-- Logs begin at Wed 2022-05-11 19:59:17 UTC, end at Wed 2022-05-11 21:23:57 UTC. -- May 11 20:44:26.841655 dv-cinder-841467-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 11 20:44:26.852033 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 11 20:44:26.854085 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 20:44:26 2022] *** May 11 20:44:26.854085 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 20:44:26.854085 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 20:44:26.854085 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: nodename: dv-cinder-841467-1-iscsi May 11 20:44:26.854085 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: machine: x86_64 May 11 20:44:26.854085 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: clock source: unix May 11 20:44:26.854085 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: pcre jit disabled May 11 20:44:26.854085 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: detected number of CPU cores: 4 May 11 20:44:26.854085 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: current working directory: / May 11 20:44:26.854085 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: detected binary path: /usr/bin/uwsgi-core May 11 20:44:26.854769 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: your processes number limit is 47680 May 11 20:44:26.854769 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: your memory page size is 4096 bytes May 11 20:44:26.854769 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: detected max file descriptor number: 2048 May 11 20:44:26.854769 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: lock engine: pthread robust mutexes May 11 20:44:26.854769 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: thunder lock: enabled May 11 20:44:26.854769 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 11 20:44:26.854769 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 20:44:26.899821 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: Python main interpreter initialized at 0x556463f809c0 May 11 20:44:26.899821 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: python threads support enabled May 11 20:44:26.899821 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: your server socket listen backlog is limited to 100 connections May 11 20:44:26.899821 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: your mercy for graceful operations on workers is 90 seconds May 11 20:44:26.900159 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: mapped 403077 bytes (393 KB) for 2 cores May 11 20:44:26.900237 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: *** Operational MODE: preforking *** May 11 20:44:26.900505 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: *** uWSGI is running in multiple interpreter mode *** May 11 20:44:26.900505 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: spawned uWSGI master process (pid: 80181) May 11 20:44:26.900694 dv-cinder-841467-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 11 20:44:26.902702 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: spawned uWSGI worker 1 (pid: 80192, cores: 1) May 11 20:44:26.902702 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: spawned uWSGI worker 2 (pid: 80193, cores: 1) May 11 20:44:26.902702 dv-cinder-841467-1-iscsi devstack@keystone.service[80181]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 20:44:32.600594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 20:44:32.600594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: from cryptography.utils import int_from_bytes May 11 20:44:32.601370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 20:44:32.601370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: from cryptography.utils import int_from_bytes May 11 20:44:32.601860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 20:44:32.601860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: from cryptography.utils import int_from_bytes May 11 20:44:32.602060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 20:44:32.602060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: from cryptography.utils import int_from_bytes May 11 20:44:32.650367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 20:44:32.650514 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 20:44:32.650600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 20:44:32.650689 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 20:44:32.650773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] command line args: [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 20:44:32.650846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] command line args: [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 20:44:32.650982 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 20:44:32.651097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 20:44:32.651185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ================================================================================ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 20:44:32.651270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ================================================================================ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 20:44:32.651397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] admin_token = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.651516 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] admin_token = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.651641 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] config_dir = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.651763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] config_dir = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.651843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.651957 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.652037 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] config_source = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.652139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] config_source = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.652227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] debug = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.652307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] debug = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.652380 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.652587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.652679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.652741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.652880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.652966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.653104 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.653191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.653352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.653432 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.653605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.653702 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.653809 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] log_config_append = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.653891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_config_append = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.653958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.654022 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.654135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_dir = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.654273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] log_dir = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.654273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] log_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.654557 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.654667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.654808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.654884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.655009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.655086 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.655207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.655289 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.655408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.655484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.655609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.655685 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.655803 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.655878 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.655999 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.656140 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.656222 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.656300 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.656371 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.656443 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.656515 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.656640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.656762 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.656838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.657460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.657618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.657705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.657868 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.657954 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.658140 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.658225 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.658620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.35/identity {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.658770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.35/identity {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.658848 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] publish_errors = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.658975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] publish_errors = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.659063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.659137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.659253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.659334 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.659406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.659525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.659632 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.659795 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.659871 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.659948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.660077 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] standard_threads = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.660160 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] standard_threads = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.660300 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.660379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.660542 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.660625 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.660713 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.660793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.660871 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] use_journal = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.660943 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_journal = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.661035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] use_json = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.661113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_json = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.661192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] use_stderr = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.661266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_stderr = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.661366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] use_syslog = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.661450 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_syslog = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.661616 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.661697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 20:44:32.661874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.661954 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.662110 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.662194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.662370 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.662455 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.662610 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.662695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.662856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.662939 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.663091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.663175 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.663339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.663425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.663571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.663649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.663817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.663896 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.664064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.664142 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.664309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.664393 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.664542 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.664625 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.664770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.664852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.665006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.665090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.665253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.665337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.665497 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.665605 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.665754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.665833 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.666006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.666090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.666260 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.666344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.666500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.666584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.666734 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.666811 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.666987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.667072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.667241 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.667318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.667492 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.667579 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.667738 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.667823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.667967 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.668044 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.668196 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.668282 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.668425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.668508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.668655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.668732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.668900 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.668986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.669144 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.669228 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.669371 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.669481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.669631 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.669743 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.669841 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.669943 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.670091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.670195 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.670324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.670440 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.670576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.670682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.670792 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.670889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.671028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.671158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.671251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.671329 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.671469 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.671579 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.671697 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.671793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.671927 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.672007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.672154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.672230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.672391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.672484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.672688 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.673309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.673447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.673555 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.673707 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.673808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.673944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.674020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.674178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.674264 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.674412 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.674490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.674661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.674743 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.674903 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.675030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.675123 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.675191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.675351 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.675440 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.675588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.675667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.675823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.675990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.676097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.676174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.676302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.676381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.676505 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.676583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.676729 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.676811 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.676963 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.677043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.677194 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.677282 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.677434 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.677519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.677695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.677776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.677928 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.678008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.678162 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.678253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.678396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.678474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.678659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.678738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.678895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.678974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.679139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.679217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.679381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.679466 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.679613 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.679694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.679846 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.679932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.680080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.680164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.680429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.680516 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.680671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.680750 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.680907 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.680987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.681152 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.681230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.681386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.681465 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.681645 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.681737 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.681880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.681960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.682116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.682197 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.682350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.682430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.682613 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.682702 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.682855 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.682933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.683092 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.683169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.683328 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.683415 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.683569 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.683648 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.683802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.683880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.684036 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.684124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.684272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.684350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.684498 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.684582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.684728 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.684816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.684956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.685036 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.685189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.685275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.685417 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.685508 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.685676 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.685757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.685910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.685990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.686155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.686246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.686392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.686473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.686644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.686722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.686902 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.686992 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.687143 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.687223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.687372 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.external = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.687453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.external = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.687603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.687688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.687892 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.687997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.688123 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.688209 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.688397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.password = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.688476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.password = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.688635 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.token = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.688727 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] auth.token = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.688871 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.688952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.689105 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.689185 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.689350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.689447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.689601 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.689689 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.689852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.689931 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.690096 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.690187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.690327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.690412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.690560 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.690641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.690806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.690962 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.691040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.691112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.691288 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.691374 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.691526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.691613 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.691764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.691844 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.691995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.692077 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.692254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.692342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.692510 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.692590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.692746 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.692825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.692996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.693084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.693277 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.693357 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.693519 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.693656 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.693797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.693891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.694038 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.694129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.694293 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.694372 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.694523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.694610 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.694757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.694838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.695000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.695080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.695244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.695333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.695473 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.695559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.695715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.695794 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.695948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.696030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.696200 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.696279 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.696431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.696511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.696684 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.696765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.696919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.697000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.697163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.697251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.697395 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.697481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.697661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.697743 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.697908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.697989 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.698142 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.698223 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.698372 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.698451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.698615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.698705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.698843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.698930 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.699078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.699159 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.699323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.699404 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.699569 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.699650 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.699799 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.699879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.700027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.700108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.700255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.700336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.700496 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.700575 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.700738 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.700816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.700982 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.701064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.701234 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.701314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.701476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.701631 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.701764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.701846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.701998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.702078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.702232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.702312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.702463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.702545 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.702696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.702776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.702926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.703004 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.703162 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.703270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.703395 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.703511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.703636 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.703898 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.703997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.704136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.704216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.704368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.704449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.704616 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.704706 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.704853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.704933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.705085 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.705165 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.705331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.705422 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.705581 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.705666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.705825 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.705906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.706085 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.706199 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.706277 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.706352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.706507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.706593 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.706739 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.706823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.706974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.707054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.707206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.707293 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.707441 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.707524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.707687 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.707767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.707916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.707996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.708148 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.708231 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.708373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.708453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.708619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.708708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.708857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.708939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.709090 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.709177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.709323 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.709403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.709572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.709658 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.709806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.709886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.710042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.710124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.710284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.710366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.710516 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.710599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.710761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.710846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.711006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.711090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.711240 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.711320 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.711469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.711550 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.711694 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.711776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.711926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.712007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.712162 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.712242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.712394 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.712481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.712630 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.712712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.712875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.712955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.713118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.713199 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.713362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.713443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.713631 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.713716 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.713874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.713953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.714094 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.714174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.714329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.714409 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.714562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.714644 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.714795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.714876 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.715030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.715164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.715302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.715432 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.715580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.715718 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.715870 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.715998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.716135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.716265 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.716393 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.716522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.716650 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.716779 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.716916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.717046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.717302 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.717431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.717585 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.717721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.717858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.717987 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.718114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.718242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.718370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.718506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.718636 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.718764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.718891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.719029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.719156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.719297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.719442 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.720081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.720210 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.720396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.720550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.720688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.720818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.720818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.721059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.721187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.721315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.721451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.721651 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.721786 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.721917 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.722045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] role.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.722173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.722311 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] role.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.722440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] role.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.722568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.722694 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] role.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.722822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.722956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.723085 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.723217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.723345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.723471 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.723608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.723744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.723873 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.724008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.724138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.724266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.724394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.724528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.724658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.724787 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.724916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.725042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.725171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.725317 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.725447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.725620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.725746 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.725875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.726003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.726142 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.726142 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.726389 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.726389 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.726630 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.726758 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.726893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.727032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.727161 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.727289 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.727418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.727546 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.727682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.727811 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.727941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.728070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.728197 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.728333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.728463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.728592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.728730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.728859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.728986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.729121 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.729250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.729377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.729507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.729662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.729743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.729827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.729903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.729977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.730050 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.730123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.730196 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.730277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.730353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.730426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.730498 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.730571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.730643 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.730724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.730800 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.730873 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.730946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.731019 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.731091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.731091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.731233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.731307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.731380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.731453 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.731525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.731606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.731682 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.731755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.731830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.731904 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.731976 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.732057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.732132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.732205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.732278 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.732350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.732422 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.732550 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.732643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.732794 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.732880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.733041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.733121 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.733273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.733354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.733513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.733630 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.733831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.733912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.734087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.734181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.734332 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.734425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.734569 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.734651 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.734802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.734883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.735036 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.735139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.735842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.735917 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.736067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.736149 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.736302 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.736391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.736534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.736614 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.736773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.736854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.737003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.737092 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.737241 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.737321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.737469 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.737571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.737738 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.737834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.737973 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.738054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.738200 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.738280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.738429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.738518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.738662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.738743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.738817 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 20:44:32.738891 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 20:44:32.739046 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 20:44:32.769365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.769621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.769709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.769849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.769936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.770075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.778477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.778732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.807495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.807745 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.808534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.808534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.871261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.871520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.923309 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.923538 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.924786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.925023 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.989378 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.989632 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.989862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.989947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.990085 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.990169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.990306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.990402 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.990525 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.990608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.990746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:32.990964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.013418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.013676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.013805 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.013890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.014043 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.014140 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.014271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.014355 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.014497 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.014580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.014722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.014813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.014943 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.015159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.026724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.027064 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.041610 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.041844 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.041929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.042074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.042156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.042300 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.042384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.042523 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.042606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.042740 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.042823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.042956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.043057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.043170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80193) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 11 20:44:33.060169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.060380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 20:44:33.060700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.060788 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.060902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 20:44:33.060985 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 20:44:33.061170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.061253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.061422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 11 20:44:33.061506 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.061705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.061788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.061958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.062053 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.062213 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.062465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.072995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.073271 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.073401 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.073563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.073710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.073845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.073978 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.074256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.082459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.082869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.085760 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.086039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.086149 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.086320 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.086427 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.086708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.086790 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.086990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.087081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.087254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.087367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.087528 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.087610 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.087805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.087896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.088074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.088158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.088345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.088427 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.088611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.088693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.088901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.115573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.115725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.117172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.117327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.117451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.117624 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.122734 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.122854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.122971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.123132 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.123249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.123411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.130526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.130670 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.130808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.130950 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.135410 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.135544 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.135708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.135826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.135961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.136104 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.136239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.136382 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.136511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.136654 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.136780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.136926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.137047 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.137196 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.137312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.137462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.156594 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.156729 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.156868 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.157557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.161952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.162039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.165518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.165615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.165836 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.165921 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.170763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.170850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.174356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.174462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.178067 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.178159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.178365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.178449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.178643 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.178727 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.178921 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.179005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.179193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.179279 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.179466 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.179549 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.198855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.198959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.199226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.199310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.199494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.199577 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.199759 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.199844 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.208268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.208360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.209988 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.210072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.210262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.210345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.213294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.213378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.213593 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.213691 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.213872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.213957 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.214153 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.214236 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.214428 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.214511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.227762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.227852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.228040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.228124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.228319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.228403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.228616 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.228700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.228897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.228989 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.229178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.229261 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.229453 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.229557 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.247368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.247587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.250623 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.251381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.254496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.254684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.256110 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.256281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.257746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.257931 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.258016 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.258207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.258292 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.258494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.265664 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.265927 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.267808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.268139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.271311 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.271605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.271701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.271890 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.271974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.272166 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.272249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.272449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.281285 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.281568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.281655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.281867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.281950 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.282173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.289825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80193) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.290106 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.290189 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 11 20:44:33.290386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.290482 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.290659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.290743 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.290936 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.291020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.291213 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.291305 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.291490 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.291574 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.291760 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.291840 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.292024 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.292107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.292291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.292372 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.292557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.292646 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.292825 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.292906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.293086 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.293167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.293342 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80193) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.293513 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.293619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 11 20:44:33.332668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556463f809c0 pid: 80193 (default app) May 11 20:44:33.334497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556463f809c0 pid: 80192 (default app) May 11 20:44:33.336034 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164499de-8b9f-493e-acbb-b4e8103d5f0b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:33.336329 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164499de-8b9f-493e-acbb-b4e8103d5f0b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:33.336615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164499de-8b9f-493e-acbb-b4e8103d5f0b None None] PATH_INFO: `/v3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:33.340831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1/1] 10.222.0.35 () {50 vars in 791 bytes} [Wed May 11 20:44:33 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:44:42.168954 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a826ecc-4b55-43e1-9ef5-5c280636cac4 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:42.169484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a826ecc-4b55-43e1-9ef5-5c280636cac4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:42.169484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a826ecc-4b55-43e1-9ef5-5c280636cac4 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:42.174463 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1/2] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:44:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:44:42.179592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc7458-629a-43f1-8b9a-7b5bc545a1c1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:42.180022 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc7458-629a-43f1-8b9a-7b5bc545a1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:42.180152 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc7458-629a-43f1-8b9a-7b5bc545a1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:42.212361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG oslo_db.sqlalchemy.engines [None req-c1bc7458-629a-43f1-8b9a-7b5bc545a1c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 20:44:42.392620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG passlib.handlers.bcrypt [None req-c1bc7458-629a-43f1-8b9a-7b5bc545a1c1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80193) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 20:44:42.393029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG passlib.handlers.bcrypt [None req-c1bc7458-629a-43f1-8b9a-7b5bc545a1c1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80193) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 20:44:42.448118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c1bc7458-629a-43f1-8b9a-7b5bc545a1c1 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:44:42.449676 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c1bc7458-629a-43f1-8b9a-7b5bc545a1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:44:42.569869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 2/3] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:44:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 11 20:44:42.756957 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a826ecc-4b55-43e1-9ef5-5c280636cac4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:42.789921 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG oslo_db.sqlalchemy.engines [None req-6a826ecc-4b55-43e1-9ef5-5c280636cac4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 20:44:42.915381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a826ecc-4b55-43e1-9ef5-5c280636cac4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:42.919820 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b8d96-caec-4ebe-b40c-c63aa9b09f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:42.920480 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b8d96-caec-4ebe-b40c-c63aa9b09f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:42.920763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b8d96-caec-4ebe-b40c-c63aa9b09f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:42.921037 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b8d96-caec-4ebe-b40c-c63aa9b09f71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:42.929430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b8d96-caec-4ebe-b40c-c63aa9b09f71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:42.980683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7c0b8d96-caec-4ebe-b40c-c63aa9b09f71 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 20:44:42.981018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b8d96-caec-4ebe-b40c-c63aa9b09f71 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:42.990897 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 2/4] 10.222.0.35 () {58 vars in 1324 bytes} [Wed May 11 20:44:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 20:44:42.996770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc7458-629a-43f1-8b9a-7b5bc545a1c1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:43.011236 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc7458-629a-43f1-8b9a-7b5bc545a1c1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:43.015599 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d9b0d-50fb-4b5f-8257-5be56a9f7d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:43.016712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d9b0d-50fb-4b5f-8257-5be56a9f7d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:43.017001 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d9b0d-50fb-4b5f-8257-5be56a9f7d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:43.017284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d9b0d-50fb-4b5f-8257-5be56a9f7d9e admin admin] PATH_INFO: `/v3/projects/2831911a3b2e4e6f87ef9844395d784e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:43.018827 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d9b0d-50fb-4b5f-8257-5be56a9f7d9e admin admin] RBAC: Authorizing `identity:get_project(project_id=2831911a3b2e4e6f87ef9844395d784e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:43.069248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dc9d9b0d-50fb-4b5f-8257-5be56a9f7d9e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 11 20:44:43.069608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d9b0d-50fb-4b5f-8257-5be56a9f7d9e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:43.074134 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 3/5] 10.222.0.35 () {56 vars in 1207 bytes} [Wed May 11 20:44:42 2022] GET /identity/v3/projects/2831911a3b2e4e6f87ef9844395d784e => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:44:45.234123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c137-c1b9-4e8f-ac2a-d88da9230978 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:45.234644 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c137-c1b9-4e8f-ac2a-d88da9230978 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:45.234748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c137-c1b9-4e8f-ac2a-d88da9230978 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:45.238841 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 3/6] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:44:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:44:45.244309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6f508-42f3-4183-8a72-27b50866c0e0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:45.244744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6f508-42f3-4183-8a72-27b50866c0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:45.244875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6f508-42f3-4183-8a72-27b50866c0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:45.264905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-91d6f508-42f3-4183-8a72-27b50866c0e0 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:44:45.267070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-91d6f508-42f3-4183-8a72-27b50866c0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:44:45.275306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 4/7] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:44:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 11 20:44:45.296719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38c137-c1b9-4e8f-ac2a-d88da9230978 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:45.308474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38c137-c1b9-4e8f-ac2a-d88da9230978 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:45.313215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd326ac-8474-4308-aeb4-0e67516ddfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:45.313883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd326ac-8474-4308-aeb4-0e67516ddfec admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:45.314175 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd326ac-8474-4308-aeb4-0e67516ddfec admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:45.314452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd326ac-8474-4308-aeb4-0e67516ddfec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:45.322035 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd326ac-8474-4308-aeb4-0e67516ddfec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:45.323857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd326ac-8474-4308-aeb4-0e67516ddfec admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:45.333089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 4/8] 10.222.0.35 () {58 vars in 1324 bytes} [Wed May 11 20:44:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 20:44:45.338408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6f508-42f3-4183-8a72-27b50866c0e0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:45.347129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6f508-42f3-4183-8a72-27b50866c0e0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:45.351505 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be110abe-2ae1-4737-be0c-223b361172ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:45.352358 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be110abe-2ae1-4737-be0c-223b361172ec admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:45.352643 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be110abe-2ae1-4737-be0c-223b361172ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:45.352921 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be110abe-2ae1-4737-be0c-223b361172ec admin admin] PATH_INFO: `/v3/users/3529d1a9e25d41d4bfc8bab9cf496381` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:45.354326 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be110abe-2ae1-4737-be0c-223b361172ec admin admin] RBAC: Authorizing `identity:get_user(user_id=3529d1a9e25d41d4bfc8bab9cf496381)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:45.356138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be110abe-2ae1-4737-be0c-223b361172ec admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:45.357710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 5/9] 10.222.0.35 () {56 vars in 1198 bytes} [Wed May 11 20:44:45 2022] GET /identity/v3/users/3529d1a9e25d41d4bfc8bab9cf496381 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:44:47.613723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58581f3e-f903-4f04-b93f-d702035904de None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:47.614249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58581f3e-f903-4f04-b93f-d702035904de None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:47.614347 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58581f3e-f903-4f04-b93f-d702035904de None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:47.615630 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 5/10] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:44:47.621004 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9f7f9-f1cc-4700-9434-76f0f8bb3350 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:47.621425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9f7f9-f1cc-4700-9434-76f0f8bb3350 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:47.621603 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9f7f9-f1cc-4700-9434-76f0f8bb3350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:47.637066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e6c58-fd9b-4992-8bc4-48329bbade60 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:47.637357 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e6c58-fd9b-4992-8bc4-48329bbade60 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:47.637714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e6c58-fd9b-4992-8bc4-48329bbade60 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:47.639095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 6/11] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:44:47.645893 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4deeb3d-ac36-46ca-a872-11aa6a13d03b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:47.646185 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4deeb3d-ac36-46ca-a872-11aa6a13d03b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:47.646470 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4deeb3d-ac36-46ca-a872-11aa6a13d03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:47.688158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG passlib.handlers.bcrypt [None req-e4deeb3d-ac36-46ca-a872-11aa6a13d03b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80192) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 11 20:44:47.688582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG passlib.handlers.bcrypt [None req-e4deeb3d-ac36-46ca-a872-11aa6a13d03b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80192) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 11 20:44:47.735748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e4deeb3d-ac36-46ca-a872-11aa6a13d03b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:44:47.737377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e4deeb3d-ac36-46ca-a872-11aa6a13d03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:44:47.746040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-01a9f7f9-f1cc-4700-9434-76f0f8bb3350 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:44:47.747203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-01a9f7f9-f1cc-4700-9434-76f0f8bb3350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:44:47.824754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 6/12] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:44:47.836119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 7/13] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:44:47.848710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9f7f9-f1cc-4700-9434-76f0f8bb3350 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:47.858002 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4deeb3d-ac36-46ca-a872-11aa6a13d03b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:47.942482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9f7f9-f1cc-4700-9434-76f0f8bb3350 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:47.951793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4deeb3d-ac36-46ca-a872-11aa6a13d03b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:47.974531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef929f06-bdbb-4422-ae59-3714465efde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:47.975316 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef929f06-bdbb-4422-ae59-3714465efde2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:47.975597 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef929f06-bdbb-4422-ae59-3714465efde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:47.975870 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef929f06-bdbb-4422-ae59-3714465efde2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:47.984781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f729042-71fe-4b60-bf5d-e5da68a7858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:47.985792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f729042-71fe-4b60-bf5d-e5da68a7858b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:47.986086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f729042-71fe-4b60-bf5d-e5da68a7858b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:47.986368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f729042-71fe-4b60-bf5d-e5da68a7858b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:47.986465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef929f06-bdbb-4422-ae59-3714465efde2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ef929f06-bdbb-4422-ae59-3714465efde2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:44:47.997477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:44:47.998442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:44:47.999361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:44:47.999361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:44:47.999361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:44:47.999361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:44:47.999361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:44:47.999361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:44:47.999361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:44:47.999361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:44:47.999361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:44:47.999361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:44:47.999361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:44:47.999361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:44:47.999361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 7/14] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:44:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:44:48.004492 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef929f06-bdbb-4422-ae59-3714465efde2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:48.052304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f729042-71fe-4b60-bf5d-e5da68a7858b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:48.053855 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f729042-71fe-4b60-bf5d-e5da68a7858b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:48.098736 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef929f06-bdbb-4422-ae59-3714465efde2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:48.130383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044475-e640-4419-b4ef-1077d717b096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:48.131248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044475-e640-4419-b4ef-1077d717b096 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:48.131534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044475-e640-4419-b4ef-1077d717b096 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:48.131814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044475-e640-4419-b4ef-1077d717b096 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:48.132559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87044475-e640-4419-b4ef-1077d717b096 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:44:48.132870 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87044475-e640-4419-b4ef-1077d717b096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:48.134290 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87044475-e640-4419-b4ef-1077d717b096 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:48.146583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 8/15] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:44:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 20:44:48.146737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 8/16] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:44:48.152035 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f729042-71fe-4b60-bf5d-e5da68a7858b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:48.152162 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044475-e640-4419-b4ef-1077d717b096 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:48.244971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044475-e640-4419-b4ef-1077d717b096 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:48.246344 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f729042-71fe-4b60-bf5d-e5da68a7858b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:48.278919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0faea-bc62-4123-8978-28f20c319a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:48.279114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a331ac-6ce0-4e5d-8ad1-208b7c504258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:48.279756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a331ac-6ce0-4e5d-8ad1-208b7c504258 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:48.279849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0faea-bc62-4123-8978-28f20c319a80 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:48.280043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a331ac-6ce0-4e5d-8ad1-208b7c504258 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:48.280135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0faea-bc62-4123-8978-28f20c319a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:48.280322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a331ac-6ce0-4e5d-8ad1-208b7c504258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:48.280417 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0faea-bc62-4123-8978-28f20c319a80 None admin] PATH_INFO: `/v3/users/3529d1a9e25d41d4bfc8bab9cf496381` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:48.281598 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0faea-bc62-4123-8978-28f20c319a80 None admin] RBAC: Authorizing `identity:get_user(user_id=3529d1a9e25d41d4bfc8bab9cf496381)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:48.283055 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0faea-bc62-4123-8978-28f20c319a80 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:48.284659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 9/17] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:44:48 2022] GET /identity/v3/users/3529d1a9e25d41d4bfc8bab9cf496381 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:44:48.290121 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0faea-bc62-4123-8978-28f20c319a80 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:48.389808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0faea-bc62-4123-8978-28f20c319a80 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:48.405926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a331ac-6ce0-4e5d-8ad1-208b7c504258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:48.407436 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a331ac-6ce0-4e5d-8ad1-208b7c504258 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:48.422983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724452c8-989f-4b14-a4e0-cd6ec4e421f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:48.423785 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724452c8-989f-4b14-a4e0-cd6ec4e421f5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:48.424075 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724452c8-989f-4b14-a4e0-cd6ec4e421f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:48.424352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724452c8-989f-4b14-a4e0-cd6ec4e421f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:48.425564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724452c8-989f-4b14-a4e0-cd6ec4e421f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:48.426995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724452c8-989f-4b14-a4e0-cd6ec4e421f5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-27a331ac-6ce0-4e5d-8ad1-208b7c504258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:44:48.427875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:44:48.428773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:44:48.429626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:44:48.429626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:44:48.429626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:44:48.429626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:44:48.429845 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 10/18] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:44:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:44:48.429915 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 9/19] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:44:48.434247 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724452c8-989f-4b14-a4e0-cd6ec4e421f5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:48.434601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a331ac-6ce0-4e5d-8ad1-208b7c504258 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:48.527404 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724452c8-989f-4b14-a4e0-cd6ec4e421f5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:48.529799 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a331ac-6ce0-4e5d-8ad1-208b7c504258 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:48.558507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b28620-e51a-4a56-8f92-7ed238eb5bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:48.559156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b28620-e51a-4a56-8f92-7ed238eb5bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:48.559437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b28620-e51a-4a56-8f92-7ed238eb5bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:48.559710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b28620-e51a-4a56-8f92-7ed238eb5bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:48.560532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b28620-e51a-4a56-8f92-7ed238eb5bc4 None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.domain.id=default, user.id=3529d1a9e25d41d4bfc8bab9cf496381) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:44:48.560840 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b28620-e51a-4a56-8f92-7ed238eb5bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:48.561357 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1df0b0-b31c-4b16-97bd-80b71c457480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:48.562053 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1df0b0-b31c-4b16-97bd-80b71c457480 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:48.562306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b28620-e51a-4a56-8f92-7ed238eb5bc4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:48.562404 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1df0b0-b31c-4b16-97bd-80b71c457480 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:48.563144 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1df0b0-b31c-4b16-97bd-80b71c457480 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:48.563873 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1df0b0-b31c-4b16-97bd-80b71c457480 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:44:48.564187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1df0b0-b31c-4b16-97bd-80b71c457480 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:48.565575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1df0b0-b31c-4b16-97bd-80b71c457480 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:48.569275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 11/20] 10.222.0.35 () {56 vars in 1322 bytes} [Wed May 11 20:44:48 2022] GET /identity/v3/role_assignments?user.id=3529d1a9e25d41d4bfc8bab9cf496381&scope.domain.id=default&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 233 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:44:48.584587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 10/21] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:44:51.463114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99da54-d490-4d98-b94d-82c4afc3a3f6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:51.463653 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99da54-d490-4d98-b94d-82c4afc3a3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:51.463653 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99da54-d490-4d98-b94d-82c4afc3a3f6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:51.465377 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 12/22] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:44:51.471255 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69a35-e8fe-4b46-a50e-58e6f4d804cc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:51.471796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69a35-e8fe-4b46-a50e-58e6f4d804cc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:51.471796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c69a35-e8fe-4b46-a50e-58e6f4d804cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:51.493896 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-62c69a35-e8fe-4b46-a50e-58e6f4d804cc None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:44:51.495471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-62c69a35-e8fe-4b46-a50e-58e6f4d804cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:44:51.509484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3c827-128b-4d8a-9479-97eb3ec3f295 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:51.510153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3c827-128b-4d8a-9479-97eb3ec3f295 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:51.510636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3c827-128b-4d8a-9479-97eb3ec3f295 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:51.512228 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 13/23] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:44:51.518955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e207518-a5e6-465e-8ee9-d2ab76bb7e73 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:51.519814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e207518-a5e6-465e-8ee9-d2ab76bb7e73 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:51.520295 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e207518-a5e6-465e-8ee9-d2ab76bb7e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:51.538377 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7e207518-a5e6-465e-8ee9-d2ab76bb7e73 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:44:51.539932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7e207518-a5e6-465e-8ee9-d2ab76bb7e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:44:51.627456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 11/24] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:44:51.630971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfd7ed-b134-42fd-8d24-58eb248d5701 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:51.632822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfd7ed-b134-42fd-8d24-58eb248d5701 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:51.634231 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfd7ed-b134-42fd-8d24-58eb248d5701 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:51.635706 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 12/25] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:44:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:44:51.641499 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19caf8e-ec53-4485-9c1d-391f4a59b2a6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:51.642058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19caf8e-ec53-4485-9c1d-391f4a59b2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:51.643782 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19caf8e-ec53-4485-9c1d-391f4a59b2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:51.653666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 14/26] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:44:51.668217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e207518-a5e6-465e-8ee9-d2ab76bb7e73 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:51.671116 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c19caf8e-ec53-4485-9c1d-391f4a59b2a6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:44:51.672598 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c19caf8e-ec53-4485-9c1d-391f4a59b2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:44:51.779077 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 13/27] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:44:51.779077 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19caf8e-ec53-4485-9c1d-391f4a59b2a6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:51.779348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e207518-a5e6-465e-8ee9-d2ab76bb7e73 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:51.814500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096519c-2875-4255-83c0-8fc347751264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:51.815540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096519c-2875-4255-83c0-8fc347751264 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:51.815993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096519c-2875-4255-83c0-8fc347751264 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:51.816429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096519c-2875-4255-83c0-8fc347751264 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:51.817340 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096519c-2875-4255-83c0-8fc347751264 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:51.819232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096519c-2875-4255-83c0-8fc347751264 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:51.873199 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19caf8e-ec53-4485-9c1d-391f4a59b2a6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:51.912035 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a6a84-102a-472d-a693-0c38b0164e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:51.913208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a6a84-102a-472d-a693-0c38b0164e1f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:51.913819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a6a84-102a-472d-a693-0c38b0164e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:51.914341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a6a84-102a-472d-a693-0c38b0164e1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:51.926355 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a6a84-102a-472d-a693-0c38b0164e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-cc1a6a84-102a-472d-a693-0c38b0164e1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:44:51.936052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:44:51.936908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:44:51.938780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:44:51.938780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:44:51.938780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:44:51.938780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:44:51.938780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:44:51.938780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:44:51.938780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:44:51.938780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:44:51.938780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:44:51.938780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:44:51.938780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:44:51.938780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:44:51.941322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 14/28] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:44:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:44:51.943166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ae372-7fd1-43ac-beda-6e72c833dc67 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:51.943676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ae372-7fd1-43ac-beda-6e72c833dc67 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:51.944238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ae372-7fd1-43ac-beda-6e72c833dc67 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:51.946571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 15/29] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:44:51.947494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ae372-7fd1-43ac-beda-6e72c833dc67 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:52.010188 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 15/30] 10.222.0.35 () {60 vars in 1131 bytes} [Wed May 11 20:44:51 2022] POST /identity/v3/roles => generated 225 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:44:52.011571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096519c-2875-4255-83c0-8fc347751264 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:52.115655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ae372-7fd1-43ac-beda-6e72c833dc67 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:52.189622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096519c-2875-4255-83c0-8fc347751264 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:52.191744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd62d5-dd04-4e41-a07d-5a127c59abd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:52.192443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd62d5-dd04-4e41-a07d-5a127c59abd2 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:52.192733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd62d5-dd04-4e41-a07d-5a127c59abd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:52.193862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd62d5-dd04-4e41-a07d-5a127c59abd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:52.193862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd62d5-dd04-4e41-a07d-5a127c59abd2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:52.195230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd62d5-dd04-4e41-a07d-5a127c59abd2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:52.227405 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbad3a-8272-444c-a1b0-68a489e50599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:52.228483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbad3a-8272-444c-a1b0-68a489e50599 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:52.229022 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbad3a-8272-444c-a1b0-68a489e50599 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:52.229505 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbad3a-8272-444c-a1b0-68a489e50599 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:52.230542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbad3a-8272-444c-a1b0-68a489e50599 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:44:52.231044 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbad3a-8272-444c-a1b0-68a489e50599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:52.232976 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbad3a-8272-444c-a1b0-68a489e50599 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:52.243229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 16/31] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:44:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:44:52.245070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a8ea-6c64-462b-9e40-7d96e92d8e54 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:52.245362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a8ea-6c64-462b-9e40-7d96e92d8e54 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:52.245670 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96a8ea-6c64-462b-9e40-7d96e92d8e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:52.263968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1d96a8ea-6c64-462b-9e40-7d96e92d8e54 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:44:52.265515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1d96a8ea-6c64-462b-9e40-7d96e92d8e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:44:52.352363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 17/32] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:44:52.353723 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96a8ea-6c64-462b-9e40-7d96e92d8e54 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:52.409645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 16/33] 10.222.0.35 () {60 vars in 1131 bytes} [Wed May 11 20:44:51 2022] POST /identity/v3/roles => generated 219 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:44:52.416416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd62d5-dd04-4e41-a07d-5a127c59abd2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:52.483421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96a8ea-6c64-462b-9e40-7d96e92d8e54 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:52.520237 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da29b0-03d4-40b3-9476-3b7fe6f81ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:52.521398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da29b0-03d4-40b3-9476-3b7fe6f81ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:52.521814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da29b0-03d4-40b3-9476-3b7fe6f81ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:52.522203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da29b0-03d4-40b3-9476-3b7fe6f81ec3 None admin] PATH_INFO: `/v3/users/3529d1a9e25d41d4bfc8bab9cf496381` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:52.523555 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da29b0-03d4-40b3-9476-3b7fe6f81ec3 None admin] RBAC: Authorizing `identity:get_user(user_id=3529d1a9e25d41d4bfc8bab9cf496381)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:52.525124 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da29b0-03d4-40b3-9476-3b7fe6f81ec3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:52.526095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd62d5-dd04-4e41-a07d-5a127c59abd2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:52.527481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 18/34] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:44:52 2022] GET /identity/v3/users/3529d1a9e25d41d4bfc8bab9cf496381 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:44:52.533624 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da29b0-03d4-40b3-9476-3b7fe6f81ec3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:52.632021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2dcf3-c8c9-4cf9-af03-7501bd689343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:52.633148 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2dcf3-c8c9-4cf9-af03-7501bd689343 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:52.633791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2dcf3-c8c9-4cf9-af03-7501bd689343 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:52.634234 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2dcf3-c8c9-4cf9-af03-7501bd689343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:52.648991 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2dcf3-c8c9-4cf9-af03-7501bd689343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:52.651849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2dcf3-c8c9-4cf9-af03-7501bd689343 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:52.657693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da29b0-03d4-40b3-9476-3b7fe6f81ec3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ade2dcf3-c8c9-4cf9-af03-7501bd689343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:44:52.676684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:44:52.677556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:44:52.678384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:44:52.678384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:44:52.678384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:44:52.678384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:44:52.686016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 17/35] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:44:52.686016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bce8a-9366-4891-bc6b-91ad625e4d49 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:52.686016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bce8a-9366-4891-bc6b-91ad625e4d49 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:52.686016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bce8a-9366-4891-bc6b-91ad625e4d49 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:52.686016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 18/36] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:44:52.686016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bce8a-9366-4891-bc6b-91ad625e4d49 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:52.707205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cb63d-c608-4439-83c3-06c34ca8037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:52.708036 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cb63d-c608-4439-83c3-06c34ca8037f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:52.708536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cb63d-c608-4439-83c3-06c34ca8037f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:52.708637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cb63d-c608-4439-83c3-06c34ca8037f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:52.709836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cb63d-c608-4439-83c3-06c34ca8037f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:52.711312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cb63d-c608-4439-83c3-06c34ca8037f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:52.712962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 19/37] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:44:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:44:52.714163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232ad3-54ae-492b-b888-3d622cf4b9c3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:52.714521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232ad3-54ae-492b-b888-3d622cf4b9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:52.714811 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232ad3-54ae-492b-b888-3d622cf4b9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:52.735116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cc232ad3-54ae-492b-b888-3d622cf4b9c3 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:44:52.738293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cc232ad3-54ae-492b-b888-3d622cf4b9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:44:52.802902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bce8a-9366-4891-bc6b-91ad625e4d49 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:52.807145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 20/38] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:44:52.807975 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232ad3-54ae-492b-b888-3d622cf4b9c3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:52.844512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd2f1a-a008-4db7-835e-12b78efabc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:52.844783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd2f1a-a008-4db7-835e-12b78efabc6c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:52.845074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd2f1a-a008-4db7-835e-12b78efabc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:52.845358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd2f1a-a008-4db7-835e-12b78efabc6c None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:52.846643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd2f1a-a008-4db7-835e-12b78efabc6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:44:52.846958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd2f1a-a008-4db7-835e-12b78efabc6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:52.848365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd2f1a-a008-4db7-835e-12b78efabc6c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:52.860227 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 19/39] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:44:52.861313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b29ffa-6083-4895-ba16-02852c9c33ed None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:52.861640 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b29ffa-6083-4895-ba16-02852c9c33ed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:52.861927 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b29ffa-6083-4895-ba16-02852c9c33ed None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:52.863161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 20/40] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:44:52.863862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b29ffa-6083-4895-ba16-02852c9c33ed None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:52.908039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232ad3-54ae-492b-b888-3d622cf4b9c3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:52.940251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97d49b-9298-4e3d-91d6-2dd1958c7649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:52.941056 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97d49b-9298-4e3d-91d6-2dd1958c7649 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:52.941346 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97d49b-9298-4e3d-91d6-2dd1958c7649 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:52.941667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97d49b-9298-4e3d-91d6-2dd1958c7649 None admin] PATH_INFO: `/v3/domains/default/users/3529d1a9e25d41d4bfc8bab9cf496381/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:52.943713 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97d49b-9298-4e3d-91d6-2dd1958c7649 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3529d1a9e25d41d4bfc8bab9cf496381, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:52.945170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97d49b-9298-4e3d-91d6-2dd1958c7649 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:52.961335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b29ffa-6083-4895-ba16-02852c9c33ed None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:52.993919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97cf8b-d2f5-4f16-90e4-354f79f5e1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:52.994739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97cf8b-d2f5-4f16-90e4-354f79f5e1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:52.995030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97cf8b-d2f5-4f16-90e4-354f79f5e1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:52.995321 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97cf8b-d2f5-4f16-90e4-354f79f5e1d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:52.996795 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97cf8b-d2f5-4f16-90e4-354f79f5e1d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:52.998278 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97cf8b-d2f5-4f16-90e4-354f79f5e1d8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:52.999891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 21/41] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:44:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:44:53.000632 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97cf8b-d2f5-4f16-90e4-354f79f5e1d8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:53.055490 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 21/42] 10.222.0.35 () {58 vars in 1361 bytes} [Wed May 11 20:44:52 2022] PUT /identity/v3/domains/default/users/3529d1a9e25d41d4bfc8bab9cf496381/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:44:53.056767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd9503-55b2-4a55-acc4-6c424a8ab210 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:53.057058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd9503-55b2-4a55-acc4-6c424a8ab210 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:53.057342 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd9503-55b2-4a55-acc4-6c424a8ab210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:53.075389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5dbd9503-55b2-4a55-acc4-6c424a8ab210 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:44:53.077059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5dbd9503-55b2-4a55-acc4-6c424a8ab210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:44:53.102008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97cf8b-d2f5-4f16-90e4-354f79f5e1d8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:53.142349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb332a8-50cf-4054-a695-10baa9ffcdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:53.143219 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb332a8-50cf-4054-a695-10baa9ffcdf2 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:53.143615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb332a8-50cf-4054-a695-10baa9ffcdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:53.144000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb332a8-50cf-4054-a695-10baa9ffcdf2 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:53.145096 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb332a8-50cf-4054-a695-10baa9ffcdf2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:53.146708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb332a8-50cf-4054-a695-10baa9ffcdf2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:53.157933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 22/43] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:44:53.159202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd9503-55b2-4a55-acc4-6c424a8ab210 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:53.261300 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd9503-55b2-4a55-acc4-6c424a8ab210 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:53.294748 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ffa49-f04d-4ba7-b0d9-c0a8b540d212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:53.295592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ffa49-f04d-4ba7-b0d9-c0a8b540d212 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:53.295978 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ffa49-f04d-4ba7-b0d9-c0a8b540d212 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:53.296363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ffa49-f04d-4ba7-b0d9-c0a8b540d212 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:53.297181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ffa49-f04d-4ba7-b0d9-c0a8b540d212 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:53.298827 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ffa49-f04d-4ba7-b0d9-c0a8b540d212 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:53.303273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 22/44] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 11 20:44:52 2022] POST /identity/v3/projects => generated 301 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:44:53.304076 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb332a8-50cf-4054-a695-10baa9ffcdf2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:53.385647 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 23/45] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 11 20:44:53 2022] POST /identity/v3/projects => generated 312 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:44:53.440863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb332a8-50cf-4054-a695-10baa9ffcdf2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:53.483702 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113aefa-bbad-4b1b-bf63-42f05e0239ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:53.484955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113aefa-bbad-4b1b-bf63-42f05e0239ad None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:53.485249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113aefa-bbad-4b1b-bf63-42f05e0239ad None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:53.485548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113aefa-bbad-4b1b-bf63-42f05e0239ad None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:53.486340 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113aefa-bbad-4b1b-bf63-42f05e0239ad None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:53.487896 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113aefa-bbad-4b1b-bf63-42f05e0239ad None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:53.560763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 23/46] 10.222.0.35 () {60 vars in 1131 bytes} [Wed May 11 20:44:53 2022] POST /identity/v3/roles => generated 223 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:44:55.282208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547a1b0-e579-4960-84f8-02e85686130c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:55.282713 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547a1b0-e579-4960-84f8-02e85686130c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:55.282796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547a1b0-e579-4960-84f8-02e85686130c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:55.284151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 24/47] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:44:55.289299 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfb816-d776-4758-ab00-9fa00ed57957 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:55.289750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfb816-d776-4758-ab00-9fa00ed57957 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:55.289908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfb816-d776-4758-ab00-9fa00ed57957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:55.306826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-eebfb816-d776-4758-ab00-9fa00ed57957 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:44:55.308319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eebfb816-d776-4758-ab00-9fa00ed57957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:44:55.372213 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 24/48] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:44:55.395067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547a1b0-e579-4960-84f8-02e85686130c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:55.497150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547a1b0-e579-4960-84f8-02e85686130c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:55.528317 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb4e4c-284e-4dd2-bd32-14a082d02177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:55.529112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb4e4c-284e-4dd2-bd32-14a082d02177 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:55.529403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb4e4c-284e-4dd2-bd32-14a082d02177 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:55.529707 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb4e4c-284e-4dd2-bd32-14a082d02177 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:55.539915 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb4e4c-284e-4dd2-bd32-14a082d02177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f8eb4e4c-284e-4dd2-bd32-14a082d02177 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:44:55.548147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:44:55.549021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:44:55.549914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:44:55.549914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:44:55.549914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:44:55.549914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:44:55.549914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:44:55.549914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:44:55.549914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:44:55.549914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:44:55.549914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:44:55.549914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:44:55.549914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:44:55.549914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:44:55.549914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 25/49] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:44:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:44:55.555060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfb816-d776-4758-ab00-9fa00ed57957 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:55.612964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516b503-1eb8-4908-858f-f7af8d60ed84 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:55.613253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516b503-1eb8-4908-858f-f7af8d60ed84 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:55.613546 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516b503-1eb8-4908-858f-f7af8d60ed84 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:55.615640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 26/50] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:44:55.620165 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c6310-3c0b-4d6d-9ee3-040398d8317f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:55.620463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c6310-3c0b-4d6d-9ee3-040398d8317f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:55.620745 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c6310-3c0b-4d6d-9ee3-040398d8317f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:55.636363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c67c6310-3c0b-4d6d-9ee3-040398d8317f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:44:55.637553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c67c6310-3c0b-4d6d-9ee3-040398d8317f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:44:55.651031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfb816-d776-4758-ab00-9fa00ed57957 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:55.683440 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46161139-4bb3-4d11-89ef-c0915a3b9111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:55.684104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46161139-4bb3-4d11-89ef-c0915a3b9111 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:55.684394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46161139-4bb3-4d11-89ef-c0915a3b9111 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:55.684679 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46161139-4bb3-4d11-89ef-c0915a3b9111 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:55.685426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46161139-4bb3-4d11-89ef-c0915a3b9111 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:44:55.685766 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46161139-4bb3-4d11-89ef-c0915a3b9111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:55.687154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46161139-4bb3-4d11-89ef-c0915a3b9111 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:55.698542 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 25/51] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:44:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:44:55.700434 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 27/52] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:44:55.703699 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46161139-4bb3-4d11-89ef-c0915a3b9111 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:55.723074 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c6310-3c0b-4d6d-9ee3-040398d8317f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:55.799590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46161139-4bb3-4d11-89ef-c0915a3b9111 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:55.815962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c6310-3c0b-4d6d-9ee3-040398d8317f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:55.834126 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204eb7d6-aa4f-47e1-a9ad-a22eeae01e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:55.835003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204eb7d6-aa4f-47e1-a9ad-a22eeae01e44 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:55.835292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204eb7d6-aa4f-47e1-a9ad-a22eeae01e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:55.835711 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204eb7d6-aa4f-47e1-a9ad-a22eeae01e44 None admin] PATH_INFO: `/v3/users/3529d1a9e25d41d4bfc8bab9cf496381` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:55.837164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204eb7d6-aa4f-47e1-a9ad-a22eeae01e44 None admin] RBAC: Authorizing `identity:get_user(user_id=3529d1a9e25d41d4bfc8bab9cf496381)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:55.838645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204eb7d6-aa4f-47e1-a9ad-a22eeae01e44 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:55.840321 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 26/53] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:44:55 2022] GET /identity/v3/users/3529d1a9e25d41d4bfc8bab9cf496381 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:44:55.846219 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204eb7d6-aa4f-47e1-a9ad-a22eeae01e44 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:55.853695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc72c6c-8a77-42eb-8fd5-e15a0578047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:55.854490 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc72c6c-8a77-42eb-8fd5-e15a0578047b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:55.854778 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc72c6c-8a77-42eb-8fd5-e15a0578047b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:55.855056 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc72c6c-8a77-42eb-8fd5-e15a0578047b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:55.856226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc72c6c-8a77-42eb-8fd5-e15a0578047b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:55.857816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc72c6c-8a77-42eb-8fd5-e15a0578047b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:55.859455 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 28/54] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:44:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:44:55.864768 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc72c6c-8a77-42eb-8fd5-e15a0578047b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:55.940515 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204eb7d6-aa4f-47e1-a9ad-a22eeae01e44 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:55.957807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc72c6c-8a77-42eb-8fd5-e15a0578047b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:55.973127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb5247-8910-4b4f-96cc-01e880a4f0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:55.973960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb5247-8910-4b4f-96cc-01e880a4f0bc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:55.974248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb5247-8910-4b4f-96cc-01e880a4f0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:55.974530 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb5247-8910-4b4f-96cc-01e880a4f0bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:55.975720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb5247-8910-4b4f-96cc-01e880a4f0bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:55.977165 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb5247-8910-4b4f-96cc-01e880a4f0bc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:55.978915 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 27/55] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:44:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:44:55.984550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb5247-8910-4b4f-96cc-01e880a4f0bc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:55.990757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cc723-5020-45fd-8147-c4a02c669977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:55.991490 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cc723-5020-45fd-8147-c4a02c669977 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:55.991844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cc723-5020-45fd-8147-c4a02c669977 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:55.992211 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cc723-5020-45fd-8147-c4a02c669977 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:55.992985 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656cc723-5020-45fd-8147-c4a02c669977 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:55.994522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656cc723-5020-45fd-8147-c4a02c669977 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:56.079157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb5247-8910-4b4f-96cc-01e880a4f0bc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:56.094723 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 29/56] 10.222.0.35 () {60 vars in 1140 bytes} [Wed May 11 20:44:55 2022] POST /identity/v3/projects => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 20:44:56.112574 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabbf10-8197-4501-8acf-499bfaf1589e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:56.113262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabbf10-8197-4501-8acf-499bfaf1589e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:56.113580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabbf10-8197-4501-8acf-499bfaf1589e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:56.113866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabbf10-8197-4501-8acf-499bfaf1589e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:56.114787 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabbf10-8197-4501-8acf-499bfaf1589e None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.domain.id=default, user.id=3529d1a9e25d41d4bfc8bab9cf496381) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:44:56.115108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabbf10-8197-4501-8acf-499bfaf1589e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:56.116681 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabbf10-8197-4501-8acf-499bfaf1589e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:56.128042 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 28/57] 10.222.0.35 () {56 vars in 1322 bytes} [Wed May 11 20:44:55 2022] GET /identity/v3/role_assignments?user.id=3529d1a9e25d41d4bfc8bab9cf496381&scope.domain.id=default&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:44:58.307711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eed218-b802-44b3-815f-1f0567f893b1 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:58.308210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eed218-b802-44b3-815f-1f0567f893b1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:58.308314 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eed218-b802-44b3-815f-1f0567f893b1 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:58.309660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 30/58] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:44:58.315427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1c658-7230-481b-852b-3a8a342cfdec None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:58.315824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1c658-7230-481b-852b-3a8a342cfdec None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:58.315994 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1c658-7230-481b-852b-3a8a342cfdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:58.332246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-39c1c658-7230-481b-852b-3a8a342cfdec None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:44:58.333408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-39c1c658-7230-481b-852b-3a8a342cfdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:44:58.396176 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 29/59] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:44:58.419889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eed218-b802-44b3-815f-1f0567f893b1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:58.513398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eed218-b802-44b3-815f-1f0567f893b1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:58.544377 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f83376-4f51-4578-9c57-b8068a425f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:58.545146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f83376-4f51-4578-9c57-b8068a425f71 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:58.545432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f83376-4f51-4578-9c57-b8068a425f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:58.545738 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f83376-4f51-4578-9c57-b8068a425f71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:58.547487 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f83376-4f51-4578-9c57-b8068a425f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:58.548920 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f83376-4f51-4578-9c57-b8068a425f71 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:58.550522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 31/60] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:44:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:44:58.557510 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1c658-7230-481b-852b-3a8a342cfdec None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:44:58.648718 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1c658-7230-481b-852b-3a8a342cfdec None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:44:58.681436 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5bbd6-8b2f-4fc9-9e88-a4df1ef9d41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:44:58.682115 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5bbd6-8b2f-4fc9-9e88-a4df1ef9d41c None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:44:58.682404 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5bbd6-8b2f-4fc9-9e88-a4df1ef9d41c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:44:58.682683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5bbd6-8b2f-4fc9-9e88-a4df1ef9d41c None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:44:58.683379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5bbd6-8b2f-4fc9-9e88-a4df1ef9d41c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:44:58.684826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5bbd6-8b2f-4fc9-9e88-a4df1ef9d41c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:44:58.921471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 30/61] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:44:58 2022] POST /identity/v3/users => generated 275 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:45:02.437254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f92a77-c4a0-402c-a105-2b1c4c8bc213 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:02.437254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f92a77-c4a0-402c-a105-2b1c4c8bc213 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:02.437254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f92a77-c4a0-402c-a105-2b1c4c8bc213 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:02.438189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 32/62] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:02.439864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c61a9-2a56-4c3f-a273-45841a4c7b9f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:02.440596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c61a9-2a56-4c3f-a273-45841a4c7b9f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:02.441034 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c61a9-2a56-4c3f-a273-45841a4c7b9f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:02.442812 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 31/63] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:02.447632 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30ef37-2649-46d2-ae54-342ec63dce11 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:02.448089 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30ef37-2649-46d2-ae54-342ec63dce11 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:02.448529 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30ef37-2649-46d2-ae54-342ec63dce11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:02.466947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ea92f-b56c-42bd-921c-f452fdb314ef None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:02.467440 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ea92f-b56c-42bd-921c-f452fdb314ef None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:02.467861 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ea92f-b56c-42bd-921c-f452fdb314ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:02.474201 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3b30ef37-2649-46d2-ae54-342ec63dce11 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:02.476308 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3b30ef37-2649-46d2-ae54-342ec63dce11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:02.493407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-253ea92f-b56c-42bd-921c-f452fdb314ef None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:02.496183 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-253ea92f-b56c-42bd-921c-f452fdb314ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:02.613695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 33/64] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:02.629222 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 32/65] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:02.636690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30ef37-2649-46d2-ae54-342ec63dce11 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:02.657982 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ea92f-b56c-42bd-921c-f452fdb314ef None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:02.775160 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ea92f-b56c-42bd-921c-f452fdb314ef None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:02.809326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aacab4-d54b-4c6a-b0eb-80c849545e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:02.810645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aacab4-d54b-4c6a-b0eb-80c849545e4f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:02.811502 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aacab4-d54b-4c6a-b0eb-80c849545e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:02.812259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aacab4-d54b-4c6a-b0eb-80c849545e4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:02.814123 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30ef37-2649-46d2-ae54-342ec63dce11 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:02.828439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aacab4-d54b-4c6a-b0eb-80c849545e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-13aacab4-d54b-4c6a-b0eb-80c849545e4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:02.841169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:02.842119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:02.842887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:02.842887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:02.842887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:02.842887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:02.842887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:02.842887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:02.842887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:02.842887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:02.842887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:02.842887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:02.842887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:02.842887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:02.847352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 33/66] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:45:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:02.849241 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae5ba7-f53e-40dc-8bf0-242368f50e23 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:02.849923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae5ba7-f53e-40dc-8bf0-242368f50e23 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:02.850307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae5ba7-f53e-40dc-8bf0-242368f50e23 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:02.853601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 34/67] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:02.857645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d7b4a-a389-4bcf-83a6-628009cdc39a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:02.858273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d7b4a-a389-4bcf-83a6-628009cdc39a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:02.858431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ee405-5b04-4052-a9c9-3b2f6f9978cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:02.858892 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d7b4a-a389-4bcf-83a6-628009cdc39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:02.859462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee405-5b04-4052-a9c9-3b2f6f9978cb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:02.859867 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee405-5b04-4052-a9c9-3b2f6f9978cb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:02.860252 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee405-5b04-4052-a9c9-3b2f6f9978cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:02.871295 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ee405-5b04-4052-a9c9-3b2f6f9978cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:02.877149 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-045d7b4a-a389-4bcf-83a6-628009cdc39a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:02.878381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-045d7b4a-a389-4bcf-83a6-628009cdc39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-643ee405-5b04-4052-a9c9-3b2f6f9978cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:02.879538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:02.880496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:02.881392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:02.881392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:02.881392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:02.881392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:02.881392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:02.881392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:02.881392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:02.881392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:02.881392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:02.881392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:02.881392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:02.881392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:02.881392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 34/68] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:02.882067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ee405-5b04-4052-a9c9-3b2f6f9978cb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:02.943201 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 35/69] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:02.944589 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e1f0b-1814-4e84-9598-4da1d536ed15 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:02.944886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e1f0b-1814-4e84-9598-4da1d536ed15 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:02.945173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e1f0b-1814-4e84-9598-4da1d536ed15 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:02.946785 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 36/70] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:02.947926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdae89b-93f5-408c-b07c-b72a8e36e1dc None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:02.948217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdae89b-93f5-408c-b07c-b72a8e36e1dc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:02.948499 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdae89b-93f5-408c-b07c-b72a8e36e1dc None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:02.949865 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 37/71] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:02.954339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdae89b-93f5-408c-b07c-b72a8e36e1dc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:02.978894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ee405-5b04-4052-a9c9-3b2f6f9978cb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:03.010731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb0cbf-28b3-4726-9a06-538e5db51950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:03.011501 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb0cbf-28b3-4726-9a06-538e5db51950 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:03.011798 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb0cbf-28b3-4726-9a06-538e5db51950 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:03.012082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb0cbf-28b3-4726-9a06-538e5db51950 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:03.012832 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb0cbf-28b3-4726-9a06-538e5db51950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:03.013174 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb0cbf-28b3-4726-9a06-538e5db51950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:03.014606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb0cbf-28b3-4726-9a06-538e5db51950 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:03.023151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 35/72] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:03.024319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cdd9f-30cc-4c28-9ef4-ef25ab2e7c41 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:03.024612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cdd9f-30cc-4c28-9ef4-ef25ab2e7c41 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:03.024895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cdd9f-30cc-4c28-9ef4-ef25ab2e7c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:03.042180 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0f0cdd9f-30cc-4c28-9ef4-ef25ab2e7c41 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:03.043371 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0f0cdd9f-30cc-4c28-9ef4-ef25ab2e7c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:03.050099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdae89b-93f5-408c-b07c-b72a8e36e1dc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:03.083337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5bb949-bd9a-4a9c-af7f-724eaf9b9883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:03.084459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bb949-bd9a-4a9c-af7f-724eaf9b9883 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:03.084962 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bb949-bd9a-4a9c-af7f-724eaf9b9883 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:03.085486 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bb949-bd9a-4a9c-af7f-724eaf9b9883 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:03.086893 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bb949-bd9a-4a9c-af7f-724eaf9b9883 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:03.087417 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bb949-bd9a-4a9c-af7f-724eaf9b9883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:03.088855 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5bb949-bd9a-4a9c-af7f-724eaf9b9883 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:03.096767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 38/73] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:03.098127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516149fe-702e-42d3-87f6-4dae8944fdf6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:03.098423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516149fe-702e-42d3-87f6-4dae8944fdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:03.098704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516149fe-702e-42d3-87f6-4dae8944fdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:03.110575 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 36/74] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:03.111413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cdd9f-30cc-4c28-9ef4-ef25ab2e7c41 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:03.114543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-516149fe-702e-42d3-87f6-4dae8944fdf6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:03.115726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-516149fe-702e-42d3-87f6-4dae8944fdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:03.180494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 39/75] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:03.181334 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516149fe-702e-42d3-87f6-4dae8944fdf6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:03.217205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cdd9f-30cc-4c28-9ef4-ef25ab2e7c41 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:03.248848 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19619d81-bf82-4701-b566-492e61b7e7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:03.250228 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619d81-bf82-4701-b566-492e61b7e7fa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:03.250519 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619d81-bf82-4701-b566-492e61b7e7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:03.250797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19619d81-bf82-4701-b566-492e61b7e7fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:03.260392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19619d81-bf82-4701-b566-492e61b7e7fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-19619d81-bf82-4701-b566-492e61b7e7fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:03.268536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:03.269690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:03.270473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:03.270473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:03.270473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:03.270473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:03.270473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:03.270473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:03.270473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:03.270473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:03.270473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:03.270473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:03.270473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:03.270473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:03.273678 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 37/76] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:45:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:03.274729 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19619d81-bf82-4701-b566-492e61b7e7fa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:03.275316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516149fe-702e-42d3-87f6-4dae8944fdf6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:03.307747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f07d16-4800-4b09-ac9b-ce567ff3ae0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:03.308550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07d16-4800-4b09-ac9b-ce567ff3ae0b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:03.308837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07d16-4800-4b09-ac9b-ce567ff3ae0b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:03.309118 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f07d16-4800-4b09-ac9b-ce567ff3ae0b None admin] PATH_INFO: `/v3/users/3529d1a9e25d41d4bfc8bab9cf496381` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:03.310342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f07d16-4800-4b09-ac9b-ce567ff3ae0b None admin] RBAC: Authorizing `identity:get_user(user_id=3529d1a9e25d41d4bfc8bab9cf496381)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:03.311800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f07d16-4800-4b09-ac9b-ce567ff3ae0b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:03.314088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 40/77] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:03 2022] GET /identity/v3/users/3529d1a9e25d41d4bfc8bab9cf496381 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:03.314848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f07d16-4800-4b09-ac9b-ce567ff3ae0b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:03.368002 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19619d81-bf82-4701-b566-492e61b7e7fa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:03.399219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94c07b-0558-46a7-b704-acad6cfe695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:03.400083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94c07b-0558-46a7-b704-acad6cfe695a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:03.400365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94c07b-0558-46a7-b704-acad6cfe695a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:03.400635 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94c07b-0558-46a7-b704-acad6cfe695a None admin] PATH_INFO: `/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:03.406991 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f07d16-4800-4b09-ac9b-ce567ff3ae0b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:03.413136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94c07b-0558-46a7-b704-acad6cfe695a None admin] RBAC: Authorizing `identity:get_user(user_id=9abf29d44f1a4c1ca2c6ad2350032bb9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:03.414649 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94c07b-0558-46a7-b704-acad6cfe695a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:03.416301 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 38/78] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:03 2022] GET /identity/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:03.417072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94c07b-0558-46a7-b704-acad6cfe695a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:03.440171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c549de4-6d87-4f39-b258-74d361550d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:03.440962 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c549de4-6d87-4f39-b258-74d361550d26 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:03.441246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c549de4-6d87-4f39-b258-74d361550d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:03.441543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c549de4-6d87-4f39-b258-74d361550d26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:03.451414 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c549de4-6d87-4f39-b258-74d361550d26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3c549de4-6d87-4f39-b258-74d361550d26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:03.459174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:03.460084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:03.460877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:03.460877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:03.460877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:03.460877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:03.460877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:03.460877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:03.460877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:03.460877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:03.460877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:03.460877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:03.460877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:03.460877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:03.460877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 41/79] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:03.461517 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c549de4-6d87-4f39-b258-74d361550d26 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:03.509341 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94c07b-0558-46a7-b704-acad6cfe695a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:03.541746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762af1d-484b-409d-8699-5ce1a72ac708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:03.542532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762af1d-484b-409d-8699-5ce1a72ac708 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:03.542818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762af1d-484b-409d-8699-5ce1a72ac708 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:03.543095 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762af1d-484b-409d-8699-5ce1a72ac708 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:03.544267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762af1d-484b-409d-8699-5ce1a72ac708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:03.545732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762af1d-484b-409d-8699-5ce1a72ac708 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:03.547825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 39/80] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:03.548582 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762af1d-484b-409d-8699-5ce1a72ac708 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:03.559926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c549de4-6d87-4f39-b258-74d361550d26 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:03.591708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d603f1-9be5-40e2-ba03-660e46650ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:03.592378 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d603f1-9be5-40e2-ba03-660e46650ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:03.592671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d603f1-9be5-40e2-ba03-660e46650ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:03.592958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d603f1-9be5-40e2-ba03-660e46650ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:03.593820 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d603f1-9be5-40e2-ba03-660e46650ac7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:03.594140 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d603f1-9be5-40e2-ba03-660e46650ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:03.595531 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d603f1-9be5-40e2-ba03-660e46650ac7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:03.603137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 42/81] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:45:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:03.607623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d603f1-9be5-40e2-ba03-660e46650ac7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:03.639944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762af1d-484b-409d-8699-5ce1a72ac708 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:03.672410 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d84c4a-a358-4b96-9ac3-cbc15674da7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:03.673058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d84c4a-a358-4b96-9ac3-cbc15674da7d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:03.673346 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d84c4a-a358-4b96-9ac3-cbc15674da7d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:03.673661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d84c4a-a358-4b96-9ac3-cbc15674da7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:03.700243 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d603f1-9be5-40e2-ba03-660e46650ac7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:03.731380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36ccc2-3114-404a-94db-6010efb62b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:03.732021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36ccc2-3114-404a-94db-6010efb62b19 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:03.732308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36ccc2-3114-404a-94db-6010efb62b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:03.732586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36ccc2-3114-404a-94db-6010efb62b19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:03.735892 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d84c4a-a358-4b96-9ac3-cbc15674da7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:03.737379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d84c4a-a358-4b96-9ac3-cbc15674da7d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:03.795989 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36ccc2-3114-404a-94db-6010efb62b19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:03.797486 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36ccc2-3114-404a-94db-6010efb62b19 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:03.830009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 40/82] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:03.830783 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d84c4a-a358-4b96-9ac3-cbc15674da7d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:03.890996 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 43/83] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:03.891819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36ccc2-3114-404a-94db-6010efb62b19 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:03.923153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d84c4a-a358-4b96-9ac3-cbc15674da7d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:03.954626 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1042b-ff9c-4446-9274-1c6774be569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:03.955313 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1042b-ff9c-4446-9274-1c6774be569f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:03.955602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1042b-ff9c-4446-9274-1c6774be569f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:03.955884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1042b-ff9c-4446-9274-1c6774be569f None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:03.956635 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1042b-ff9c-4446-9274-1c6774be569f None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:03.956947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1042b-ff9c-4446-9274-1c6774be569f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:03.958366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1042b-ff9c-4446-9274-1c6774be569f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:03.966271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 41/84] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:03.966889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1042b-ff9c-4446-9274-1c6774be569f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:03.984360 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36ccc2-3114-404a-94db-6010efb62b19 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:04.016624 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b81d1b-6fcc-4206-b988-5f5a2e1ee2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:04.017280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b81d1b-6fcc-4206-b988-5f5a2e1ee2d4 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:04.017648 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b81d1b-6fcc-4206-b988-5f5a2e1ee2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:04.017883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b81d1b-6fcc-4206-b988-5f5a2e1ee2d4 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:04.018585 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b81d1b-6fcc-4206-b988-5f5a2e1ee2d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:04.020280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b81d1b-6fcc-4206-b988-5f5a2e1ee2d4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:04.059217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1042b-ff9c-4446-9274-1c6774be569f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:04.090497 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282d372-c9a8-49fe-8f69-376ab63bbfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:04.091302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282d372-c9a8-49fe-8f69-376ab63bbfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:04.091614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282d372-c9a8-49fe-8f69-376ab63bbfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:04.091897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282d372-c9a8-49fe-8f69-376ab63bbfc7 None admin] PATH_INFO: `/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:04.093110 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282d372-c9a8-49fe-8f69-376ab63bbfc7 None admin] RBAC: Authorizing `identity:get_user(user_id=9abf29d44f1a4c1ca2c6ad2350032bb9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:04.095192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282d372-c9a8-49fe-8f69-376ab63bbfc7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:04.096843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 42/85] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:03 2022] GET /identity/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9 => generated 275 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:04.097642 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282d372-c9a8-49fe-8f69-376ab63bbfc7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:04.133569 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 44/86] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:45:03 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:45:04.133569 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b81d1b-6fcc-4206-b988-5f5a2e1ee2d4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:04.200075 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282d372-c9a8-49fe-8f69-376ab63bbfc7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:04.223341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b81d1b-6fcc-4206-b988-5f5a2e1ee2d4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:04.235438 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c891c0-516c-46fb-9506-2af182178ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:04.236328 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c891c0-516c-46fb-9506-2af182178ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:04.236615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c891c0-516c-46fb-9506-2af182178ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:04.236899 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c891c0-516c-46fb-9506-2af182178ed3 None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:04.238188 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c891c0-516c-46fb-9506-2af182178ed3 None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:04.239660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c891c0-516c-46fb-9506-2af182178ed3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:04.241456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 43/87] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:04 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:04.242287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c891c0-516c-46fb-9506-2af182178ed3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:04.261048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f127cd-b80a-4305-80e0-e0dc4a3e057f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:04.262387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f127cd-b80a-4305-80e0-e0dc4a3e057f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:04.262768 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f127cd-b80a-4305-80e0-e0dc4a3e057f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:04.263126 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f127cd-b80a-4305-80e0-e0dc4a3e057f None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:04.264485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f127cd-b80a-4305-80e0-e0dc4a3e057f None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:04.266623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f127cd-b80a-4305-80e0-e0dc4a3e057f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:04.268541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 45/88] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:04 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:04.273943 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f127cd-b80a-4305-80e0-e0dc4a3e057f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:04.349478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c891c0-516c-46fb-9506-2af182178ed3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:04.371419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f127cd-b80a-4305-80e0-e0dc4a3e057f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:04.389250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8690ca-bcef-40b5-adc6-87b3556ba421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:04.389612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8690ca-bcef-40b5-adc6-87b3556ba421 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:04.390649 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8690ca-bcef-40b5-adc6-87b3556ba421 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:04.390649 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8690ca-bcef-40b5-adc6-87b3556ba421 None admin] PATH_INFO: `/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:04.391386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8690ca-bcef-40b5-adc6-87b3556ba421 None admin] RBAC: Authorizing `identity:get_user(user_id=9abf29d44f1a4c1ca2c6ad2350032bb9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:04.392873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8690ca-bcef-40b5-adc6-87b3556ba421 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:04.397383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 44/89] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:04 2022] GET /identity/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:04.397383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8690ca-bcef-40b5-adc6-87b3556ba421 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:04.408177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12dc09-51ec-4caf-b019-6f9ee0dc9fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:04.408974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12dc09-51ec-4caf-b019-6f9ee0dc9fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:04.409360 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12dc09-51ec-4caf-b019-6f9ee0dc9fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:04.409767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12dc09-51ec-4caf-b019-6f9ee0dc9fd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:04.480855 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12dc09-51ec-4caf-b019-6f9ee0dc9fd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:04.482363 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12dc09-51ec-4caf-b019-6f9ee0dc9fd1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:04.498987 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8690ca-bcef-40b5-adc6-87b3556ba421 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:04.533769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de391f-9664-48a8-a0cc-7984a48658b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:04.534528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de391f-9664-48a8-a0cc-7984a48658b1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:04.534724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de391f-9664-48a8-a0cc-7984a48658b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:04.535010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de391f-9664-48a8-a0cc-7984a48658b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:04.535861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de391f-9664-48a8-a0cc-7984a48658b1 None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=07752e1fa91d4fec8615e3b11c555cb7, user.id=3529d1a9e25d41d4bfc8bab9cf496381) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:04.536185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de391f-9664-48a8-a0cc-7984a48658b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:04.537779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de391f-9664-48a8-a0cc-7984a48658b1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:04.543618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 45/90] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:04 2022] GET /identity/v3/role_assignments?user.id=3529d1a9e25d41d4bfc8bab9cf496381&scope.project.id=07752e1fa91d4fec8615e3b11c555cb7&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:04.544248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de391f-9664-48a8-a0cc-7984a48658b1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:04.584035 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 46/91] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:04.585132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12dc09-51ec-4caf-b019-6f9ee0dc9fd1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:04.666075 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de391f-9664-48a8-a0cc-7984a48658b1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:04.700938 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83298841-240c-4dc1-8d3b-4ad0e048f804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:04.701662 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83298841-240c-4dc1-8d3b-4ad0e048f804 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:04.701954 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83298841-240c-4dc1-8d3b-4ad0e048f804 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:04.702244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83298841-240c-4dc1-8d3b-4ad0e048f804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:04.703146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83298841-240c-4dc1-8d3b-4ad0e048f804 None admin] RBAC: Adding query filter params (role.id=a211713995b7409ca158916c665f73b6, scope.project.id=07752e1fa91d4fec8615e3b11c555cb7, user.id=9abf29d44f1a4c1ca2c6ad2350032bb9) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:04.703464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83298841-240c-4dc1-8d3b-4ad0e048f804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:04.704954 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83298841-240c-4dc1-8d3b-4ad0e048f804 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:04.711174 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 46/92] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:04 2022] GET /identity/v3/role_assignments?user.id=9abf29d44f1a4c1ca2c6ad2350032bb9&scope.project.id=07752e1fa91d4fec8615e3b11c555cb7&role.id=a211713995b7409ca158916c665f73b6 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:04.712071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83298841-240c-4dc1-8d3b-4ad0e048f804 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:04.754658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12dc09-51ec-4caf-b019-6f9ee0dc9fd1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:04.803505 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217484c-a78d-424d-8364-91eb17326fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:04.804193 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217484c-a78d-424d-8364-91eb17326fca None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:04.804484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217484c-a78d-424d-8364-91eb17326fca None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:04.804768 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217484c-a78d-424d-8364-91eb17326fca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:04.874703 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83298841-240c-4dc1-8d3b-4ad0e048f804 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:04.923467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff202ad-391f-46df-843e-a1a456626751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:04.924875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff202ad-391f-46df-843e-a1a456626751 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:04.925365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff202ad-391f-46df-843e-a1a456626751 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:04.925916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff202ad-391f-46df-843e-a1a456626751 None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:04.927520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff202ad-391f-46df-843e-a1a456626751 None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:04.929212 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff202ad-391f-46df-843e-a1a456626751 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:04.932566 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 47/93] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:04 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:04.939184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff202ad-391f-46df-843e-a1a456626751 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:04.988086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217484c-a78d-424d-8364-91eb17326fca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:04.989628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217484c-a78d-424d-8364-91eb17326fca None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:05.048057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff202ad-391f-46df-843e-a1a456626751 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:05.083380 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a5161-80bc-49a6-94d7-7f8ba9cd1dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:05.084433 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5161-80bc-49a6-94d7-7f8ba9cd1dbb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:05.084920 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5161-80bc-49a6-94d7-7f8ba9cd1dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:05.085423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5161-80bc-49a6-94d7-7f8ba9cd1dbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:05.086499 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a5161-80bc-49a6-94d7-7f8ba9cd1dbb None admin] RBAC: Adding query filter params (role.id=6437cf432fe44cc28aa54208759f1265, scope.project.id=07752e1fa91d4fec8615e3b11c555cb7, user.id=9abf29d44f1a4c1ca2c6ad2350032bb9) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:05.087017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a5161-80bc-49a6-94d7-7f8ba9cd1dbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:05.088670 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a5161-80bc-49a6-94d7-7f8ba9cd1dbb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:05.093980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 47/94] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:05.095241 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 48/95] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:04 2022] GET /identity/v3/role_assignments?user.id=9abf29d44f1a4c1ca2c6ad2350032bb9&scope.project.id=07752e1fa91d4fec8615e3b11c555cb7&role.id=6437cf432fe44cc28aa54208759f1265 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:05.099503 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217484c-a78d-424d-8364-91eb17326fca None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:05.216689 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217484c-a78d-424d-8364-91eb17326fca None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:05.256688 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6b151-75af-48b1-bf59-9357eb065586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:05.257898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6b151-75af-48b1-bf59-9357eb065586 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:05.258359 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6b151-75af-48b1-bf59-9357eb065586 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:05.258808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6b151-75af-48b1-bf59-9357eb065586 None admin] PATH_INFO: `/v3/projects/1054800bee554353bb2ad7cb127a4d8b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:05.260248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6b151-75af-48b1-bf59-9357eb065586 None admin] RBAC: Authorizing `identity:get_project(project_id=1054800bee554353bb2ad7cb127a4d8b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:05.262039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6b151-75af-48b1-bf59-9357eb065586 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:05.264345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 48/96] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:05 2022] GET /identity/v3/projects/1054800bee554353bb2ad7cb127a4d8b => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:05.270301 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a5161-80bc-49a6-94d7-7f8ba9cd1dbb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:05.380399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a5161-80bc-49a6-94d7-7f8ba9cd1dbb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:05.418837 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3940ad-5ca8-47be-9515-4f89328ed4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:05.419824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3940ad-5ca8-47be-9515-4f89328ed4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:05.420282 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3940ad-5ca8-47be-9515-4f89328ed4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:05.420797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3940ad-5ca8-47be-9515-4f89328ed4e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:05.421869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3940ad-5ca8-47be-9515-4f89328ed4e9 None admin] RBAC: Adding query filter params (role.id=a211713995b7409ca158916c665f73b6, scope.project.id=1054800bee554353bb2ad7cb127a4d8b, user.id=9abf29d44f1a4c1ca2c6ad2350032bb9) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:05.422380 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3940ad-5ca8-47be-9515-4f89328ed4e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:05.423995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3940ad-5ca8-47be-9515-4f89328ed4e9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:05.430054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 49/97] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:05 2022] GET /identity/v3/role_assignments?user.id=9abf29d44f1a4c1ca2c6ad2350032bb9&scope.project.id=1054800bee554353bb2ad7cb127a4d8b&role.id=a211713995b7409ca158916c665f73b6 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:07.008880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911bd1-fcc1-4869-baa9-e0ec44e477f7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:07.009424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911bd1-fcc1-4869-baa9-e0ec44e477f7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:07.009424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911bd1-fcc1-4869-baa9-e0ec44e477f7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:07.010832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 49/98] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:07.019664 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c6b79-e241-4e25-a697-048babff2ca9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:07.020094 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c6b79-e241-4e25-a697-048babff2ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:07.020294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c6b79-e241-4e25-a697-048babff2ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:07.037155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-310c6b79-e241-4e25-a697-048babff2ca9 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:07.042586 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-310c6b79-e241-4e25-a697-048babff2ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:07.132658 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 50/99] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:07.167877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95911bd1-fcc1-4869-baa9-e0ec44e477f7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:07.282306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95911bd1-fcc1-4869-baa9-e0ec44e477f7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:07.324832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14cca7-f9ba-41ec-8b8e-ad7a683d7b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:07.325666 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14cca7-f9ba-41ec-8b8e-ad7a683d7b9c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:07.325952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14cca7-f9ba-41ec-8b8e-ad7a683d7b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:07.326226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14cca7-f9ba-41ec-8b8e-ad7a683d7b9c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:07.342633 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14cca7-f9ba-41ec-8b8e-ad7a683d7b9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4f14cca7-f9ba-41ec-8b8e-ad7a683d7b9c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:07.350568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:07.351427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:07.352277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:07.352277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:07.352277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:07.352277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:07.352277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:07.352277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:07.352277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:07.352277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:07.352277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:07.352277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:07.352277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:07.352277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:07.352277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 50/100] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:07.359384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c6b79-e241-4e25-a697-048babff2ca9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:07.460607 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c6b79-e241-4e25-a697-048babff2ca9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:07.464952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dde20-13e9-4088-9c2f-f3ae4e983678 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:07.465241 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dde20-13e9-4088-9c2f-f3ae4e983678 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:07.465540 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dde20-13e9-4088-9c2f-f3ae4e983678 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:07.466909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 51/101] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:45:07.472461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7414d-1f88-40ec-a98c-d40bb227f811 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:07.472751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7414d-1f88-40ec-a98c-d40bb227f811 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:07.473031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7414d-1f88-40ec-a98c-d40bb227f811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:07.491798 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d7e7414d-1f88-40ec-a98c-d40bb227f811 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:07.492996 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d7e7414d-1f88-40ec-a98c-d40bb227f811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:07.540984 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ef4fe-1d0f-4d10-a389-5e6b8a0474a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:07.541693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ef4fe-1d0f-4d10-a389-5e6b8a0474a4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:07.541985 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ef4fe-1d0f-4d10-a389-5e6b8a0474a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:07.542267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ef4fe-1d0f-4d10-a389-5e6b8a0474a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:07.543026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ef4fe-1d0f-4d10-a389-5e6b8a0474a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:07.543341 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ef4fe-1d0f-4d10-a389-5e6b8a0474a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:07.544748 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ef4fe-1d0f-4d10-a389-5e6b8a0474a4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:07.564541 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 51/102] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:07.570239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ef4fe-1d0f-4d10-a389-5e6b8a0474a4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:07.656396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 52/103] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:07.697933 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7414d-1f88-40ec-a98c-d40bb227f811 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:07.808600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ef4fe-1d0f-4d10-a389-5e6b8a0474a4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:07.894547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03760103-2d08-49f4-8e35-6f26fcffa998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:07.895446 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03760103-2d08-49f4-8e35-6f26fcffa998 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:07.895738 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03760103-2d08-49f4-8e35-6f26fcffa998 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:07.896019 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03760103-2d08-49f4-8e35-6f26fcffa998 None admin] PATH_INFO: `/v3/users/60c4d6c6dbe647dfaabd9a40ff209f79` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:07.912940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03760103-2d08-49f4-8e35-6f26fcffa998 None admin] RBAC: Authorizing `identity:get_user(user_id=60c4d6c6dbe647dfaabd9a40ff209f79)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:07.914788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03760103-2d08-49f4-8e35-6f26fcffa998 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:07.916837 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 52/104] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:07 2022] GET /identity/v3/users/60c4d6c6dbe647dfaabd9a40ff209f79 => generated 289 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:07.918093 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1db3f-7964-479d-837e-b74ac3edb1ad None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:07.918538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1db3f-7964-479d-837e-b74ac3edb1ad None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:07.918828 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1db3f-7964-479d-837e-b74ac3edb1ad None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:07.920188 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 53/105] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:07.925317 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1db3f-7964-479d-837e-b74ac3edb1ad None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:07.929892 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7414d-1f88-40ec-a98c-d40bb227f811 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:08.001233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cef4b-32fb-4bce-ac79-a6c57ad89eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:08.002069 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cef4b-32fb-4bce-ac79-a6c57ad89eed None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:08.002352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cef4b-32fb-4bce-ac79-a6c57ad89eed None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:08.002630 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cef4b-32fb-4bce-ac79-a6c57ad89eed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:08.004377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cef4b-32fb-4bce-ac79-a6c57ad89eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:08.005853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cef4b-32fb-4bce-ac79-a6c57ad89eed None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:08.007639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 53/106] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:08.013875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae4a25-a61c-4b69-82ba-f6df732eefb7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:08.015569 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae4a25-a61c-4b69-82ba-f6df732eefb7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:08.015870 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae4a25-a61c-4b69-82ba-f6df732eefb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:08.050620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cfae4a25-a61c-4b69-82ba-f6df732eefb7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:08.051827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cfae4a25-a61c-4b69-82ba-f6df732eefb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:08.084256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1db3f-7964-479d-837e-b74ac3edb1ad None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:08.150996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61702d27-3393-43e1-b8fd-6eefebc48834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:08.151715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61702d27-3393-43e1-b8fd-6eefebc48834 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:08.152009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61702d27-3393-43e1-b8fd-6eefebc48834 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:08.152291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61702d27-3393-43e1-b8fd-6eefebc48834 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:08.163243 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 54/107] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:08.164493 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae4a25-a61c-4b69-82ba-f6df732eefb7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:08.272690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61702d27-3393-43e1-b8fd-6eefebc48834 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:08.274283 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61702d27-3393-43e1-b8fd-6eefebc48834 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:08.372635 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae4a25-a61c-4b69-82ba-f6df732eefb7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:08.384678 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 54/108] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:08.392415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61702d27-3393-43e1-b8fd-6eefebc48834 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:08.452236 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eae73-ef84-4ec9-b68f-34350a87560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:08.453863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eae73-ef84-4ec9-b68f-34350a87560c None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:08.454359 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eae73-ef84-4ec9-b68f-34350a87560c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:08.454840 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eae73-ef84-4ec9-b68f-34350a87560c None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:08.455748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53eae73-ef84-4ec9-b68f-34350a87560c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:08.457441 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53eae73-ef84-4ec9-b68f-34350a87560c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:08.534271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61702d27-3393-43e1-b8fd-6eefebc48834 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:08.567068 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637199e-0158-4731-9051-44ae13cb2cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:08.567877 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637199e-0158-4731-9051-44ae13cb2cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:08.568168 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637199e-0158-4731-9051-44ae13cb2cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:08.568449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637199e-0158-4731-9051-44ae13cb2cb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:08.585188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 55/109] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 11 20:45:08 2022] POST /identity/v3/projects => generated 302 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:45:08.585188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eae73-ef84-4ec9-b68f-34350a87560c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:08.586905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637199e-0158-4731-9051-44ae13cb2cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3637199e-0158-4731-9051-44ae13cb2cb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:08.595927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:08.599349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:08.600173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:08.600173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:08.600173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:08.600173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:08.600173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:08.600173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:08.600173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:08.600173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:08.600173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:08.600173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:08.600173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:08.600173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:08.600173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 55/110] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:45:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:08.600173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548c7af-bf91-4263-8e0f-13a5b0f6e096 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:08.600928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548c7af-bf91-4263-8e0f-13a5b0f6e096 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:08.600928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548c7af-bf91-4263-8e0f-13a5b0f6e096 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:08.600928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 56/111] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:08.606404 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac931c8-bb78-4397-9ecd-8744e16fe717 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:08.606739 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac931c8-bb78-4397-9ecd-8744e16fe717 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:08.606983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac931c8-bb78-4397-9ecd-8744e16fe717 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:08.608441 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 57/112] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:08.613355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7111cb-6584-42fa-80c3-1314497e7585 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:08.613355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7111cb-6584-42fa-80c3-1314497e7585 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:08.613355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7111cb-6584-42fa-80c3-1314497e7585 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:08.613355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 58/113] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:08.613355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7111cb-6584-42fa-80c3-1314497e7585 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:08.706239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eae73-ef84-4ec9-b68f-34350a87560c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:08.727886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7111cb-6584-42fa-80c3-1314497e7585 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:08.741649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1f2ca-0553-4288-99d8-8475728db223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:08.742533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1f2ca-0553-4288-99d8-8475728db223 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:08.742823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1f2ca-0553-4288-99d8-8475728db223 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:08.743115 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1f2ca-0553-4288-99d8-8475728db223 None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:08.744352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1f2ca-0553-4288-99d8-8475728db223 None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:08.745886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1f2ca-0553-4288-99d8-8475728db223 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:08.752559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 56/114] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:08 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:08.752559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66032bf4-a833-4923-bc5c-0f80510f7093 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:08.752559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66032bf4-a833-4923-bc5c-0f80510f7093 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:08.752559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66032bf4-a833-4923-bc5c-0f80510f7093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:08.769714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-66032bf4-a833-4923-bc5c-0f80510f7093 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:08.770117 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68365a1-9645-4b0d-a06e-55bca0f41cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:08.770796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68365a1-9645-4b0d-a06e-55bca0f41cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:08.770936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-66032bf4-a833-4923-bc5c-0f80510f7093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:08.771087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68365a1-9645-4b0d-a06e-55bca0f41cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:08.771353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68365a1-9645-4b0d-a06e-55bca0f41cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:08.772101 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68365a1-9645-4b0d-a06e-55bca0f41cd6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:08.772413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68365a1-9645-4b0d-a06e-55bca0f41cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:08.773904 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68365a1-9645-4b0d-a06e-55bca0f41cd6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:08.783482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 59/115] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:45:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:08.785073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97234-ba95-43df-9d9d-65b7e97eef8a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:08.785522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97234-ba95-43df-9d9d-65b7e97eef8a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:08.785825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b97234-ba95-43df-9d9d-65b7e97eef8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:08.804039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-43b97234-ba95-43df-9d9d-65b7e97eef8a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:08.805229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-43b97234-ba95-43df-9d9d-65b7e97eef8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:08.844116 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 57/116] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:08.845425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932142e3-efec-46c1-aff2-1f5056fac8e9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:08.845754 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932142e3-efec-46c1-aff2-1f5056fac8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:08.846041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932142e3-efec-46c1-aff2-1f5056fac8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:08.862470 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-932142e3-efec-46c1-aff2-1f5056fac8e9 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:08.863920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-932142e3-efec-46c1-aff2-1f5056fac8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:08.886110 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 60/117] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:08.891228 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b97234-ba95-43df-9d9d-65b7e97eef8a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:08.938923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 58/118] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:08.939601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932142e3-efec-46c1-aff2-1f5056fac8e9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:09.001029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b97234-ba95-43df-9d9d-65b7e97eef8a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:09.034551 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c673a9-c869-40b0-9d08-166db3263b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:09.035223 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c673a9-c869-40b0-9d08-166db3263b3f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:09.035515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c673a9-c869-40b0-9d08-166db3263b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:09.035781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c673a9-c869-40b0-9d08-166db3263b3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:09.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932142e3-efec-46c1-aff2-1f5056fac8e9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:09.036835 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c673a9-c869-40b0-9d08-166db3263b3f None admin] RBAC: Adding query filter params (role.id=12cfd45464bc4f27ba33f6b1038f3d31, scope.project.id=07752e1fa91d4fec8615e3b11c555cb7, user.id=60c4d6c6dbe647dfaabd9a40ff209f79) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:09.036918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c673a9-c869-40b0-9d08-166db3263b3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:09.038381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c673a9-c869-40b0-9d08-166db3263b3f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:09.043765 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 61/119] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:08 2022] GET /identity/v3/role_assignments?user.id=60c4d6c6dbe647dfaabd9a40ff209f79&scope.project.id=07752e1fa91d4fec8615e3b11c555cb7&role.id=12cfd45464bc4f27ba33f6b1038f3d31 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:09.044534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c673a9-c869-40b0-9d08-166db3263b3f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:09.074924 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff027753-401c-4743-bd59-76dca3bf16c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:09.076343 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff027753-401c-4743-bd59-76dca3bf16c4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:09.076848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff027753-401c-4743-bd59-76dca3bf16c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:09.078054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff027753-401c-4743-bd59-76dca3bf16c4 None admin] PATH_INFO: `/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:09.079717 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff027753-401c-4743-bd59-76dca3bf16c4 None admin] RBAC: Authorizing `identity:get_user(user_id=9abf29d44f1a4c1ca2c6ad2350032bb9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:09.081729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff027753-401c-4743-bd59-76dca3bf16c4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:09.083998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 59/120] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:08 2022] GET /identity/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:09.085352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff027753-401c-4743-bd59-76dca3bf16c4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:09.157438 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c673a9-c869-40b0-9d08-166db3263b3f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:09.193724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a648d-321d-461e-a5a3-00037ebdba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:09.194717 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a648d-321d-461e-a5a3-00037ebdba19 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:09.195017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a648d-321d-461e-a5a3-00037ebdba19 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:09.195302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a648d-321d-461e-a5a3-00037ebdba19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:09.201805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff027753-401c-4743-bd59-76dca3bf16c4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:09.206861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a648d-321d-461e-a5a3-00037ebdba19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-636a648d-321d-461e-a5a3-00037ebdba19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:09.214823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:09.215781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:09.216557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:09.216557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:09.216557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:09.216557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:09.216557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:09.216557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:09.216557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:09.216557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:09.216557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:09.216557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:09.216557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:09.216557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:09.221597 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 62/121] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:09.222556 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a648d-321d-461e-a5a3-00037ebdba19 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:09.244532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c90a0-c67c-41c7-a054-67594018feab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:09.245747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c90a0-c67c-41c7-a054-67594018feab None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:09.246678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c90a0-c67c-41c7-a054-67594018feab None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:09.247336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c90a0-c67c-41c7-a054-67594018feab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:09.261153 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c90a0-c67c-41c7-a054-67594018feab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ac8c90a0-c67c-41c7-a054-67594018feab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:09.272372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:09.273246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:09.274054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:09.274054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:09.274054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:09.274054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:09.274054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:09.274054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:09.274054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:09.274054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:09.274054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:09.274054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:09.274054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:09.274054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:09.280285 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 60/122] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:09.280285 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c90a0-c67c-41c7-a054-67594018feab None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:09.338579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a648d-321d-461e-a5a3-00037ebdba19 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:09.374256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d5d7f-dd31-4671-aac8-69426bc37296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:09.375067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d5d7f-dd31-4671-aac8-69426bc37296 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:09.375407 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d5d7f-dd31-4671-aac8-69426bc37296 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:09.375687 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d5d7f-dd31-4671-aac8-69426bc37296 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:09.386395 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d5d7f-dd31-4671-aac8-69426bc37296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-7e3d5d7f-dd31-4671-aac8-69426bc37296 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:09.395299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:09.396190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:09.397436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:09.397436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:09.397436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:09.397436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:09.397436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:09.397436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:09.397436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:09.397436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:09.397436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:09.397436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:09.397436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:09.397436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:09.401405 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 63/123] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:09.402350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d5d7f-dd31-4671-aac8-69426bc37296 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:09.411268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c90a0-c67c-41c7-a054-67594018feab None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:09.454600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94620b0e-6be0-44a4-a137-fd0099b49bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:09.456398 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94620b0e-6be0-44a4-a137-fd0099b49bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:09.456923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94620b0e-6be0-44a4-a137-fd0099b49bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:09.457722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94620b0e-6be0-44a4-a137-fd0099b49bf9 None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:09.459647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94620b0e-6be0-44a4-a137-fd0099b49bf9 None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:09.461794 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94620b0e-6be0-44a4-a137-fd0099b49bf9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:09.464530 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 61/124] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:09 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:09.466000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94620b0e-6be0-44a4-a137-fd0099b49bf9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:09.507692 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d5d7f-dd31-4671-aac8-69426bc37296 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:09.546106 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c414c4-5669-4c3b-b3aa-8cb32a426626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:09.546875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c414c4-5669-4c3b-b3aa-8cb32a426626 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:09.547165 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c414c4-5669-4c3b-b3aa-8cb32a426626 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:09.547445 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c414c4-5669-4c3b-b3aa-8cb32a426626 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:09.548201 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c414c4-5669-4c3b-b3aa-8cb32a426626 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:09.548569 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c414c4-5669-4c3b-b3aa-8cb32a426626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:09.550027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c414c4-5669-4c3b-b3aa-8cb32a426626 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:09.558861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 64/125] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:09.560656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c414c4-5669-4c3b-b3aa-8cb32a426626 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:09.589863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94620b0e-6be0-44a4-a137-fd0099b49bf9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:09.633222 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5c8b3-2839-4ead-8bdf-ca99d1a56edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:09.633933 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5c8b3-2839-4ead-8bdf-ca99d1a56edc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:09.634411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5c8b3-2839-4ead-8bdf-ca99d1a56edc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:09.634701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5c8b3-2839-4ead-8bdf-ca99d1a56edc None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:09.636233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5c8b3-2839-4ead-8bdf-ca99d1a56edc None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:09.636557 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5c8b3-2839-4ead-8bdf-ca99d1a56edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:09.637998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5c8b3-2839-4ead-8bdf-ca99d1a56edc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:09.649465 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 62/126] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:09.650252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5c8b3-2839-4ead-8bdf-ca99d1a56edc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:09.671506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c414c4-5669-4c3b-b3aa-8cb32a426626 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:09.706283 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b94cfa-a194-4193-af7c-4afbed2eaaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:09.707044 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b94cfa-a194-4193-af7c-4afbed2eaaef None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:09.707432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b94cfa-a194-4193-af7c-4afbed2eaaef None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:09.707786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b94cfa-a194-4193-af7c-4afbed2eaaef None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:09.708608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b94cfa-a194-4193-af7c-4afbed2eaaef None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:09.708988 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b94cfa-a194-4193-af7c-4afbed2eaaef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:09.710534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b94cfa-a194-4193-af7c-4afbed2eaaef None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:09.718954 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 65/127] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:09.724812 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b94cfa-a194-4193-af7c-4afbed2eaaef None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:09.768051 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5c8b3-2839-4ead-8bdf-ca99d1a56edc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:09.805004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaff82-b807-4806-aa8a-c8ecea543c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:09.805004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaff82-b807-4806-aa8a-c8ecea543c3d None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:09.805004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaff82-b807-4806-aa8a-c8ecea543c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:09.805004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaff82-b807-4806-aa8a-c8ecea543c3d None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7/users/9abf29d44f1a4c1ca2c6ad2350032bb9/roles/6437cf432fe44cc28aa54208759f1265` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:09.805885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafaff82-b807-4806-aa8a-c8ecea543c3d None admin] RBAC: Authorizing `identity:create_grant(project_id=07752e1fa91d4fec8615e3b11c555cb7, user_id=9abf29d44f1a4c1ca2c6ad2350032bb9, role_id=6437cf432fe44cc28aa54208759f1265)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:09.807431 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafaff82-b807-4806-aa8a-c8ecea543c3d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:09.844812 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b94cfa-a194-4193-af7c-4afbed2eaaef None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:09.880237 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab15bf9-c49f-49c8-a762-e57062a22fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:09.881123 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab15bf9-c49f-49c8-a762-e57062a22fdc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:09.881414 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab15bf9-c49f-49c8-a762-e57062a22fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:09.881725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab15bf9-c49f-49c8-a762-e57062a22fdc None admin] PATH_INFO: `/v3/users/3529d1a9e25d41d4bfc8bab9cf496381` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:09.883072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab15bf9-c49f-49c8-a762-e57062a22fdc None admin] RBAC: Authorizing `identity:get_user(user_id=3529d1a9e25d41d4bfc8bab9cf496381)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:09.884535 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab15bf9-c49f-49c8-a762-e57062a22fdc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:09.886335 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 66/128] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:09 2022] GET /identity/v3/users/3529d1a9e25d41d4bfc8bab9cf496381 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:09.887131 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab15bf9-c49f-49c8-a762-e57062a22fdc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:09.899915 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 63/129] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:45:09 2022] PUT /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7/users/9abf29d44f1a4c1ca2c6ad2350032bb9/roles/6437cf432fe44cc28aa54208759f1265 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:09.901446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaff82-b807-4806-aa8a-c8ecea543c3d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:10.077251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab15bf9-c49f-49c8-a762-e57062a22fdc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:10.091403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaff82-b807-4806-aa8a-c8ecea543c3d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:10.111947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e58ea4-c560-4967-b49b-bbbe8358e823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:10.112836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e58ea4-c560-4967-b49b-bbbe8358e823 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:10.113172 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e58ea4-c560-4967-b49b-bbbe8358e823 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:10.113458 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e58ea4-c560-4967-b49b-bbbe8358e823 None admin] PATH_INFO: `/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:10.114886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e58ea4-c560-4967-b49b-bbbe8358e823 None admin] RBAC: Authorizing `identity:get_user(user_id=9abf29d44f1a4c1ca2c6ad2350032bb9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:10.116157 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e58ea4-c560-4967-b49b-bbbe8358e823 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:10.121572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 67/130] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:09 2022] GET /identity/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:10.121572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e58ea4-c560-4967-b49b-bbbe8358e823 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:10.166859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e860a8-5578-49c3-81fa-2b2e3f28e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:10.167907 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e860a8-5578-49c3-81fa-2b2e3f28e25d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:10.168293 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e860a8-5578-49c3-81fa-2b2e3f28e25d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:10.168674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e860a8-5578-49c3-81fa-2b2e3f28e25d None admin] PATH_INFO: `/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:10.170106 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e860a8-5578-49c3-81fa-2b2e3f28e25d None admin] RBAC: Authorizing `identity:get_user(user_id=9abf29d44f1a4c1ca2c6ad2350032bb9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:10.172187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e860a8-5578-49c3-81fa-2b2e3f28e25d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:10.174285 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 64/131] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:09 2022] GET /identity/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:10.174977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e860a8-5578-49c3-81fa-2b2e3f28e25d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:10.242501 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e58ea4-c560-4967-b49b-bbbe8358e823 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:10.278448 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800d8e4-089a-4f64-9568-2dae5a141af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:10.279538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800d8e4-089a-4f64-9568-2dae5a141af2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:10.279936 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800d8e4-089a-4f64-9568-2dae5a141af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:10.280337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800d8e4-089a-4f64-9568-2dae5a141af2 None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:10.281753 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800d8e4-089a-4f64-9568-2dae5a141af2 None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:10.283352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800d8e4-089a-4f64-9568-2dae5a141af2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:10.285834 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 68/132] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:10 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:10.286432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800d8e4-089a-4f64-9568-2dae5a141af2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:10.299504 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e860a8-5578-49c3-81fa-2b2e3f28e25d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:10.355715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f95b7a-71e1-4f28-8b89-03bb9c27857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:10.356906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95b7a-71e1-4f28-8b89-03bb9c27857a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:10.357345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95b7a-71e1-4f28-8b89-03bb9c27857a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:10.357811 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95b7a-71e1-4f28-8b89-03bb9c27857a None admin] PATH_INFO: `/v3/projects/1054800bee554353bb2ad7cb127a4d8b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:10.361714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f95b7a-71e1-4f28-8b89-03bb9c27857a None admin] RBAC: Authorizing `identity:get_project(project_id=1054800bee554353bb2ad7cb127a4d8b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:10.363892 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f95b7a-71e1-4f28-8b89-03bb9c27857a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:10.367413 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 65/133] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:10 2022] GET /identity/v3/projects/1054800bee554353bb2ad7cb127a4d8b => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:10.368845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f95b7a-71e1-4f28-8b89-03bb9c27857a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:10.400854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800d8e4-089a-4f64-9568-2dae5a141af2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:10.434681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a52a6-bcc5-4eab-a7ef-66e3d74cb0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:10.435744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a52a6-bcc5-4eab-a7ef-66e3d74cb0cf None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:10.436133 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a52a6-bcc5-4eab-a7ef-66e3d74cb0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:10.437076 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a52a6-bcc5-4eab-a7ef-66e3d74cb0cf None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:10.438449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a52a6-bcc5-4eab-a7ef-66e3d74cb0cf None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:10.440060 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a52a6-bcc5-4eab-a7ef-66e3d74cb0cf None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:10.441924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 69/134] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:10 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:10.442822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a52a6-bcc5-4eab-a7ef-66e3d74cb0cf None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:10.484458 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f95b7a-71e1-4f28-8b89-03bb9c27857a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:10.531204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ab081-be09-4f4d-bdc9-44710192f1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:10.532128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ab081-be09-4f4d-bdc9-44710192f1be None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:10.532416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ab081-be09-4f4d-bdc9-44710192f1be None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:10.532696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ab081-be09-4f4d-bdc9-44710192f1be None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7/users/3529d1a9e25d41d4bfc8bab9cf496381/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:10.536529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ab081-be09-4f4d-bdc9-44710192f1be None admin] RBAC: Authorizing `identity:create_grant(project_id=07752e1fa91d4fec8615e3b11c555cb7, user_id=3529d1a9e25d41d4bfc8bab9cf496381, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:10.538054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ab081-be09-4f4d-bdc9-44710192f1be None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:10.559119 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a52a6-bcc5-4eab-a7ef-66e3d74cb0cf None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:10.600474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f4c26-5605-41fa-a73e-0ac7fa91c74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:10.601380 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f4c26-5605-41fa-a73e-0ac7fa91c74a None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:10.601704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f4c26-5605-41fa-a73e-0ac7fa91c74a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:10.602045 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f4c26-5605-41fa-a73e-0ac7fa91c74a None admin] PATH_INFO: `/v3/projects/1054800bee554353bb2ad7cb127a4d8b/users/9abf29d44f1a4c1ca2c6ad2350032bb9/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:10.604118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f4c26-5605-41fa-a73e-0ac7fa91c74a None admin] RBAC: Authorizing `identity:create_grant(project_id=1054800bee554353bb2ad7cb127a4d8b, user_id=9abf29d44f1a4c1ca2c6ad2350032bb9, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:10.605593 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f4c26-5605-41fa-a73e-0ac7fa91c74a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:10.664775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 66/135] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:45:10 2022] PUT /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7/users/3529d1a9e25d41d4bfc8bab9cf496381/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:10.665577 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ab081-be09-4f4d-bdc9-44710192f1be None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:10.710745 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 70/136] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:45:10 2022] PUT /identity/v3/projects/1054800bee554353bb2ad7cb127a4d8b/users/9abf29d44f1a4c1ca2c6ad2350032bb9/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:10.812882 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ab081-be09-4f4d-bdc9-44710192f1be None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:10.857307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ec4da-23ec-4429-80c2-5081c1255697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:10.858270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ec4da-23ec-4429-80c2-5081c1255697 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:10.859096 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ec4da-23ec-4429-80c2-5081c1255697 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:10.859380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ec4da-23ec-4429-80c2-5081c1255697 None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7/users/9abf29d44f1a4c1ca2c6ad2350032bb9/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:10.861612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ec4da-23ec-4429-80c2-5081c1255697 None admin] RBAC: Authorizing `identity:create_grant(project_id=07752e1fa91d4fec8615e3b11c555cb7, user_id=9abf29d44f1a4c1ca2c6ad2350032bb9, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:10.868035 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ec4da-23ec-4429-80c2-5081c1255697 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:10.937360 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 67/137] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:45:10 2022] PUT /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7/users/9abf29d44f1a4c1ca2c6ad2350032bb9/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:11.058940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230bff5-69c6-4d7a-bd87-b2b41280109a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:11.059257 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230bff5-69c6-4d7a-bd87-b2b41280109a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:11.059521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230bff5-69c6-4d7a-bd87-b2b41280109a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:11.060975 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 71/138] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:11.067277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce56c0a-04ab-4be6-a66d-45db10958083 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:11.067567 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce56c0a-04ab-4be6-a66d-45db10958083 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:11.067848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce56c0a-04ab-4be6-a66d-45db10958083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:11.086000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4ce56c0a-04ab-4be6-a66d-45db10958083 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:11.087329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4ce56c0a-04ab-4be6-a66d-45db10958083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:11.174847 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 68/139] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:11.213919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230bff5-69c6-4d7a-bd87-b2b41280109a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:11.332184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230bff5-69c6-4d7a-bd87-b2b41280109a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:11.366126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e80320-b443-42f6-a3a9-3aefb32ed3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:11.366939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e80320-b443-42f6-a3a9-3aefb32ed3de None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:11.367227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e80320-b443-42f6-a3a9-3aefb32ed3de None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:11.367508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e80320-b443-42f6-a3a9-3aefb32ed3de None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:11.368787 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e80320-b443-42f6-a3a9-3aefb32ed3de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:11.370334 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e80320-b443-42f6-a3a9-3aefb32ed3de None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:11.372062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 72/140] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:11.378555 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce56c0a-04ab-4be6-a66d-45db10958083 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:11.488208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce56c0a-04ab-4be6-a66d-45db10958083 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:11.522703 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b82b0-ec2a-42cb-9b20-e1783ddcccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:11.523405 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b82b0-ec2a-42cb-9b20-e1783ddcccf5 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:11.523686 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b82b0-ec2a-42cb-9b20-e1783ddcccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:11.523964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b82b0-ec2a-42cb-9b20-e1783ddcccf5 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:11.524696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b82b0-ec2a-42cb-9b20-e1783ddcccf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:11.526223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b82b0-ec2a-42cb-9b20-e1783ddcccf5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:11.639439 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17a5ca-4c7d-430c-8a89-e18b13f0b644 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:11.640401 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17a5ca-4c7d-430c-8a89-e18b13f0b644 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:11.640690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17a5ca-4c7d-430c-8a89-e18b13f0b644 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:11.642294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 73/141] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:45:11.647449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef57b7-d622-4fc1-bc2d-185d2d5900a9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:11.647742 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef57b7-d622-4fc1-bc2d-185d2d5900a9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:11.648027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef57b7-d622-4fc1-bc2d-185d2d5900a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:11.676312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 69/142] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:45:11 2022] POST /identity/v3/users => generated 283 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:45:11.682119 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-40ef57b7-d622-4fc1-bc2d-185d2d5900a9 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:11.683378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-40ef57b7-d622-4fc1-bc2d-185d2d5900a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:11.756901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 74/143] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:45:11.810370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b82b0-ec2a-42cb-9b20-e1783ddcccf5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:11.926396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b82b0-ec2a-42cb-9b20-e1783ddcccf5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:11.967296 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5320ef-f1dc-4437-8a2e-d17957692a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:11.968216 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5320ef-f1dc-4437-8a2e-d17957692a22 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:11.968547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5320ef-f1dc-4437-8a2e-d17957692a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:11.968826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5320ef-f1dc-4437-8a2e-d17957692a22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:11.986403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5320ef-f1dc-4437-8a2e-d17957692a22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ef5320ef-f1dc-4437-8a2e-d17957692a22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:11.994187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:11.995066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:11.995877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:11.995877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:11.995877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:11.995877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:11.995877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:11.995877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:11.995877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:11.995877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:11.995877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:11.995877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:11.995877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:11.995877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:11.995877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 70/144] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:12.001933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef57b7-d622-4fc1-bc2d-185d2d5900a9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:12.108817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef57b7-d622-4fc1-bc2d-185d2d5900a9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:12.143171 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d9392-9c0e-46d6-b0c8-487f2c66c611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:12.143852 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d9392-9c0e-46d6-b0c8-487f2c66c611 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:12.144137 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d9392-9c0e-46d6-b0c8-487f2c66c611 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:12.144674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d9392-9c0e-46d6-b0c8-487f2c66c611 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:12.145423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d9392-9c0e-46d6-b0c8-487f2c66c611 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:12.145766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d9392-9c0e-46d6-b0c8-487f2c66c611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:12.147148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d9392-9c0e-46d6-b0c8-487f2c66c611 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:12.156205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 75/145] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:12.162019 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5320ef-f1dc-4437-8a2e-d17957692a22 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:12.272951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5320ef-f1dc-4437-8a2e-d17957692a22 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:12.313670 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12345d91-11b7-407b-9d17-5278c9aefe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:12.314953 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345d91-11b7-407b-9d17-5278c9aefe27 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:12.315435 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345d91-11b7-407b-9d17-5278c9aefe27 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:12.315969 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345d91-11b7-407b-9d17-5278c9aefe27 None admin] PATH_INFO: `/v3/users/60c4d6c6dbe647dfaabd9a40ff209f79` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:12.317353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12345d91-11b7-407b-9d17-5278c9aefe27 None admin] RBAC: Authorizing `identity:get_user(user_id=60c4d6c6dbe647dfaabd9a40ff209f79)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:12.319089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12345d91-11b7-407b-9d17-5278c9aefe27 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:12.320990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 71/146] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:12 2022] GET /identity/v3/users/60c4d6c6dbe647dfaabd9a40ff209f79 => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:12.326642 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d9392-9c0e-46d6-b0c8-487f2c66c611 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:12.471339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d9392-9c0e-46d6-b0c8-487f2c66c611 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:12.508904 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e56815-cf24-42f7-8071-b6ffded28e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:12.509801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e56815-cf24-42f7-8071-b6ffded28e6d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:12.510085 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e56815-cf24-42f7-8071-b6ffded28e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:12.510362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e56815-cf24-42f7-8071-b6ffded28e6d None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:12.511565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e56815-cf24-42f7-8071-b6ffded28e6d None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:12.513008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e56815-cf24-42f7-8071-b6ffded28e6d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:12.515562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 76/147] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:12 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:12.521889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12345d91-11b7-407b-9d17-5278c9aefe27 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:12.647160 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12345d91-11b7-407b-9d17-5278c9aefe27 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:12.683078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501861a-9dda-41a8-905a-038e6bab52c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:12.684331 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501861a-9dda-41a8-905a-038e6bab52c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:12.684823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501861a-9dda-41a8-905a-038e6bab52c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:12.685294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501861a-9dda-41a8-905a-038e6bab52c2 None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7/users/60c4d6c6dbe647dfaabd9a40ff209f79/roles/12cfd45464bc4f27ba33f6b1038f3d31` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:12.688062 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501861a-9dda-41a8-905a-038e6bab52c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=07752e1fa91d4fec8615e3b11c555cb7, user_id=60c4d6c6dbe647dfaabd9a40ff209f79, role_id=12cfd45464bc4f27ba33f6b1038f3d31)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:12.689778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501861a-9dda-41a8-905a-038e6bab52c2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:12.756461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 72/148] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:45:12 2022] PUT /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7/users/60c4d6c6dbe647dfaabd9a40ff209f79/roles/12cfd45464bc4f27ba33f6b1038f3d31 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:13.125967 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02020206-7439-420f-9881-4b8246fa3907 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:13.126336 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02020206-7439-420f-9881-4b8246fa3907 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:13.126544 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02020206-7439-420f-9881-4b8246fa3907 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:13.128784 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 77/149] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:13.136445 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5f819-55c8-41f0-a939-99ef405cbc2b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:13.137024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5f819-55c8-41f0-a939-99ef405cbc2b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:13.137504 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5f819-55c8-41f0-a939-99ef405cbc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:13.157750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-28a5f819-55c8-41f0-a939-99ef405cbc2b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:13.159237 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-28a5f819-55c8-41f0-a939-99ef405cbc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:13.231449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 73/150] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:13.271567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02020206-7439-420f-9881-4b8246fa3907 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:13.379240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02020206-7439-420f-9881-4b8246fa3907 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:13.413154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c621eb-9eb7-416c-8115-bbc7cd4db7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:13.414318 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c621eb-9eb7-416c-8115-bbc7cd4db7bc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:13.414812 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c621eb-9eb7-416c-8115-bbc7cd4db7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:13.415284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c621eb-9eb7-416c-8115-bbc7cd4db7bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:13.425882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c621eb-9eb7-416c-8115-bbc7cd4db7bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-41c621eb-9eb7-416c-8115-bbc7cd4db7bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:13.434482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:13.435339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:13.436118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:13.436118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:13.436118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:13.436118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:13.436118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:13.436118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:13.436118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:13.436118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:13.436118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:13.436118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:13.436118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:13.436118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:13.439203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 78/151] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:45:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:13.444918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5f819-55c8-41f0-a939-99ef405cbc2b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:13.554592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5f819-55c8-41f0-a939-99ef405cbc2b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:13.588639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05c0f7-d9aa-4ba9-8554-cd6e6a46f004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:13.589719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05c0f7-d9aa-4ba9-8554-cd6e6a46f004 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:13.590203 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05c0f7-d9aa-4ba9-8554-cd6e6a46f004 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:13.590678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05c0f7-d9aa-4ba9-8554-cd6e6a46f004 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:13.591620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05c0f7-d9aa-4ba9-8554-cd6e6a46f004 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:13.592158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05c0f7-d9aa-4ba9-8554-cd6e6a46f004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:13.594304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05c0f7-d9aa-4ba9-8554-cd6e6a46f004 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:13.603025 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 74/152] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:45:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:13.610228 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c621eb-9eb7-416c-8115-bbc7cd4db7bc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:13.718304 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c621eb-9eb7-416c-8115-bbc7cd4db7bc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:13.752282 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f4b7d-f2c1-40f3-8f67-d42dadba4aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:13.753559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4b7d-f2c1-40f3-8f67-d42dadba4aef None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:13.754037 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4b7d-f2c1-40f3-8f67-d42dadba4aef None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:13.754521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4b7d-f2c1-40f3-8f67-d42dadba4aef None admin] PATH_INFO: `/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:13.755908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f4b7d-f2c1-40f3-8f67-d42dadba4aef None admin] RBAC: Authorizing `identity:get_user(user_id=9abf29d44f1a4c1ca2c6ad2350032bb9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:13.757586 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f4b7d-f2c1-40f3-8f67-d42dadba4aef None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:13.759436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 79/153] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:13 2022] GET /identity/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:13.765632 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05c0f7-d9aa-4ba9-8554-cd6e6a46f004 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:13.915138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05c0f7-d9aa-4ba9-8554-cd6e6a46f004 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:13.955065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54250c1-c50a-4c4d-b2cd-89d504423a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:13.955789 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54250c1-c50a-4c4d-b2cd-89d504423a09 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:13.956081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54250c1-c50a-4c4d-b2cd-89d504423a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:13.956362 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54250c1-c50a-4c4d-b2cd-89d504423a09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:14.028288 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54250c1-c50a-4c4d-b2cd-89d504423a09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:14.029694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54250c1-c50a-4c4d-b2cd-89d504423a09 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:14.144691 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 75/154] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:14.150853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f4b7d-f2c1-40f3-8f67-d42dadba4aef None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:14.299724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f4b7d-f2c1-40f3-8f67-d42dadba4aef None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:14.343834 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617e7d4-b065-4ba0-a3b8-3b1cae1f1ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:14.344705 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617e7d4-b065-4ba0-a3b8-3b1cae1f1ecb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:14.344988 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617e7d4-b065-4ba0-a3b8-3b1cae1f1ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:14.345265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617e7d4-b065-4ba0-a3b8-3b1cae1f1ecb None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:14.349736 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617e7d4-b065-4ba0-a3b8-3b1cae1f1ecb None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:14.351255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617e7d4-b065-4ba0-a3b8-3b1cae1f1ecb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:14.353216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 80/155] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:14 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:14.359704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54250c1-c50a-4c4d-b2cd-89d504423a09 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:14.508030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54250c1-c50a-4c4d-b2cd-89d504423a09 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:14.547101 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de66b6-f019-4bd7-b46f-2694029f31c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:14.547766 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de66b6-f019-4bd7-b46f-2694029f31c1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:14.548052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de66b6-f019-4bd7-b46f-2694029f31c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:14.548392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de66b6-f019-4bd7-b46f-2694029f31c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:14.549268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de66b6-f019-4bd7-b46f-2694029f31c1 None admin] RBAC: Adding query filter params (role.id=6437cf432fe44cc28aa54208759f1265, scope.project.id=07752e1fa91d4fec8615e3b11c555cb7, user.id=9abf29d44f1a4c1ca2c6ad2350032bb9) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:14.549609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de66b6-f019-4bd7-b46f-2694029f31c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:14.551123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de66b6-f019-4bd7-b46f-2694029f31c1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:14.562446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 76/156] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:14 2022] GET /identity/v3/role_assignments?user.id=9abf29d44f1a4c1ca2c6ad2350032bb9&scope.project.id=07752e1fa91d4fec8615e3b11c555cb7&role.id=6437cf432fe44cc28aa54208759f1265 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:14.695304 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e05614-b39d-4b6b-8d93-b4d118f4371c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:14.696157 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e05614-b39d-4b6b-8d93-b4d118f4371c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:14.696581 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e05614-b39d-4b6b-8d93-b4d118f4371c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:14.698240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 81/157] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:14.704859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa469c6-2c9d-49a1-8542-22f6ab82dd7a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:14.705151 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa469c6-2c9d-49a1-8542-22f6ab82dd7a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:14.705435 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa469c6-2c9d-49a1-8542-22f6ab82dd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:14.727005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-efa469c6-2c9d-49a1-8542-22f6ab82dd7a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:14.728259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-efa469c6-2c9d-49a1-8542-22f6ab82dd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:14.821800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 77/158] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:14.858254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e05614-b39d-4b6b-8d93-b4d118f4371c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:14.911221 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420d64d-cc11-4bfd-8026-dc6309b9c0a7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:14.911740 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420d64d-cc11-4bfd-8026-dc6309b9c0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:14.912162 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420d64d-cc11-4bfd-8026-dc6309b9c0a7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:14.913869 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 78/159] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:45:14.927529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549354f-1eb1-4585-9b97-9fc77b3c94e1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:14.928097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549354f-1eb1-4585-9b97-9fc77b3c94e1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:14.928550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549354f-1eb1-4585-9b97-9fc77b3c94e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:14.962077 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5549354f-1eb1-4585-9b97-9fc77b3c94e1 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:14.963576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5549354f-1eb1-4585-9b97-9fc77b3c94e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:15.002806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e05614-b39d-4b6b-8d93-b4d118f4371c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:15.053169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6975c-1976-4b41-996b-13c140b84971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:15.054261 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6975c-1976-4b41-996b-13c140b84971 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:15.054688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6975c-1976-4b41-996b-13c140b84971 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:15.055125 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6975c-1976-4b41-996b-13c140b84971 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:15.066452 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6975c-1976-4b41-996b-13c140b84971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f6d6975c-1976-4b41-996b-13c140b84971 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:15.074590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:15.075746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:15.076894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:15.076894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:15.076894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:15.076894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:15.076894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:15.076894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:15.076894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:15.076894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:15.076894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:15.076894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:15.076894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:15.076894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:15.079430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 82/160] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:15.084722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 79/161] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:15.085515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da3b5-59e1-420c-9ac2-84132aa1a404 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:15.085991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da3b5-59e1-420c-9ac2-84132aa1a404 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:15.086164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549354f-1eb1-4585-9b97-9fc77b3c94e1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:15.086577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da3b5-59e1-420c-9ac2-84132aa1a404 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:15.088052 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 83/162] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:15.107185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b5375-1696-4997-b07f-27c86c49eb3f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:15.107692 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b5375-1696-4997-b07f-27c86c49eb3f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:15.108139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b5375-1696-4997-b07f-27c86c49eb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:15.136491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3c2b5375-1696-4997-b07f-27c86c49eb3f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:15.137936 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3c2b5375-1696-4997-b07f-27c86c49eb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:15.208942 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 84/163] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:45:15.210052 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b5375-1696-4997-b07f-27c86c49eb3f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:15.267715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549354f-1eb1-4585-9b97-9fc77b3c94e1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:15.333827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b73fa6-6a73-44b2-9b3e-8637bff18d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:15.334417 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b73fa6-6a73-44b2-9b3e-8637bff18d0a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:15.334696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b73fa6-6a73-44b2-9b3e-8637bff18d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:15.334967 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b73fa6-6a73-44b2-9b3e-8637bff18d0a None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:15.336884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b73fa6-6a73-44b2-9b3e-8637bff18d0a None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:15.337191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b73fa6-6a73-44b2-9b3e-8637bff18d0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:15.338602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b73fa6-6a73-44b2-9b3e-8637bff18d0a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:15.353267 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 80/164] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:15.354106 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b73fa6-6a73-44b2-9b3e-8637bff18d0a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:15.369944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b5375-1696-4997-b07f-27c86c49eb3f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:15.430230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442380c7-d16e-4997-afd8-369c735c923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:15.431024 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442380c7-d16e-4997-afd8-369c735c923d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:15.431305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442380c7-d16e-4997-afd8-369c735c923d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:15.431574 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442380c7-d16e-4997-afd8-369c735c923d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:15.456442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442380c7-d16e-4997-afd8-369c735c923d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-442380c7-d16e-4997-afd8-369c735c923d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:15.464397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:15.465352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:15.466315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:15.466315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:15.466315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:15.466315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:15.466315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:15.466315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:15.466315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:15.466315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:15.466315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:15.466315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:15.466315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:15.466315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:15.475033 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 85/165] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:15.475710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442380c7-d16e-4997-afd8-369c735c923d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:15.527171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b73fa6-6a73-44b2-9b3e-8637bff18d0a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:15.561461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252f000-7c42-481b-aaf6-47352d81f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:15.562604 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252f000-7c42-481b-aaf6-47352d81f5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:15.563060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252f000-7c42-481b-aaf6-47352d81f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:15.563504 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252f000-7c42-481b-aaf6-47352d81f5b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:15.574002 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a252f000-7c42-481b-aaf6-47352d81f5b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a252f000-7c42-481b-aaf6-47352d81f5b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:15.583083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:15.584015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:15.584815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:15.584815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:15.584815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:15.584815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:15.584815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:15.584815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:15.584815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:15.584815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:15.584815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:15.584815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:15.584815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:15.584815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:15.587333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 81/166] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:45:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:15.588314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252f000-7c42-481b-aaf6-47352d81f5b4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:15.685147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442380c7-d16e-4997-afd8-369c735c923d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:15.689870 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a252f000-7c42-481b-aaf6-47352d81f5b4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:15.723435 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e1728-9329-4f87-98b3-5523f59ca275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:15.724468 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e1728-9329-4f87-98b3-5523f59ca275 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:15.724948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e1728-9329-4f87-98b3-5523f59ca275 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:15.725439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e1728-9329-4f87-98b3-5523f59ca275 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:15.726444 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e1728-9329-4f87-98b3-5523f59ca275 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:15.726970 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e1728-9329-4f87-98b3-5523f59ca275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:15.728589 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e1728-9329-4f87-98b3-5523f59ca275 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:15.737925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 82/167] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:15.739123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e1728-9329-4f87-98b3-5523f59ca275 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:15.771399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd86c5-99fd-4cf3-802c-331c4c886b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:15.772293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd86c5-99fd-4cf3-802c-331c4c886b93 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:15.772580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd86c5-99fd-4cf3-802c-331c4c886b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:15.772857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd86c5-99fd-4cf3-802c-331c4c886b93 None admin] PATH_INFO: `/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:15.778263 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd86c5-99fd-4cf3-802c-331c4c886b93 None admin] RBAC: Authorizing `identity:get_user(user_id=9abf29d44f1a4c1ca2c6ad2350032bb9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:15.779922 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd86c5-99fd-4cf3-802c-331c4c886b93 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:15.781788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 86/168] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:15 2022] GET /identity/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9 => generated 275 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:15.782699 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd86c5-99fd-4cf3-802c-331c4c886b93 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:15.884158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e1728-9329-4f87-98b3-5523f59ca275 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:15.955570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe890f-1260-4763-89ed-a2838715890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:15.956489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe890f-1260-4763-89ed-a2838715890c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:15.956914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe890f-1260-4763-89ed-a2838715890c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:15.957327 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe890f-1260-4763-89ed-a2838715890c None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:15.958242 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe890f-1260-4763-89ed-a2838715890c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:15.958716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe890f-1260-4763-89ed-a2838715890c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:15.960241 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe890f-1260-4763-89ed-a2838715890c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:15.975308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 83/169] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:15.979069 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe890f-1260-4763-89ed-a2838715890c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:16.006999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd86c5-99fd-4cf3-802c-331c4c886b93 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:16.078591 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4c268-adf9-43bd-b99a-28566a2560d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:16.079713 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4c268-adf9-43bd-b99a-28566a2560d5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:16.080134 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4c268-adf9-43bd-b99a-28566a2560d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:16.080544 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4c268-adf9-43bd-b99a-28566a2560d5 None admin] PATH_INFO: `/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:16.086254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4c268-adf9-43bd-b99a-28566a2560d5 None admin] RBAC: Authorizing `identity:get_user(user_id=9abf29d44f1a4c1ca2c6ad2350032bb9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:16.087889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4c268-adf9-43bd-b99a-28566a2560d5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:16.090017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 87/170] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:15 2022] GET /identity/v3/users/9abf29d44f1a4c1ca2c6ad2350032bb9 => generated 275 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:16.090997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4c268-adf9-43bd-b99a-28566a2560d5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:16.199603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe890f-1260-4763-89ed-a2838715890c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:16.263540 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56766e08-78e9-4641-925e-0b071d8da6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:16.264475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56766e08-78e9-4641-925e-0b071d8da6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:16.264895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56766e08-78e9-4641-925e-0b071d8da6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:16.265308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56766e08-78e9-4641-925e-0b071d8da6d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:16.268194 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4c268-adf9-43bd-b99a-28566a2560d5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:16.331024 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecf001-9136-4aa4-91a1-39d4a500aa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:16.332179 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf001-9136-4aa4-91a1-39d4a500aa87 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:16.332602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf001-9136-4aa4-91a1-39d4a500aa87 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:16.333029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecf001-9136-4aa4-91a1-39d4a500aa87 None admin] PATH_INFO: `/v3/users/3529d1a9e25d41d4bfc8bab9cf496381` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:16.335971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecf001-9136-4aa4-91a1-39d4a500aa87 None admin] RBAC: Authorizing `identity:get_user(user_id=3529d1a9e25d41d4bfc8bab9cf496381)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:16.337751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ecf001-9136-4aa4-91a1-39d4a500aa87 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:16.339538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 88/171] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:16 2022] GET /identity/v3/users/3529d1a9e25d41d4bfc8bab9cf496381 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:16.342020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecf001-9136-4aa4-91a1-39d4a500aa87 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:16.386411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56766e08-78e9-4641-925e-0b071d8da6d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:16.388792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56766e08-78e9-4641-925e-0b071d8da6d0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:16.526482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecf001-9136-4aa4-91a1-39d4a500aa87 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:16.571488 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 84/172] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:16.573997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56766e08-78e9-4641-925e-0b071d8da6d0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:16.574758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8980dd-a626-4e2d-ae97-5dbd5367208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:16.575598 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8980dd-a626-4e2d-ae97-5dbd5367208a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:16.576103 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8980dd-a626-4e2d-ae97-5dbd5367208a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:16.576513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8980dd-a626-4e2d-ae97-5dbd5367208a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:16.676736 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8980dd-a626-4e2d-ae97-5dbd5367208a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:16.678801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8980dd-a626-4e2d-ae97-5dbd5367208a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:16.713187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56766e08-78e9-4641-925e-0b071d8da6d0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:16.749816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3008c90-eb4e-41c9-a447-0f00813ce445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:16.750705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008c90-eb4e-41c9-a447-0f00813ce445 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:16.751128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008c90-eb4e-41c9-a447-0f00813ce445 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:16.751569 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3008c90-eb4e-41c9-a447-0f00813ce445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:16.824285 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3008c90-eb4e-41c9-a447-0f00813ce445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:16.826080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3008c90-eb4e-41c9-a447-0f00813ce445 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:16.916603 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 89/173] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:16.918269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8980dd-a626-4e2d-ae97-5dbd5367208a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:16.940050 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 85/174] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:16.942450 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac472d8-d95d-42b2-87d8-c55f67d12385 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:16.942938 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac472d8-d95d-42b2-87d8-c55f67d12385 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:16.943407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac472d8-d95d-42b2-87d8-c55f67d12385 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:16.944980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 86/175] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:16.946506 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22b825-a23f-465b-b86b-f131ab2fc100 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:16.948455 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22b825-a23f-465b-b86b-f131ab2fc100 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:16.949738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22b825-a23f-465b-b86b-f131ab2fc100 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:16.952103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 87/176] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:16.953215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22b825-a23f-465b-b86b-f131ab2fc100 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:17.046681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8980dd-a626-4e2d-ae97-5dbd5367208a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:17.069739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22b825-a23f-465b-b86b-f131ab2fc100 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:17.079504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e6b77-2007-4ad6-9ce0-8e8dd14c82e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:17.080293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e6b77-2007-4ad6-9ce0-8e8dd14c82e3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.080572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e6b77-2007-4ad6-9ce0-8e8dd14c82e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.080845 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e6b77-2007-4ad6-9ce0-8e8dd14c82e3 None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.082038 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e6b77-2007-4ad6-9ce0-8e8dd14c82e3 None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:17.083480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e6b77-2007-4ad6-9ce0-8e8dd14c82e3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:17.085158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 90/177] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:16 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:17.086085 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e6b77-2007-4ad6-9ce0-8e8dd14c82e3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:17.107068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63059290-dcfd-478c-a716-6f7fbd779715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:17.107917 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63059290-dcfd-478c-a716-6f7fbd779715 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.108254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63059290-dcfd-478c-a716-6f7fbd779715 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.109030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63059290-dcfd-478c-a716-6f7fbd779715 None admin] PATH_INFO: `/v3/projects/1054800bee554353bb2ad7cb127a4d8b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.110222 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63059290-dcfd-478c-a716-6f7fbd779715 None admin] RBAC: Authorizing `identity:get_project(project_id=1054800bee554353bb2ad7cb127a4d8b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:17.111657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63059290-dcfd-478c-a716-6f7fbd779715 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:17.113336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 88/178] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:16 2022] GET /identity/v3/projects/1054800bee554353bb2ad7cb127a4d8b => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:17.114491 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f12ff5-7e33-4086-8516-b9d8f3019df8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.114772 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f12ff5-7e33-4086-8516-b9d8f3019df8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.115046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f12ff5-7e33-4086-8516-b9d8f3019df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.130302 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-65f12ff5-7e33-4086-8516-b9d8f3019df8 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:17.131486 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-65f12ff5-7e33-4086-8516-b9d8f3019df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:17.179338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e6b77-2007-4ad6-9ce0-8e8dd14c82e3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:17.193331 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 89/179] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:17.194602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea677-c708-47fc-9a56-9c7e8930ac4e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.194892 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea677-c708-47fc-9a56-9c7e8930ac4e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.195172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea677-c708-47fc-9a56-9c7e8930ac4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.210757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3cbea677-c708-47fc-9a56-9c7e8930ac4e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:17.211915 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3cbea677-c708-47fc-9a56-9c7e8930ac4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:17.222758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a9684-d245-48a8-bbea-a58d96f0bbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:17.223612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a9684-d245-48a8-bbea-a58d96f0bbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.223893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a9684-d245-48a8-bbea-a58d96f0bbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.224167 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a9684-d245-48a8-bbea-a58d96f0bbb0 None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.225320 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a9684-d245-48a8-bbea-a58d96f0bbb0 None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:17.226793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a9684-d245-48a8-bbea-a58d96f0bbb0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:17.228589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 91/180] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:17 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:17.229745 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017d509-20c9-4f24-8651-062f9316d6f3 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.230030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017d509-20c9-4f24-8651-062f9316d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.230306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017d509-20c9-4f24-8651-062f9316d6f3 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.231506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 92/181] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:17.232554 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33255f18-47f1-4e9d-a84e-c3af882f2e1a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.233077 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33255f18-47f1-4e9d-a84e-c3af882f2e1a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.233960 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33255f18-47f1-4e9d-a84e-c3af882f2e1a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.237571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 93/182] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:17.237571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33255f18-47f1-4e9d-a84e-c3af882f2e1a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:17.280656 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 90/183] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:17.282461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbea677-c708-47fc-9a56-9c7e8930ac4e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:17.330865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33255f18-47f1-4e9d-a84e-c3af882f2e1a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:17.363167 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281753e4-97a4-4bf4-87c7-2af087dc9216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:17.363821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281753e4-97a4-4bf4-87c7-2af087dc9216 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.364107 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281753e4-97a4-4bf4-87c7-2af087dc9216 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.364383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281753e4-97a4-4bf4-87c7-2af087dc9216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.365213 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281753e4-97a4-4bf4-87c7-2af087dc9216 None admin] RBAC: Adding query filter params (role.id=a211713995b7409ca158916c665f73b6, scope.project.id=07752e1fa91d4fec8615e3b11c555cb7, user.id=9abf29d44f1a4c1ca2c6ad2350032bb9) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:17.365566 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281753e4-97a4-4bf4-87c7-2af087dc9216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:17.367389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281753e4-97a4-4bf4-87c7-2af087dc9216 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:17.373358 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 94/184] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:17 2022] GET /identity/v3/role_assignments?user.id=9abf29d44f1a4c1ca2c6ad2350032bb9&scope.project.id=07752e1fa91d4fec8615e3b11c555cb7&role.id=a211713995b7409ca158916c665f73b6 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:17.373981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281753e4-97a4-4bf4-87c7-2af087dc9216 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:17.389187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbea677-c708-47fc-9a56-9c7e8930ac4e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:17.429033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c9754-57f2-49e2-86e0-fa4c291a70d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:17.429882 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c9754-57f2-49e2-86e0-fa4c291a70d1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.430190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c9754-57f2-49e2-86e0-fa4c291a70d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.430675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c9754-57f2-49e2-86e0-fa4c291a70d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.431696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c9754-57f2-49e2-86e0-fa4c291a70d1 None admin] RBAC: Adding query filter params (role.id=a211713995b7409ca158916c665f73b6, scope.project.id=1054800bee554353bb2ad7cb127a4d8b, user.id=9abf29d44f1a4c1ca2c6ad2350032bb9) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:17.432015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c9754-57f2-49e2-86e0-fa4c291a70d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:17.433549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c9754-57f2-49e2-86e0-fa4c291a70d1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:17.440609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 91/185] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:17 2022] GET /identity/v3/role_assignments?user.id=9abf29d44f1a4c1ca2c6ad2350032bb9&scope.project.id=1054800bee554353bb2ad7cb127a4d8b&role.id=a211713995b7409ca158916c665f73b6 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:17.454627 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c9754-57f2-49e2-86e0-fa4c291a70d1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:17.492938 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281753e4-97a4-4bf4-87c7-2af087dc9216 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:17.542770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9555bb-8783-412a-96d0-1426314960ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:17.545045 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9555bb-8783-412a-96d0-1426314960ca None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.546180 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9555bb-8783-412a-96d0-1426314960ca None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.546665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9555bb-8783-412a-96d0-1426314960ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.562570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9555bb-8783-412a-96d0-1426314960ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-1f9555bb-8783-412a-96d0-1426314960ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:17.573013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:17.574049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:17.574858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:17.574858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:17.574858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:17.574858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:17.574858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:17.574858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:17.574858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:17.574858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:17.574858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:17.574858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:17.574858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:17.574858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:17.575483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 95/186] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:17.577654 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326f8f9-9bd3-4bde-821f-0834afc69860 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.577928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326f8f9-9bd3-4bde-821f-0834afc69860 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.578209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326f8f9-9bd3-4bde-821f-0834afc69860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.582672 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c9754-57f2-49e2-86e0-fa4c291a70d1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:17.604321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c326f8f9-9bd3-4bde-821f-0834afc69860 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:17.605578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c326f8f9-9bd3-4bde-821f-0834afc69860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:17.633056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639062f-a3d7-40d1-adea-3a8d0f7cbdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:17.633862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639062f-a3d7-40d1-adea-3a8d0f7cbdb6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.634155 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639062f-a3d7-40d1-adea-3a8d0f7cbdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.634435 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639062f-a3d7-40d1-adea-3a8d0f7cbdb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.635285 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639062f-a3d7-40d1-adea-3a8d0f7cbdb6 None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=07752e1fa91d4fec8615e3b11c555cb7, user.id=3529d1a9e25d41d4bfc8bab9cf496381) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:17.635601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639062f-a3d7-40d1-adea-3a8d0f7cbdb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:17.637182 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639062f-a3d7-40d1-adea-3a8d0f7cbdb6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:17.647575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 92/187] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:17 2022] GET /identity/v3/role_assignments?user.id=3529d1a9e25d41d4bfc8bab9cf496381&scope.project.id=07752e1fa91d4fec8615e3b11c555cb7&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:17.648848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275c1a0-8adb-4883-bea6-f808d5df36ca None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.648848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275c1a0-8adb-4883-bea6-f808d5df36ca None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.649134 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275c1a0-8adb-4883-bea6-f808d5df36ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.673490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e275c1a0-8adb-4883-bea6-f808d5df36ca None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:17.675733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e275c1a0-8adb-4883-bea6-f808d5df36ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:17.699360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 96/188] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:17.700664 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326f8f9-9bd3-4bde-821f-0834afc69860 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:17.771168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 93/189] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:17.772489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275c1a0-8adb-4883-bea6-f808d5df36ca None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:17.833018 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326f8f9-9bd3-4bde-821f-0834afc69860 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:17.876941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd229b-f6b6-489c-901e-4941106a9646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:17.877775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd229b-f6b6-489c-901e-4941106a9646 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.878059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd229b-f6b6-489c-901e-4941106a9646 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.878331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd229b-f6b6-489c-901e-4941106a9646 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.886895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275c1a0-8adb-4883-bea6-f808d5df36ca None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:17.889430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd229b-f6b6-489c-901e-4941106a9646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c3cd229b-f6b6-489c-901e-4941106a9646 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:17.897392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:17.898491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:17.899474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:17.899474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:17.899474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:17.899474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:17.899474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:17.899474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:17.899474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:17.899474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:17.899474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:17.899474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:17.899474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:17.899474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:17.899474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 97/190] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:17.899474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd229b-f6b6-489c-901e-4941106a9646 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:17.927184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b43b3-9738-4e7f-abff-274d011dd9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:17.927853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b43b3-9738-4e7f-abff-274d011dd9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:17.928136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b43b3-9738-4e7f-abff-274d011dd9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:17.928408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b43b3-9738-4e7f-abff-274d011dd9c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:17.929147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b43b3-9738-4e7f-abff-274d011dd9c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:17.929456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b43b3-9738-4e7f-abff-274d011dd9c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:17.930874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b43b3-9738-4e7f-abff-274d011dd9c0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:17.939374 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 94/191] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:17.940171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b43b3-9738-4e7f-abff-274d011dd9c0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:18.002300 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd229b-f6b6-489c-901e-4941106a9646 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:18.033400 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b43b3-9738-4e7f-abff-274d011dd9c0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:18.033574 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dff1ee-e891-423b-8f65-f95ff6151d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:18.034269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff1ee-e891-423b-8f65-f95ff6151d22 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:18.034550 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff1ee-e891-423b-8f65-f95ff6151d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:18.034823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dff1ee-e891-423b-8f65-f95ff6151d22 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:18.044552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dff1ee-e891-423b-8f65-f95ff6151d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-77dff1ee-e891-423b-8f65-f95ff6151d22 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:18.053206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:18.054116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:18.054944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:18.054944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:18.054944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:18.054944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:18.054944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:18.054944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:18.054944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:18.054944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:18.054944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:18.054944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:18.054944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:18.054944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:18.054944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 98/192] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:45:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:18.055650 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dff1ee-e891-423b-8f65-f95ff6151d22 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:18.066256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa0dd0-f9c7-4079-8e4f-b84b87c605d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:18.067047 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa0dd0-f9c7-4079-8e4f-b84b87c605d9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:18.067331 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa0dd0-f9c7-4079-8e4f-b84b87c605d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:18.067602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa0dd0-f9c7-4079-8e4f-b84b87c605d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:18.068756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa0dd0-f9c7-4079-8e4f-b84b87c605d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:18.070228 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa0dd0-f9c7-4079-8e4f-b84b87c605d9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:18.071811 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 95/193] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:18.072560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa0dd0-f9c7-4079-8e4f-b84b87c605d9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:18.151040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dff1ee-e891-423b-8f65-f95ff6151d22 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:18.167860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa0dd0-f9c7-4079-8e4f-b84b87c605d9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:18.182700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1b8d2-6fb8-4eae-a97d-14951f8394e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:18.183361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1b8d2-6fb8-4eae-a97d-14951f8394e2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:18.183648 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1b8d2-6fb8-4eae-a97d-14951f8394e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:18.183929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1b8d2-6fb8-4eae-a97d-14951f8394e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:18.184678 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1b8d2-6fb8-4eae-a97d-14951f8394e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:18.184990 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1b8d2-6fb8-4eae-a97d-14951f8394e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:18.186439 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1b8d2-6fb8-4eae-a97d-14951f8394e2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:18.194175 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 99/194] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:18.196052 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1b8d2-6fb8-4eae-a97d-14951f8394e2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:18.200073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169064a0-11ee-4d11-9977-c4624278d3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:18.200925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169064a0-11ee-4d11-9977-c4624278d3fb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:18.201205 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169064a0-11ee-4d11-9977-c4624278d3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:18.201477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169064a0-11ee-4d11-9977-c4624278d3fb None admin] PATH_INFO: `/v3/users/a62a529073f64b36bc4b328a09b6895e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:18.215886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169064a0-11ee-4d11-9977-c4624278d3fb None admin] RBAC: Authorizing `identity:get_user(user_id=a62a529073f64b36bc4b328a09b6895e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:18.217318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169064a0-11ee-4d11-9977-c4624278d3fb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:18.219516 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 96/195] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:18 2022] GET /identity/v3/users/a62a529073f64b36bc4b328a09b6895e => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:18.220316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169064a0-11ee-4d11-9977-c4624278d3fb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:18.290569 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1b8d2-6fb8-4eae-a97d-14951f8394e2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:18.312722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169064a0-11ee-4d11-9977-c4624278d3fb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:18.320774 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a848a36-4da5-4043-9d0c-f738c0174f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:18.321433 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a848a36-4da5-4043-9d0c-f738c0174f9b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:18.321741 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a848a36-4da5-4043-9d0c-f738c0174f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:18.322013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a848a36-4da5-4043-9d0c-f738c0174f9b None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:18.322755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a848a36-4da5-4043-9d0c-f738c0174f9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:18.323059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a848a36-4da5-4043-9d0c-f738c0174f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:18.324424 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a848a36-4da5-4043-9d0c-f738c0174f9b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:18.332323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 100/196] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:45:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:18.336995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a848a36-4da5-4043-9d0c-f738c0174f9b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:18.345575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e2afe-b47f-4efe-bdd2-3cd6742f77d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:18.346243 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e2afe-b47f-4efe-bdd2-3cd6742f77d8 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:18.346529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e2afe-b47f-4efe-bdd2-3cd6742f77d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:18.346806 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e2afe-b47f-4efe-bdd2-3cd6742f77d8 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:18.347513 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e2afe-b47f-4efe-bdd2-3cd6742f77d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:18.348941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e2afe-b47f-4efe-bdd2-3cd6742f77d8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:18.425231 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a848a36-4da5-4043-9d0c-f738c0174f9b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:18.456299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfa430-b18d-49ab-896b-5f9b2f103517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:18.457226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfa430-b18d-49ab-896b-5f9b2f103517 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:18.457507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfa430-b18d-49ab-896b-5f9b2f103517 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:18.457810 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfa430-b18d-49ab-896b-5f9b2f103517 None admin] PATH_INFO: `/v3/users/60c4d6c6dbe647dfaabd9a40ff209f79` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:18.458983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfa430-b18d-49ab-896b-5f9b2f103517 None admin] RBAC: Authorizing `identity:get_user(user_id=60c4d6c6dbe647dfaabd9a40ff209f79)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:18.460409 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfa430-b18d-49ab-896b-5f9b2f103517 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:18.462031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 101/197] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:18 2022] GET /identity/v3/users/60c4d6c6dbe647dfaabd9a40ff209f79 => generated 289 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:18.462829 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfa430-b18d-49ab-896b-5f9b2f103517 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:18.489567 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 97/198] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:45:18 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:45:18.489567 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e2afe-b47f-4efe-bdd2-3cd6742f77d8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:18.568333 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfa430-b18d-49ab-896b-5f9b2f103517 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:18.582157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e2afe-b47f-4efe-bdd2-3cd6742f77d8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:18.603758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f4f7a-d63f-4c6c-9857-1ec0f474c14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:18.604089 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f4f7a-d63f-4c6c-9857-1ec0f474c14a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:18.604373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f4f7a-d63f-4c6c-9857-1ec0f474c14a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:18.604648 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f4f7a-d63f-4c6c-9857-1ec0f474c14a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:18.618106 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f4a93-647a-41f1-8ac4-c06c3647158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:18.618995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f4a93-647a-41f1-8ac4-c06c3647158d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:18.619278 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f4a93-647a-41f1-8ac4-c06c3647158d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:18.619552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f4a93-647a-41f1-8ac4-c06c3647158d None admin] PATH_INFO: `/v3/users/a62a529073f64b36bc4b328a09b6895e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:18.620777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f4a93-647a-41f1-8ac4-c06c3647158d None admin] RBAC: Authorizing `identity:get_user(user_id=a62a529073f64b36bc4b328a09b6895e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:18.622281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f4a93-647a-41f1-8ac4-c06c3647158d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:18.629136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 98/199] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:18 2022] GET /identity/v3/users/a62a529073f64b36bc4b328a09b6895e => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:18.629136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f4a93-647a-41f1-8ac4-c06c3647158d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:18.674895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f4f7a-d63f-4c6c-9857-1ec0f474c14a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:18.676757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f4f7a-d63f-4c6c-9857-1ec0f474c14a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:18.731104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f4a93-647a-41f1-8ac4-c06c3647158d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:18.769971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33891d8e-3ff6-4c81-8147-60569425bbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:18.770939 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33891d8e-3ff6-4c81-8147-60569425bbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:18.771223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33891d8e-3ff6-4c81-8147-60569425bbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:18.771497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33891d8e-3ff6-4c81-8147-60569425bbd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:18.782138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 102/200] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:18.782315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f4f7a-d63f-4c6c-9857-1ec0f474c14a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:18.871777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33891d8e-3ff6-4c81-8147-60569425bbd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:18.873266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33891d8e-3ff6-4c81-8147-60569425bbd1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:18.901487 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f4f7a-d63f-4c6c-9857-1ec0f474c14a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:19.186884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baf3ad-20da-4c97-baad-65211b3da3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:19.186884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baf3ad-20da-4c97-baad-65211b3da3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:19.186884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baf3ad-20da-4c97-baad-65211b3da3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:19.186884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baf3ad-20da-4c97-baad-65211b3da3d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:19.187665 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 99/201] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:19.187665 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33891d8e-3ff6-4c81-8147-60569425bbd1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:19.187824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06baf3ad-20da-4c97-baad-65211b3da3d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:19.187824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06baf3ad-20da-4c97-baad-65211b3da3d0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:19.187959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33891d8e-3ff6-4c81-8147-60569425bbd1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:19.188032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 103/202] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:19.188032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baf3ad-20da-4c97-baad-65211b3da3d0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:19.188172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6810120-c096-4bae-81a1-36731706912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:19.188172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6810120-c096-4bae-81a1-36731706912e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:19.188172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6810120-c096-4bae-81a1-36731706912e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:19.188172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6810120-c096-4bae-81a1-36731706912e None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:19.188439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6810120-c096-4bae-81a1-36731706912e None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:19.188439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6810120-c096-4bae-81a1-36731706912e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:19.188439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 100/203] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:18 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:19.188439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6810120-c096-4bae-81a1-36731706912e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:19.217235 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baf3ad-20da-4c97-baad-65211b3da3d0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:19.228751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6810120-c096-4bae-81a1-36731706912e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:19.251947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208b3c7-d9af-4d16-a976-f92814c88aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:19.252803 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208b3c7-d9af-4d16-a976-f92814c88aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:19.253087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208b3c7-d9af-4d16-a976-f92814c88aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:19.253361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208b3c7-d9af-4d16-a976-f92814c88aa4 None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:19.254580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208b3c7-d9af-4d16-a976-f92814c88aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:19.256033 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208b3c7-d9af-4d16-a976-f92814c88aa4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:19.257933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 104/204] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:19 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:19.262369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208b3c7-d9af-4d16-a976-f92814c88aa4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:19.266333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeca09c-f7e8-46e7-b4f6-529c74aff377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:19.267363 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeca09c-f7e8-46e7-b4f6-529c74aff377 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:19.267654 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeca09c-f7e8-46e7-b4f6-529c74aff377 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:19.267928 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeca09c-f7e8-46e7-b4f6-529c74aff377 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:19.269131 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeca09c-f7e8-46e7-b4f6-529c74aff377 None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:19.270879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeca09c-f7e8-46e7-b4f6-529c74aff377 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:19.272725 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 101/205] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:19 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:19.273327 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeca09c-f7e8-46e7-b4f6-529c74aff377 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:19.361987 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208b3c7-d9af-4d16-a976-f92814c88aa4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:19.375619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeca09c-f7e8-46e7-b4f6-529c74aff377 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:19.396660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18a17e-2315-4839-aa0e-77e0fcd0d114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:19.397323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a17e-2315-4839-aa0e-77e0fcd0d114 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:19.397634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a17e-2315-4839-aa0e-77e0fcd0d114 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:19.397917 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a17e-2315-4839-aa0e-77e0fcd0d114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:19.398818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18a17e-2315-4839-aa0e-77e0fcd0d114 None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=e4df84ef89b243829f2a079628e9e618, user.id=a62a529073f64b36bc4b328a09b6895e) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:19.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18a17e-2315-4839-aa0e-77e0fcd0d114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:19.400628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18a17e-2315-4839-aa0e-77e0fcd0d114 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:19.406163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 105/206] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:19 2022] GET /identity/v3/role_assignments?user.id=a62a529073f64b36bc4b328a09b6895e&scope.project.id=e4df84ef89b243829f2a079628e9e618&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:19.406940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18a17e-2315-4839-aa0e-77e0fcd0d114 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:19.422627 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e741b-7ae4-4a10-8b8b-a77a2d9adbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:19.423359 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e741b-7ae4-4a10-8b8b-a77a2d9adbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:19.423646 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e741b-7ae4-4a10-8b8b-a77a2d9adbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:19.423913 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e741b-7ae4-4a10-8b8b-a77a2d9adbd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:19.424771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e741b-7ae4-4a10-8b8b-a77a2d9adbd8 None admin] RBAC: Adding query filter params (role.id=12cfd45464bc4f27ba33f6b1038f3d31, scope.project.id=07752e1fa91d4fec8615e3b11c555cb7, user.id=60c4d6c6dbe647dfaabd9a40ff209f79) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:19.425082 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e741b-7ae4-4a10-8b8b-a77a2d9adbd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:19.429875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e741b-7ae4-4a10-8b8b-a77a2d9adbd8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:19.440436 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 102/207] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:19 2022] GET /identity/v3/role_assignments?user.id=60c4d6c6dbe647dfaabd9a40ff209f79&scope.project.id=07752e1fa91d4fec8615e3b11c555cb7&role.id=12cfd45464bc4f27ba33f6b1038f3d31 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:19.580387 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18a17e-2315-4839-aa0e-77e0fcd0d114 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:19.621606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7f720-ae2f-4972-9dcf-d2e3302563ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:19.622288 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7f720-ae2f-4972-9dcf-d2e3302563ea None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:19.622568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7f720-ae2f-4972-9dcf-d2e3302563ea None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:19.622839 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7f720-ae2f-4972-9dcf-d2e3302563ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:19.624226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7f720-ae2f-4972-9dcf-d2e3302563ea None admin] RBAC: Adding query filter params (role.id=6437cf432fe44cc28aa54208759f1265, scope.project.id=e4df84ef89b243829f2a079628e9e618, user.id=a62a529073f64b36bc4b328a09b6895e) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:19.624539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7f720-ae2f-4972-9dcf-d2e3302563ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:19.626052 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7f720-ae2f-4972-9dcf-d2e3302563ea None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:19.632572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 106/208] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:19 2022] GET /identity/v3/role_assignments?user.id=a62a529073f64b36bc4b328a09b6895e&scope.project.id=e4df84ef89b243829f2a079628e9e618&role.id=6437cf432fe44cc28aa54208759f1265 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:20.941201 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1128d0-2b42-43b7-871c-cf14edf893fd None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:20.941770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1128d0-2b42-43b7-871c-cf14edf893fd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:20.941770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1128d0-2b42-43b7-871c-cf14edf893fd None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:20.943225 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 103/209] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:20.948560 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cb91f-d299-4415-ac8a-96f764111d68 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:20.948975 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cb91f-d299-4415-ac8a-96f764111d68 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:20.949157 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cb91f-d299-4415-ac8a-96f764111d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:20.966009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cf8cb91f-d299-4415-ac8a-96f764111d68 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:20.967268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cf8cb91f-d299-4415-ac8a-96f764111d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:20.986209 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbf2e4-252f-4d0e-8532-c428073f1011 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:20.986504 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbf2e4-252f-4d0e-8532-c428073f1011 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:20.986773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbf2e4-252f-4d0e-8532-c428073f1011 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:20.988339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 104/210] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:45:20.993155 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ab23b-93e9-4ba4-b9b4-201918ef7838 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:20.993438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ab23b-93e9-4ba4-b9b4-201918ef7838 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:20.993759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ab23b-93e9-4ba4-b9b4-201918ef7838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:21.010477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-002ab23b-93e9-4ba4-b9b4-201918ef7838 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:21.011654 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-002ab23b-93e9-4ba4-b9b4-201918ef7838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:21.035416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 107/211] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:21.059003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cb91f-d299-4415-ac8a-96f764111d68 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:21.085654 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 105/212] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:45:21.103619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ab23b-93e9-4ba4-b9b4-201918ef7838 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:21.156824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cb91f-d299-4415-ac8a-96f764111d68 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:21.190374 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b298e-8cb4-4af0-8173-22d5935a43c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:21.191172 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b298e-8cb4-4af0-8173-22d5935a43c8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:21.191459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b298e-8cb4-4af0-8173-22d5935a43c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:21.191734 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b298e-8cb4-4af0-8173-22d5935a43c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:21.200647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ab23b-93e9-4ba4-b9b4-201918ef7838 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:21.202101 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b298e-8cb4-4af0-8173-22d5935a43c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-570b298e-8cb4-4af0-8173-22d5935a43c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:21.209824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:21.212280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:21.214286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:21.214286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:21.214286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:21.214286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:21.214286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:21.214286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:21.214286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:21.214286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:21.214286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:21.214286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:21.214286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:21.214286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:21.214286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 108/213] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:45:21.221547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b298e-8cb4-4af0-8173-22d5935a43c8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:21.239329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765b54a-c50f-453e-a33c-702d64b2632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:21.240230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765b54a-c50f-453e-a33c-702d64b2632e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:21.240588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765b54a-c50f-453e-a33c-702d64b2632e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:21.240925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765b54a-c50f-453e-a33c-702d64b2632e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:21.242175 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765b54a-c50f-453e-a33c-702d64b2632e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:21.243686 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765b54a-c50f-453e-a33c-702d64b2632e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:21.245555 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 106/214] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:21.250906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765b54a-c50f-453e-a33c-702d64b2632e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:21.336587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b298e-8cb4-4af0-8173-22d5935a43c8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:21.359408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765b54a-c50f-453e-a33c-702d64b2632e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:21.370436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f443a73-2063-4d44-b7a7-37f4b72f6083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:21.371201 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f443a73-2063-4d44-b7a7-37f4b72f6083 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:21.371545 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f443a73-2063-4d44-b7a7-37f4b72f6083 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:21.371886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f443a73-2063-4d44-b7a7-37f4b72f6083 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:21.372696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f443a73-2063-4d44-b7a7-37f4b72f6083 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:21.373072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f443a73-2063-4d44-b7a7-37f4b72f6083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:21.375217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f443a73-2063-4d44-b7a7-37f4b72f6083 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:21.383575 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 109/215] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:21.389203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f443a73-2063-4d44-b7a7-37f4b72f6083 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:21.394656 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ce0e8-30a0-4a61-ac7f-8ce9e0c31cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:21.395338 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ce0e8-30a0-4a61-ac7f-8ce9e0c31cd1 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:21.395620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ce0e8-30a0-4a61-ac7f-8ce9e0c31cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:21.395894 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ce0e8-30a0-4a61-ac7f-8ce9e0c31cd1 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:21.396610 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ce0e8-30a0-4a61-ac7f-8ce9e0c31cd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:21.398120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ce0e8-30a0-4a61-ac7f-8ce9e0c31cd1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:21.486320 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f443a73-2063-4d44-b7a7-37f4b72f6083 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:21.515704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 107/216] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:45:21 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 20:45:21.526552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c05123-642b-4129-ba9c-1da0102ee643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:21.527836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c05123-642b-4129-ba9c-1da0102ee643 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:21.528365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c05123-642b-4129-ba9c-1da0102ee643 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:21.528897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c05123-642b-4129-ba9c-1da0102ee643 None admin] PATH_INFO: `/v3/users/b3d0fed593f74c6d81eeceb04b01ea6e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:21.546535 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c05123-642b-4129-ba9c-1da0102ee643 None admin] RBAC: Authorizing `identity:get_user(user_id=b3d0fed593f74c6d81eeceb04b01ea6e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:21.548511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c05123-642b-4129-ba9c-1da0102ee643 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:21.551185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 110/217] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:21 2022] GET /identity/v3/users/b3d0fed593f74c6d81eeceb04b01ea6e => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:21.559033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ce0e8-30a0-4a61-ac7f-8ce9e0c31cd1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:21.681722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ce0e8-30a0-4a61-ac7f-8ce9e0c31cd1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:21.690860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101f3a1-8904-47be-9f84-abad2df3771c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:21.691194 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101f3a1-8904-47be-9f84-abad2df3771c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:21.692438 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101f3a1-8904-47be-9f84-abad2df3771c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:21.693610 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 111/218] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:21.699547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bf1c5-5976-465a-a678-ab0f54bffadb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:21.700143 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bf1c5-5976-465a-a678-ab0f54bffadb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:21.700634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bf1c5-5976-465a-a678-ab0f54bffadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:21.719597 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f10bf1c5-5976-465a-a678-ab0f54bffadb None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:21.720790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f10bf1c5-5976-465a-a678-ab0f54bffadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:21.722953 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650dd7f-dab7-4718-bff1-0127bc3bf182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:21.724046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650dd7f-dab7-4718-bff1-0127bc3bf182 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:21.724549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650dd7f-dab7-4718-bff1-0127bc3bf182 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:21.725038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650dd7f-dab7-4718-bff1-0127bc3bf182 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:21.797218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 112/219] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:21.811615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650dd7f-dab7-4718-bff1-0127bc3bf182 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:21.813139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650dd7f-dab7-4718-bff1-0127bc3bf182 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:21.815424 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bf1c5-5976-465a-a678-ab0f54bffadb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:21.923734 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bf1c5-5976-465a-a678-ab0f54bffadb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:21.947561 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 108/220] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:21.954909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650dd7f-dab7-4718-bff1-0127bc3bf182 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:21.960987 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713907df-2fa4-4d21-b23f-b4ee4b1e68ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:21.961821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713907df-2fa4-4d21-b23f-b4ee4b1e68ec None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:21.962104 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713907df-2fa4-4d21-b23f-b4ee4b1e68ec None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:21.962379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713907df-2fa4-4d21-b23f-b4ee4b1e68ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:21.973807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713907df-2fa4-4d21-b23f-b4ee4b1e68ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-713907df-2fa4-4d21-b23f-b4ee4b1e68ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:21.981578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:21.982470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:21.983822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:21.983822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:21.983822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:21.983822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:21.983822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:21.983822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:21.983822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:21.983822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:21.983822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:21.983822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:21.983822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:21.983822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:21.983822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 113/221] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:45:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:45:21.989634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713907df-2fa4-4d21-b23f-b4ee4b1e68ec None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:22.066178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650dd7f-dab7-4718-bff1-0127bc3bf182 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:22.138030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713907df-2fa4-4d21-b23f-b4ee4b1e68ec None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:22.139909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6088e-4eeb-4b1a-bc88-b1a20a7c4656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:22.141547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6088e-4eeb-4b1a-bc88-b1a20a7c4656 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:22.141547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6088e-4eeb-4b1a-bc88-b1a20a7c4656 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:22.141547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6088e-4eeb-4b1a-bc88-b1a20a7c4656 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:22.144697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6088e-4eeb-4b1a-bc88-b1a20a7c4656 None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:22.144697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6088e-4eeb-4b1a-bc88-b1a20a7c4656 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:22.146255 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 109/222] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:21 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:22.147611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e49c2d-5e2c-4704-bb5c-2d68f34bfd72 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:22.147902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e49c2d-5e2c-4704-bb5c-2d68f34bfd72 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:22.148180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e49c2d-5e2c-4704-bb5c-2d68f34bfd72 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:22.149413 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 110/223] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:22.152102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e49c2d-5e2c-4704-bb5c-2d68f34bfd72 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:22.178254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca4d9d-e099-4ebc-a63a-5972882ecb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:22.179691 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca4d9d-e099-4ebc-a63a-5972882ecb00 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:22.180207 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca4d9d-e099-4ebc-a63a-5972882ecb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:22.180911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca4d9d-e099-4ebc-a63a-5972882ecb00 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:22.182024 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca4d9d-e099-4ebc-a63a-5972882ecb00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:22.182577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca4d9d-e099-4ebc-a63a-5972882ecb00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:22.184663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca4d9d-e099-4ebc-a63a-5972882ecb00 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:22.196371 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 114/224] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:22.198131 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79496d68-d21e-4fdc-bb37-23be33ce8dbc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:22.198613 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79496d68-d21e-4fdc-bb37-23be33ce8dbc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:22.199071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79496d68-d21e-4fdc-bb37-23be33ce8dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:22.220098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-79496d68-d21e-4fdc-bb37-23be33ce8dbc None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:22.221853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-79496d68-d21e-4fdc-bb37-23be33ce8dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:22.261814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e49c2d-5e2c-4704-bb5c-2d68f34bfd72 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:22.298207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fccc4f-cb08-4334-b294-a11340521bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:22.298968 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fccc4f-cb08-4334-b294-a11340521bae None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:22.299380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fccc4f-cb08-4334-b294-a11340521bae None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:22.299662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fccc4f-cb08-4334-b294-a11340521bae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:22.300559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fccc4f-cb08-4334-b294-a11340521bae None admin] RBAC: Adding query filter params (role.id=a211713995b7409ca158916c665f73b6, scope.project.id=e4df84ef89b243829f2a079628e9e618, user.id=b3d0fed593f74c6d81eeceb04b01ea6e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:22.300989 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fccc4f-cb08-4334-b294-a11340521bae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:22.302606 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fccc4f-cb08-4334-b294-a11340521bae None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:22.306033 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 115/225] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:22.307174 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79496d68-d21e-4fdc-bb37-23be33ce8dbc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:22.321577 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 111/226] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:22 2022] GET /identity/v3/role_assignments?user.id=b3d0fed593f74c6d81eeceb04b01ea6e&scope.project.id=e4df84ef89b243829f2a079628e9e618&role.id=a211713995b7409ca158916c665f73b6 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:22.337571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fccc4f-cb08-4334-b294-a11340521bae None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:22.471958 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79496d68-d21e-4fdc-bb37-23be33ce8dbc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:22.526727 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fccc4f-cb08-4334-b294-a11340521bae None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:22.546692 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2602ee5-13b2-46af-84e5-501d98463d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:22.547641 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2602ee5-13b2-46af-84e5-501d98463d8e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:22.547927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2602ee5-13b2-46af-84e5-501d98463d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:22.548205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2602ee5-13b2-46af-84e5-501d98463d8e None admin] PATH_INFO: `/v3/users/a62a529073f64b36bc4b328a09b6895e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:22.549558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2602ee5-13b2-46af-84e5-501d98463d8e None admin] RBAC: Authorizing `identity:get_user(user_id=a62a529073f64b36bc4b328a09b6895e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:22.551034 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2602ee5-13b2-46af-84e5-501d98463d8e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:22.554418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 116/227] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:22 2022] GET /identity/v3/users/a62a529073f64b36bc4b328a09b6895e => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:22.561266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2602ee5-13b2-46af-84e5-501d98463d8e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:22.591589 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f2ba9-2823-4b95-a207-3b1fcffa1285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:22.593507 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f2ba9-2823-4b95-a207-3b1fcffa1285 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:22.594154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f2ba9-2823-4b95-a207-3b1fcffa1285 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:22.594944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f2ba9-2823-4b95-a207-3b1fcffa1285 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:22.612995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f2ba9-2823-4b95-a207-3b1fcffa1285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-838f2ba9-2823-4b95-a207-3b1fcffa1285 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:22.623922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:22.624852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:22.625673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:22.625673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:22.625673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:22.625673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:22.625673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:22.625673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:22.625673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:22.625673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:22.625673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:22.625673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:22.625673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:22.625673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:22.628662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 112/228] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:45:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:22.637004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f2ba9-2823-4b95-a207-3b1fcffa1285 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:22.725197 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2602ee5-13b2-46af-84e5-501d98463d8e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:22.793739 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef56ed9-e923-40f3-a9b7-2c8a24794d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:22.794610 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef56ed9-e923-40f3-a9b7-2c8a24794d43 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:22.794897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef56ed9-e923-40f3-a9b7-2c8a24794d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:22.795176 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef56ed9-e923-40f3-a9b7-2c8a24794d43 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:22.797085 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef56ed9-e923-40f3-a9b7-2c8a24794d43 None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:22.798584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef56ed9-e923-40f3-a9b7-2c8a24794d43 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:22.804849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 117/229] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:22 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:22.805660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef56ed9-e923-40f3-a9b7-2c8a24794d43 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:22.807087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f2ba9-2823-4b95-a207-3b1fcffa1285 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:22.875646 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444c36c-1479-4732-ad11-8a06d7708a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:22.876327 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444c36c-1479-4732-ad11-8a06d7708a8c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:22.876611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444c36c-1479-4732-ad11-8a06d7708a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:22.876891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444c36c-1479-4732-ad11-8a06d7708a8c None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:22.877674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444c36c-1479-4732-ad11-8a06d7708a8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:22.878272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444c36c-1479-4732-ad11-8a06d7708a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:22.879812 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444c36c-1479-4732-ad11-8a06d7708a8c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:22.899681 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 113/230] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:45:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:22.906344 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444c36c-1479-4732-ad11-8a06d7708a8c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:22.965409 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef56ed9-e923-40f3-a9b7-2c8a24794d43 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:23.006672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8be6f-c15e-4657-b201-1f67234c300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:23.008051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8be6f-c15e-4657-b201-1f67234c300f None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:23.008526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8be6f-c15e-4657-b201-1f67234c300f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:23.009097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8be6f-c15e-4657-b201-1f67234c300f None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618/users/a62a529073f64b36bc4b328a09b6895e/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:23.011582 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8be6f-c15e-4657-b201-1f67234c300f None admin] RBAC: Authorizing `identity:create_grant(project_id=e4df84ef89b243829f2a079628e9e618, user_id=a62a529073f64b36bc4b328a09b6895e, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:23.013652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8be6f-c15e-4657-b201-1f67234c300f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:23.070815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444c36c-1479-4732-ad11-8a06d7708a8c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:23.106260 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa2320-6092-476e-aee1-53cbc99653fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:23.107146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa2320-6092-476e-aee1-53cbc99653fc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:23.107436 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa2320-6092-476e-aee1-53cbc99653fc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:23.107712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa2320-6092-476e-aee1-53cbc99653fc None admin] PATH_INFO: `/v3/users/a62a529073f64b36bc4b328a09b6895e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:23.109596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa2320-6092-476e-aee1-53cbc99653fc None admin] RBAC: Authorizing `identity:get_user(user_id=a62a529073f64b36bc4b328a09b6895e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:23.120509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa2320-6092-476e-aee1-53cbc99653fc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:23.120509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 114/231] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:22 2022] GET /identity/v3/users/a62a529073f64b36bc4b328a09b6895e => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:23.120509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa2320-6092-476e-aee1-53cbc99653fc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:23.123608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 118/232] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:45:22 2022] PUT /identity/v3/projects/e4df84ef89b243829f2a079628e9e618/users/a62a529073f64b36bc4b328a09b6895e/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:23.244592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa2320-6092-476e-aee1-53cbc99653fc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:23.291414 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a807011-7f65-412a-89f6-338561aafc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:23.292310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a807011-7f65-412a-89f6-338561aafc25 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:23.292597 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a807011-7f65-412a-89f6-338561aafc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:23.292876 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a807011-7f65-412a-89f6-338561aafc25 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:23.294166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a807011-7f65-412a-89f6-338561aafc25 None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:23.296270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a807011-7f65-412a-89f6-338561aafc25 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:23.298067 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 115/233] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:23 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:23.306757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8be6f-c15e-4657-b201-1f67234c300f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:23.461042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8be6f-c15e-4657-b201-1f67234c300f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:23.499309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a3734-c709-48fa-942f-c672b32b21d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:23.500209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a3734-c709-48fa-942f-c672b32b21d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:23.500496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a3734-c709-48fa-942f-c672b32b21d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:23.500773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a3734-c709-48fa-942f-c672b32b21d6 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618/users/a62a529073f64b36bc4b328a09b6895e/roles/6437cf432fe44cc28aa54208759f1265` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:23.503599 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a3734-c709-48fa-942f-c672b32b21d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4df84ef89b243829f2a079628e9e618, user_id=a62a529073f64b36bc4b328a09b6895e, role_id=6437cf432fe44cc28aa54208759f1265)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:23.505054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a3734-c709-48fa-942f-c672b32b21d6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:23.647819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 119/234] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:45:23 2022] PUT /identity/v3/projects/e4df84ef89b243829f2a079628e9e618/users/a62a529073f64b36bc4b328a09b6895e/roles/6437cf432fe44cc28aa54208759f1265 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:24.148303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c34a9-e640-441e-924c-9625cc4c8e35 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:24.148303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c34a9-e640-441e-924c-9625cc4c8e35 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:24.148303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c34a9-e640-441e-924c-9625cc4c8e35 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:24.148303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 116/235] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:24.154505 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf05e34-3a08-49c5-8772-966ee0e4a340 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:24.155395 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf05e34-3a08-49c5-8772-966ee0e4a340 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:24.155878 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf05e34-3a08-49c5-8772-966ee0e4a340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:24.178490 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2cf05e34-3a08-49c5-8772-966ee0e4a340 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:24.180011 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2cf05e34-3a08-49c5-8772-966ee0e4a340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:24.255840 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 120/236] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:24.279410 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c34a9-e640-441e-924c-9625cc4c8e35 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:24.318324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa67241-2ebd-4d35-b60a-1919778cc255 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:24.318949 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa67241-2ebd-4d35-b60a-1919778cc255 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:24.319501 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa67241-2ebd-4d35-b60a-1919778cc255 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:24.321298 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 121/237] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:45:24.326616 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075a859-787b-4342-899c-0d1740e3764e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:24.327171 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075a859-787b-4342-899c-0d1740e3764e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:24.327679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075a859-787b-4342-899c-0d1740e3764e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:24.348619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1075a859-787b-4342-899c-0d1740e3764e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:24.350908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1075a859-787b-4342-899c-0d1740e3764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:24.451694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c34a9-e640-441e-924c-9625cc4c8e35 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:24.454472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 122/238] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:45:24.491368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075a859-787b-4342-899c-0d1740e3764e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:24.493074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40763a-0342-4caf-90f8-e8f8d1c2b3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:24.494126 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40763a-0342-4caf-90f8-e8f8d1c2b3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:24.494414 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40763a-0342-4caf-90f8-e8f8d1c2b3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:24.494695 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40763a-0342-4caf-90f8-e8f8d1c2b3a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:24.521210 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40763a-0342-4caf-90f8-e8f8d1c2b3a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-be40763a-0342-4caf-90f8-e8f8d1c2b3a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:24.529891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:24.530819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:24.531647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:24.531647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:24.531647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:24.531647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:24.531647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:24.531647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:24.531647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:24.531647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:24.531647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:24.531647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:24.531647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:24.531647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:24.532295 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 117/239] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:24.538587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40763a-0342-4caf-90f8-e8f8d1c2b3a9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:24.642519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40763a-0342-4caf-90f8-e8f8d1c2b3a9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:24.681822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96daa154-8dfd-45fe-a37c-2ecd7eec6ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:24.682495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daa154-8dfd-45fe-a37c-2ecd7eec6ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:24.682773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daa154-8dfd-45fe-a37c-2ecd7eec6ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:24.683043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96daa154-8dfd-45fe-a37c-2ecd7eec6ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:24.683788 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96daa154-8dfd-45fe-a37c-2ecd7eec6ce6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:24.684090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96daa154-8dfd-45fe-a37c-2ecd7eec6ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:24.685465 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96daa154-8dfd-45fe-a37c-2ecd7eec6ce6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:24.701408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 118/240] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:24.711144 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075a859-787b-4342-899c-0d1740e3764e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:24.719465 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96daa154-8dfd-45fe-a37c-2ecd7eec6ce6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:24.750024 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2bc64-8f97-43b8-a35f-a6f15d11f2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:24.751281 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2bc64-8f97-43b8-a35f-a6f15d11f2cd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:24.751794 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2bc64-8f97-43b8-a35f-a6f15d11f2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:24.752277 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2bc64-8f97-43b8-a35f-a6f15d11f2cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:24.753829 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2bc64-8f97-43b8-a35f-a6f15d11f2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:24.755658 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2bc64-8f97-43b8-a35f-a6f15d11f2cd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:24.757979 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 123/241] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:24.768006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2bc64-8f97-43b8-a35f-a6f15d11f2cd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:24.885561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2bc64-8f97-43b8-a35f-a6f15d11f2cd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:24.924997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022edb31-e57f-41d9-9f4c-bdca48812970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:24.926332 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022edb31-e57f-41d9-9f4c-bdca48812970 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:24.926850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022edb31-e57f-41d9-9f4c-bdca48812970 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:24.927331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022edb31-e57f-41d9-9f4c-bdca48812970 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:24.928447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022edb31-e57f-41d9-9f4c-bdca48812970 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:24.930179 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022edb31-e57f-41d9-9f4c-bdca48812970 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:24.980853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96daa154-8dfd-45fe-a37c-2ecd7eec6ce6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:25.013567 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1ac6e-b2db-4623-8180-7364e0650568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:25.014470 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1ac6e-b2db-4623-8180-7364e0650568 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:25.014751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1ac6e-b2db-4623-8180-7364e0650568 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:25.015028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1ac6e-b2db-4623-8180-7364e0650568 None admin] PATH_INFO: `/v3/users/de0e63889fbe45d987b145a98c6e598b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:25.028889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1ac6e-b2db-4623-8180-7364e0650568 None admin] RBAC: Authorizing `identity:get_user(user_id=de0e63889fbe45d987b145a98c6e598b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:25.030407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1ac6e-b2db-4623-8180-7364e0650568 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:25.031625 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 124/242] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:45:24 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:45:25.033425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ec905-a8ad-40fa-9b43-326ce73210ac None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:25.034001 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ec905-a8ad-40fa-9b43-326ce73210ac None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:25.034497 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ec905-a8ad-40fa-9b43-326ce73210ac None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:25.040300 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 119/244] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:24 2022] GET /identity/v3/users/de0e63889fbe45d987b145a98c6e598b => generated 297 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:25.040716 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 125/244] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:25.041956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1ac6e-b2db-4623-8180-7364e0650568 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:25.043235 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920528-2ae6-4700-82b4-1a5122853f55 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:25.043720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920528-2ae6-4700-82b4-1a5122853f55 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:25.044214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920528-2ae6-4700-82b4-1a5122853f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:25.072012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4a920528-2ae6-4700-82b4-1a5122853f55 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:25.076127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4a920528-2ae6-4700-82b4-1a5122853f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:25.159598 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 126/245] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:25.180494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a920528-2ae6-4700-82b4-1a5122853f55 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:25.240630 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1ac6e-b2db-4623-8180-7364e0650568 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:25.283272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7a2ff-77f8-49c4-b642-a9e5c0dd4f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:25.284359 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7a2ff-77f8-49c4-b642-a9e5c0dd4f38 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:25.284883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7a2ff-77f8-49c4-b642-a9e5c0dd4f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:25.285387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7a2ff-77f8-49c4-b642-a9e5c0dd4f38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:25.318537 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a920528-2ae6-4700-82b4-1a5122853f55 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:25.355038 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82399345-6f33-4686-b616-e2928b67d4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:25.355733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7a2ff-77f8-49c4-b642-a9e5c0dd4f38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:25.355841 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82399345-6f33-4686-b616-e2928b67d4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:25.356108 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82399345-6f33-4686-b616-e2928b67d4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:25.356387 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82399345-6f33-4686-b616-e2928b67d4c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:25.358807 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7a2ff-77f8-49c4-b642-a9e5c0dd4f38 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:25.367600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82399345-6f33-4686-b616-e2928b67d4c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-82399345-6f33-4686-b616-e2928b67d4c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:25.376587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:25.377775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:25.379070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:25.379070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:25.379070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:25.379070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:25.379070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:25.379070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:25.379070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:25.379070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:25.379070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:25.379070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:25.379070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:25.379070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:25.379070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 127/246] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:25.384235 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82399345-6f33-4686-b616-e2928b67d4c2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:25.463284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 120/247] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:25.469412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7a2ff-77f8-49c4-b642-a9e5c0dd4f38 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:25.492574 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82399345-6f33-4686-b616-e2928b67d4c2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:25.529410 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcd0b5-ce4b-4b26-9676-894cbfc75101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:25.530973 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcd0b5-ce4b-4b26-9676-894cbfc75101 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:25.531452 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcd0b5-ce4b-4b26-9676-894cbfc75101 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:25.531918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcd0b5-ce4b-4b26-9676-894cbfc75101 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:25.532892 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcd0b5-ce4b-4b26-9676-894cbfc75101 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:25.533391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcd0b5-ce4b-4b26-9676-894cbfc75101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:25.535004 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcd0b5-ce4b-4b26-9676-894cbfc75101 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:25.543590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 128/248] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:25.552624 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcd0b5-ce4b-4b26-9676-894cbfc75101 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:25.583598 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7a2ff-77f8-49c4-b642-a9e5c0dd4f38 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:25.618232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968286a-391b-4956-9793-a9dbf3ae2456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:25.619095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968286a-391b-4956-9793-a9dbf3ae2456 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:25.619380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968286a-391b-4956-9793-a9dbf3ae2456 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:25.619658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968286a-391b-4956-9793-a9dbf3ae2456 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:25.620854 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968286a-391b-4956-9793-a9dbf3ae2456 None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:25.622351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968286a-391b-4956-9793-a9dbf3ae2456 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:25.624378 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 121/249] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:25 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:25.630692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968286a-391b-4956-9793-a9dbf3ae2456 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:25.665920 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcd0b5-ce4b-4b26-9676-894cbfc75101 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:25.700861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bccf85-af95-4c10-b186-68ad0c28574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:25.702158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bccf85-af95-4c10-b186-68ad0c28574b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:25.702592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bccf85-af95-4c10-b186-68ad0c28574b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:25.704862 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bccf85-af95-4c10-b186-68ad0c28574b None admin] PATH_INFO: `/v3/users/b3d0fed593f74c6d81eeceb04b01ea6e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:25.706918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bccf85-af95-4c10-b186-68ad0c28574b None admin] RBAC: Authorizing `identity:get_user(user_id=b3d0fed593f74c6d81eeceb04b01ea6e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:25.709487 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bccf85-af95-4c10-b186-68ad0c28574b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:25.711652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 129/250] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:25 2022] GET /identity/v3/users/b3d0fed593f74c6d81eeceb04b01ea6e => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:25.720442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bccf85-af95-4c10-b186-68ad0c28574b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:25.747246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968286a-391b-4956-9793-a9dbf3ae2456 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:25.783884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a8237-3ef6-400a-99a9-889f125e4399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:25.784922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a8237-3ef6-400a-99a9-889f125e4399 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:25.785398 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a8237-3ef6-400a-99a9-889f125e4399 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:25.785887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a8237-3ef6-400a-99a9-889f125e4399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:25.786916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a8237-3ef6-400a-99a9-889f125e4399 None admin] RBAC: Adding query filter params (role.id=12cfd45464bc4f27ba33f6b1038f3d31, scope.project.id=e4df84ef89b243829f2a079628e9e618, user.id=de0e63889fbe45d987b145a98c6e598b) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:25.787438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a8237-3ef6-400a-99a9-889f125e4399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:25.789239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a8237-3ef6-400a-99a9-889f125e4399 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:25.795731 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 122/251] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:25 2022] GET /identity/v3/role_assignments?user.id=de0e63889fbe45d987b145a98c6e598b&scope.project.id=e4df84ef89b243829f2a079628e9e618&role.id=12cfd45464bc4f27ba33f6b1038f3d31 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:25.849183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bccf85-af95-4c10-b186-68ad0c28574b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:25.890510 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89024e-b919-41e8-9d7a-943a725f115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:25.891824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89024e-b919-41e8-9d7a-943a725f115f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:25.892315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89024e-b919-41e8-9d7a-943a725f115f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:25.892781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89024e-b919-41e8-9d7a-943a725f115f None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:25.894614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89024e-b919-41e8-9d7a-943a725f115f None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:25.896409 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89024e-b919-41e8-9d7a-943a725f115f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:25.899014 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 130/252] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:25 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:25.906663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a8237-3ef6-400a-99a9-889f125e4399 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:26.023814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a8237-3ef6-400a-99a9-889f125e4399 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:26.059393 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c7430-9bb2-46cd-ac77-0cb334b9b17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:26.060706 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c7430-9bb2-46cd-ac77-0cb334b9b17e None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:26.061226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c7430-9bb2-46cd-ac77-0cb334b9b17e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:26.061736 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c7430-9bb2-46cd-ac77-0cb334b9b17e None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618/users/b3d0fed593f74c6d81eeceb04b01ea6e/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:26.064098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c7430-9bb2-46cd-ac77-0cb334b9b17e None admin] RBAC: Authorizing `identity:create_grant(project_id=e4df84ef89b243829f2a079628e9e618, user_id=b3d0fed593f74c6d81eeceb04b01ea6e, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:26.065864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c7430-9bb2-46cd-ac77-0cb334b9b17e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:26.070388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577ae0c-f324-465e-812c-518dc990d8e5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:26.071396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577ae0c-f324-465e-812c-518dc990d8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:26.072142 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577ae0c-f324-465e-812c-518dc990d8e5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:26.074391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 131/253] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:26.083152 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551547de-5adb-4660-804b-40ba3547cf87 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:26.091007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551547de-5adb-4660-804b-40ba3547cf87 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:26.091007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551547de-5adb-4660-804b-40ba3547cf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:26.112594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-551547de-5adb-4660-804b-40ba3547cf87 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:26.114173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-551547de-5adb-4660-804b-40ba3547cf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:26.160941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 123/254] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:45:25 2022] PUT /identity/v3/projects/e4df84ef89b243829f2a079628e9e618/users/b3d0fed593f74c6d81eeceb04b01ea6e/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:26.208887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 132/255] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:26.244237 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c7430-9bb2-46cd-ac77-0cb334b9b17e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:26.384648 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c7430-9bb2-46cd-ac77-0cb334b9b17e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:26.422363 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0d296-beb1-4b90-a609-2faee02624e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:26.423168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0d296-beb1-4b90-a609-2faee02624e5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:26.423451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0d296-beb1-4b90-a609-2faee02624e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:26.423727 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0d296-beb1-4b90-a609-2faee02624e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:26.436317 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0d296-beb1-4b90-a609-2faee02624e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d1b0d296-beb1-4b90-a609-2faee02624e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:26.444419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:26.445319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:26.446217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:26.446217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:26.446217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:26.446217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:26.446217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:26.446217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:26.446217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:26.446217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:26.446217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:26.446217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:26.446217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:26.446217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:26.448340 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 124/256] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:45:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:26.454412 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551547de-5adb-4660-804b-40ba3547cf87 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:26.549886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fc948-194f-4584-aaba-80870f2cbbed None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:26.550399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fc948-194f-4584-aaba-80870f2cbbed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:26.550818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fc948-194f-4584-aaba-80870f2cbbed None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:26.552319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 125/257] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:45:26.563334 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551547de-5adb-4660-804b-40ba3547cf87 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:26.566831 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c230dc-7384-496c-9c4d-aaad69ccfe96 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:26.567118 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c230dc-7384-496c-9c4d-aaad69ccfe96 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:26.567397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c230dc-7384-496c-9c4d-aaad69ccfe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:26.599163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab87597-dabf-4a25-b94f-e1d1629f9916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:26.600175 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab87597-dabf-4a25-b94f-e1d1629f9916 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:26.600594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab87597-dabf-4a25-b94f-e1d1629f9916 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:26.601005 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab87597-dabf-4a25-b94f-e1d1629f9916 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:26.601964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab87597-dabf-4a25-b94f-e1d1629f9916 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:26.602476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab87597-dabf-4a25-b94f-e1d1629f9916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:26.603980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab87597-dabf-4a25-b94f-e1d1629f9916 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:26.606544 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c3c230dc-7384-496c-9c4d-aaad69ccfe96 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:26.607785 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c3c230dc-7384-496c-9c4d-aaad69ccfe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:26.613056 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 133/258] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:26.618760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab87597-dabf-4a25-b94f-e1d1629f9916 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:26.714574 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 126/259] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:26.720661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab87597-dabf-4a25-b94f-e1d1629f9916 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:26.749738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c230dc-7384-496c-9c4d-aaad69ccfe96 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:26.754594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8f970-345c-4899-889e-e2ad06f821df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:26.755714 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8f970-345c-4899-889e-e2ad06f821df None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:26.756139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8f970-345c-4899-889e-e2ad06f821df None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:26.756552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8f970-345c-4899-889e-e2ad06f821df None admin] PATH_INFO: `/v3/users/a62a529073f64b36bc4b328a09b6895e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:26.757961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8f970-345c-4899-889e-e2ad06f821df None admin] RBAC: Authorizing `identity:get_user(user_id=a62a529073f64b36bc4b328a09b6895e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:26.759562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8f970-345c-4899-889e-e2ad06f821df None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:26.764568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 134/260] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:26 2022] GET /identity/v3/users/a62a529073f64b36bc4b328a09b6895e => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:26.770423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8f970-345c-4899-889e-e2ad06f821df None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:26.885135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8f970-345c-4899-889e-e2ad06f821df None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:26.919580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd62a20-0b2c-442e-bd53-a5a77e4dd42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:26.920638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd62a20-0b2c-442e-bd53-a5a77e4dd42d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:26.921064 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd62a20-0b2c-442e-bd53-a5a77e4dd42d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:26.921506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd62a20-0b2c-442e-bd53-a5a77e4dd42d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:26.931661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c230dc-7384-496c-9c4d-aaad69ccfe96 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:27.031113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c4730-dea7-4e80-b7de-8d3dd6eb974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:27.031934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4730-dea7-4e80-b7de-8d3dd6eb974d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:27.032219 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4730-dea7-4e80-b7de-8d3dd6eb974d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:27.032497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4730-dea7-4e80-b7de-8d3dd6eb974d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:27.050586 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd62a20-0b2c-442e-bd53-a5a77e4dd42d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:27.052110 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd62a20-0b2c-442e-bd53-a5a77e4dd42d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:27.062381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c4730-dea7-4e80-b7de-8d3dd6eb974d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b73c4730-dea7-4e80-b7de-8d3dd6eb974d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:27.070495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:27.071387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:27.072180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:27.072180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:27.072180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:27.072180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:27.072180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:27.072180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:27.072180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:27.072180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:27.072180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:27.072180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:27.072180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:27.072180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:27.077948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 127/261] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:45:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:45:27.083398 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c4730-dea7-4e80-b7de-8d3dd6eb974d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:27.269587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c4730-dea7-4e80-b7de-8d3dd6eb974d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:27.276306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 135/262] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:27.287413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd62a20-0b2c-442e-bd53-a5a77e4dd42d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:27.325035 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6762ec-38d0-416b-9736-7c8417614593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:27.325734 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6762ec-38d0-416b-9736-7c8417614593 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:27.326024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6762ec-38d0-416b-9736-7c8417614593 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:27.326309 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6762ec-38d0-416b-9736-7c8417614593 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:27.327105 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6762ec-38d0-416b-9736-7c8417614593 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:27.327417 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6762ec-38d0-416b-9736-7c8417614593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:27.328920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6762ec-38d0-416b-9736-7c8417614593 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:27.344249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 128/263] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:45:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:27.349641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6762ec-38d0-416b-9736-7c8417614593 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:27.496957 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd62a20-0b2c-442e-bd53-a5a77e4dd42d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:27.562323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be1303-b60d-4f51-8dae-fbfead5d0db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:27.563114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be1303-b60d-4f51-8dae-fbfead5d0db3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:27.563395 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be1303-b60d-4f51-8dae-fbfead5d0db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:27.563668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be1303-b60d-4f51-8dae-fbfead5d0db3 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:27.565570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be1303-b60d-4f51-8dae-fbfead5d0db3 None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:27.566379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be1303-b60d-4f51-8dae-fbfead5d0db3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:27.568061 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 136/264] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:27 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:27.576532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be1303-b60d-4f51-8dae-fbfead5d0db3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:27.583611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6762ec-38d0-416b-9736-7c8417614593 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:27.658052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55848e24-ab3a-4c95-9e99-5e8a9790dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:27.659289 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848e24-ab3a-4c95-9e99-5e8a9790dd14 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:27.659793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848e24-ab3a-4c95-9e99-5e8a9790dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:27.660262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848e24-ab3a-4c95-9e99-5e8a9790dd14 None admin] PATH_INFO: `/v3/users/a62a529073f64b36bc4b328a09b6895e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:27.666250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55848e24-ab3a-4c95-9e99-5e8a9790dd14 None admin] RBAC: Authorizing `identity:get_user(user_id=a62a529073f64b36bc4b328a09b6895e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:27.667977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55848e24-ab3a-4c95-9e99-5e8a9790dd14 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:27.670782 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 129/265] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:27 2022] GET /identity/v3/users/a62a529073f64b36bc4b328a09b6895e => generated 283 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:27.678529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55848e24-ab3a-4c95-9e99-5e8a9790dd14 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:27.729195 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be1303-b60d-4f51-8dae-fbfead5d0db3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:27.797908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3643a-d836-4723-88b3-f2819e6559f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:27.799115 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3643a-d836-4723-88b3-f2819e6559f7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:27.799406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3643a-d836-4723-88b3-f2819e6559f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:27.799684 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3643a-d836-4723-88b3-f2819e6559f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:27.800656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3643a-d836-4723-88b3-f2819e6559f7 None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=e4df84ef89b243829f2a079628e9e618, user.id=a62a529073f64b36bc4b328a09b6895e) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:27.800972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3643a-d836-4723-88b3-f2819e6559f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:27.802451 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3643a-d836-4723-88b3-f2819e6559f7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:27.821048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 137/266] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:27 2022] GET /identity/v3/role_assignments?user.id=a62a529073f64b36bc4b328a09b6895e&scope.project.id=e4df84ef89b243829f2a079628e9e618&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:27.877668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55848e24-ab3a-4c95-9e99-5e8a9790dd14 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:27.923340 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e69478-9519-47b1-8d2b-621800cf7f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:27.924050 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e69478-9519-47b1-8d2b-621800cf7f04 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:27.924338 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e69478-9519-47b1-8d2b-621800cf7f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:27.924613 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e69478-9519-47b1-8d2b-621800cf7f04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:28.006553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e69478-9519-47b1-8d2b-621800cf7f04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:28.008082 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e69478-9519-47b1-8d2b-621800cf7f04 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:28.127811 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 130/267] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:28.132970 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3643a-d836-4723-88b3-f2819e6559f7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:28.272766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3643a-d836-4723-88b3-f2819e6559f7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:28.310825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e84a52-0c1d-4904-971a-6b2a54737b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:28.311701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e84a52-0c1d-4904-971a-6b2a54737b3a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:28.311985 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e84a52-0c1d-4904-971a-6b2a54737b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:28.312260 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e84a52-0c1d-4904-971a-6b2a54737b3a None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:28.313444 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e84a52-0c1d-4904-971a-6b2a54737b3a None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:28.314932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e84a52-0c1d-4904-971a-6b2a54737b3a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:28.317592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 138/268] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:28 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:28.322341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e69478-9519-47b1-8d2b-621800cf7f04 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:28.429158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e69478-9519-47b1-8d2b-621800cf7f04 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:28.471543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f631d-527e-409c-864d-65ac4a0b61eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:28.472553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f631d-527e-409c-864d-65ac4a0b61eb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:28.473031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f631d-527e-409c-864d-65ac4a0b61eb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:28.473611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f631d-527e-409c-864d-65ac4a0b61eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:28.474664 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f631d-527e-409c-864d-65ac4a0b61eb None admin] RBAC: Adding query filter params (role.id=6437cf432fe44cc28aa54208759f1265, scope.project.id=e4df84ef89b243829f2a079628e9e618, user.id=a62a529073f64b36bc4b328a09b6895e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:28.475173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f631d-527e-409c-864d-65ac4a0b61eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:28.476798 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f631d-527e-409c-864d-65ac4a0b61eb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:28.486550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 131/269] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:28 2022] GET /identity/v3/role_assignments?user.id=a62a529073f64b36bc4b328a09b6895e&scope.project.id=e4df84ef89b243829f2a079628e9e618&role.id=6437cf432fe44cc28aa54208759f1265 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:28.804060 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98502a-4c16-4b3e-b9e7-87ec0bf42631 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:28.804461 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98502a-4c16-4b3e-b9e7-87ec0bf42631 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:28.804655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98502a-4c16-4b3e-b9e7-87ec0bf42631 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:28.805946 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade155f5-013d-4d98-87eb-8c8161d980d5 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:28.806425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 139/270] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:28.806906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade155f5-013d-4d98-87eb-8c8161d980d5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:28.807491 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade155f5-013d-4d98-87eb-8c8161d980d5 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:28.809140 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 132/271] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:45:28.812732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c481-ac0c-48b7-93d7-03bddd16fd37 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:28.812994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c481-ac0c-48b7-93d7-03bddd16fd37 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:28.813269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c481-ac0c-48b7-93d7-03bddd16fd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:28.825994 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1acb9-fb6e-467f-87d5-41d869041ebe None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:28.827432 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1acb9-fb6e-467f-87d5-41d869041ebe None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:28.827717 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1acb9-fb6e-467f-87d5-41d869041ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:28.840212 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e8a0c481-ac0c-48b7-93d7-03bddd16fd37 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:28.841416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e8a0c481-ac0c-48b7-93d7-03bddd16fd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:28.870058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cba1acb9-fb6e-467f-87d5-41d869041ebe None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:28.871274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cba1acb9-fb6e-467f-87d5-41d869041ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:28.933595 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 140/272] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:45:28.957750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 133/273] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:28.958442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0c481-ac0c-48b7-93d7-03bddd16fd37 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:28.981115 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1acb9-fb6e-467f-87d5-41d869041ebe None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:29.065306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0c481-ac0c-48b7-93d7-03bddd16fd37 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:29.094027 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1acb9-fb6e-467f-87d5-41d869041ebe None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:29.099578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3fd9d-68f1-4e1b-944b-6d79216f54b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:29.100385 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3fd9d-68f1-4e1b-944b-6d79216f54b7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:29.100667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3fd9d-68f1-4e1b-944b-6d79216f54b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:29.100940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3fd9d-68f1-4e1b-944b-6d79216f54b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:29.112030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3fd9d-68f1-4e1b-944b-6d79216f54b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e1e3fd9d-68f1-4e1b-944b-6d79216f54b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:29.119863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:29.120801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:29.121896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:29.121896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:29.121896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:29.121896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:29.121896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:29.121896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:29.121896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:29.121896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:29.121896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:29.121896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:29.121896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:29.121896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:29.121896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 141/274] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:45:29.128637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3fd9d-68f1-4e1b-944b-6d79216f54b7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:29.138457 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4a2b5-71de-46ef-9b31-d9672d8435b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:29.139824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4a2b5-71de-46ef-9b31-d9672d8435b1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:29.140335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4a2b5-71de-46ef-9b31-d9672d8435b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:29.140821 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4a2b5-71de-46ef-9b31-d9672d8435b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:29.142288 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4a2b5-71de-46ef-9b31-d9672d8435b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:29.144019 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4a2b5-71de-46ef-9b31-d9672d8435b1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:29.146750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 134/275] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:29.153489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4a2b5-71de-46ef-9b31-d9672d8435b1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:29.254715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3fd9d-68f1-4e1b-944b-6d79216f54b7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:29.263879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4a2b5-71de-46ef-9b31-d9672d8435b1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:29.289458 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcee795-ba94-4e49-baac-414c4770b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:29.290396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcee795-ba94-4e49-baac-414c4770b141 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:29.290838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcee795-ba94-4e49-baac-414c4770b141 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:29.291261 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcee795-ba94-4e49-baac-414c4770b141 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:29.292147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcee795-ba94-4e49-baac-414c4770b141 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:29.292596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcee795-ba94-4e49-baac-414c4770b141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:29.294174 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcee795-ba94-4e49-baac-414c4770b141 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:29.302801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac89db-b7f8-47b1-8600-de4c19a53241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:29.303483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac89db-b7f8-47b1-8600-de4c19a53241 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:29.303768 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac89db-b7f8-47b1-8600-de4c19a53241 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:29.305641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac89db-b7f8-47b1-8600-de4c19a53241 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:29.305641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac89db-b7f8-47b1-8600-de4c19a53241 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:29.306280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac89db-b7f8-47b1-8600-de4c19a53241 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:29.308351 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 142/276] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:29.309492 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a1951-9e64-46dc-b007-b5b0b9d94ba5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:29.309816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a1951-9e64-46dc-b007-b5b0b9d94ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:29.310097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a1951-9e64-46dc-b007-b5b0b9d94ba5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:29.311579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 143/277] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:29.312106 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a1951-9e64-46dc-b007-b5b0b9d94ba5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:29.399004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 135/278] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:45:29 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 20:45:29.400556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6c8ea-2f20-411d-aac2-8937dd549b6e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:29.401053 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6c8ea-2f20-411d-aac2-8937dd549b6e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:29.401157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6c8ea-2f20-411d-aac2-8937dd549b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:29.412557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a1951-9e64-46dc-b007-b5b0b9d94ba5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:29.425069 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-67f6c8ea-2f20-411d-aac2-8937dd549b6e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:29.426354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-67f6c8ea-2f20-411d-aac2-8937dd549b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:29.450692 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1a77d-a0a3-4f55-9717-724e018e4fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:29.451605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1a77d-a0a3-4f55-9717-724e018e4fab None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:29.451887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1a77d-a0a3-4f55-9717-724e018e4fab None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:29.452158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1a77d-a0a3-4f55-9717-724e018e4fab None admin] PATH_INFO: `/v3/users/760374d0f2124a6dbb48abe6ad4149cb` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:29.468065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1a77d-a0a3-4f55-9717-724e018e4fab None admin] RBAC: Authorizing `identity:get_user(user_id=760374d0f2124a6dbb48abe6ad4149cb)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:29.469726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1a77d-a0a3-4f55-9717-724e018e4fab None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:29.471551 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 144/279] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:29 2022] GET /identity/v3/users/760374d0f2124a6dbb48abe6ad4149cb => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:29.477769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e98bf-a46c-42bd-b3af-65ad95da4067 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:29.478086 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e98bf-a46c-42bd-b3af-65ad95da4067 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:29.478338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e98bf-a46c-42bd-b3af-65ad95da4067 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:29.481581 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 145/280] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:29.481581 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e98bf-a46c-42bd-b3af-65ad95da4067 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:29.513564 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 136/281] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:29.513564 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2934e1-d378-4ffb-a508-00e69b5c2abe None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:29.513564 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2934e1-d378-4ffb-a508-00e69b5c2abe None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:29.513564 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2934e1-d378-4ffb-a508-00e69b5c2abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:29.532727 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ef2934e1-d378-4ffb-a508-00e69b5c2abe None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:29.534039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ef2934e1-d378-4ffb-a508-00e69b5c2abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:29.590142 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e98bf-a46c-42bd-b3af-65ad95da4067 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:29.610446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 137/282] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:29.611461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2934e1-d378-4ffb-a508-00e69b5c2abe None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:29.624923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f96ee-e5d9-4450-a4af-5d5bf1ed0eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:29.625600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f96ee-e5d9-4450-a4af-5d5bf1ed0eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:29.626562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f96ee-e5d9-4450-a4af-5d5bf1ed0eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:29.626562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f96ee-e5d9-4450-a4af-5d5bf1ed0eb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:29.626989 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f96ee-e5d9-4450-a4af-5d5bf1ed0eb9 None admin] RBAC: Adding query filter params (role.id=a211713995b7409ca158916c665f73b6, user.id=760374d0f2124a6dbb48abe6ad4149cb, scope.system=all) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:29.627304 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f96ee-e5d9-4450-a4af-5d5bf1ed0eb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:29.628751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f96ee-e5d9-4450-a4af-5d5bf1ed0eb9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:29.633887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 146/283] 10.222.0.35 () {56 vars in 1308 bytes} [Wed May 11 20:45:29 2022] GET /identity/v3/role_assignments?user.id=760374d0f2124a6dbb48abe6ad4149cb&scope.system=all&role.id=a211713995b7409ca158916c665f73b6 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:29.634650 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f96ee-e5d9-4450-a4af-5d5bf1ed0eb9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:29.726889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2934e1-d378-4ffb-a508-00e69b5c2abe None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:29.748733 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f96ee-e5d9-4450-a4af-5d5bf1ed0eb9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:29.765669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1374c-1558-42df-a19d-7d6c262dd50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:29.766489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1374c-1558-42df-a19d-7d6c262dd50e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:29.766772 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1374c-1558-42df-a19d-7d6c262dd50e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:29.767048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1374c-1558-42df-a19d-7d6c262dd50e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:29.779042 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1374c-1558-42df-a19d-7d6c262dd50e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a7d1374c-1558-42df-a19d-7d6c262dd50e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:29.787671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:29.788653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:29.789469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:29.789469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:29.789469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:29.789469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:29.789469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:29.789469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:29.789469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:29.789469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:29.789469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:29.789469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:29.789469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:29.789469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:29.790154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd638422-1507-4d8e-b079-9bbfa27f7031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:29.790154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd638422-1507-4d8e-b079-9bbfa27f7031 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:29.790306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 138/284] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:29.790373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd638422-1507-4d8e-b079-9bbfa27f7031 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:29.790373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd638422-1507-4d8e-b079-9bbfa27f7031 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:29.795236 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1374c-1558-42df-a19d-7d6c262dd50e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:29.802102 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd638422-1507-4d8e-b079-9bbfa27f7031 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-cd638422-1507-4d8e-b079-9bbfa27f7031 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:29.810440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:29.811465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:29.813344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:29.813344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:29.813344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:29.813344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:29.813344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:29.813344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:29.813344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:29.813344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:29.813344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:29.813344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:29.813344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:29.813344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:29.813344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 147/285] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:29.819691 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd638422-1507-4d8e-b079-9bbfa27f7031 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:29.916937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1374c-1558-42df-a19d-7d6c262dd50e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:29.946697 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd638422-1507-4d8e-b079-9bbfa27f7031 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:29.951010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a874ad-9309-403d-8f55-0671174b9b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:29.951675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a874ad-9309-403d-8f55-0671174b9b28 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:29.951957 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a874ad-9309-403d-8f55-0671174b9b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:29.952231 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a874ad-9309-403d-8f55-0671174b9b28 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:29.952967 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a874ad-9309-403d-8f55-0671174b9b28 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:29.953272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a874ad-9309-403d-8f55-0671174b9b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:29.957221 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a874ad-9309-403d-8f55-0671174b9b28 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:29.964823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 139/286] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:29.972501 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a874ad-9309-403d-8f55-0671174b9b28 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:29.985725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa11d90-e32d-4d91-b962-599cadbfab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:29.987147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa11d90-e32d-4d91-b962-599cadbfab30 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:29.992368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa11d90-e32d-4d91-b962-599cadbfab30 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:29.992506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa11d90-e32d-4d91-b962-599cadbfab30 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:29.993238 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa11d90-e32d-4d91-b962-599cadbfab30 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:29.993564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa11d90-e32d-4d91-b962-599cadbfab30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:29.994964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa11d90-e32d-4d91-b962-599cadbfab30 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:30.003751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 148/287] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:30.009145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa11d90-e32d-4d91-b962-599cadbfab30 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:30.137968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa11d90-e32d-4d91-b962-599cadbfab30 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:30.172268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f980d-c6d1-47f3-aa24-38a9ce8687eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:30.173144 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f980d-c6d1-47f3-aa24-38a9ce8687eb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:30.173426 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f980d-c6d1-47f3-aa24-38a9ce8687eb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:30.173735 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f980d-c6d1-47f3-aa24-38a9ce8687eb None admin] PATH_INFO: `/v3/users/b3d0fed593f74c6d81eeceb04b01ea6e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:30.174928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f980d-c6d1-47f3-aa24-38a9ce8687eb None admin] RBAC: Authorizing `identity:get_user(user_id=b3d0fed593f74c6d81eeceb04b01ea6e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:30.176383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f980d-c6d1-47f3-aa24-38a9ce8687eb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:30.178348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 149/288] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:30 2022] GET /identity/v3/users/b3d0fed593f74c6d81eeceb04b01ea6e => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:30.183425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f980d-c6d1-47f3-aa24-38a9ce8687eb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:30.192454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a874ad-9309-403d-8f55-0671174b9b28 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:30.257696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6c8ed-7da2-4bd5-8645-370f153ce28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:30.258496 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6c8ed-7da2-4bd5-8645-370f153ce28b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:30.258777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6c8ed-7da2-4bd5-8645-370f153ce28b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:30.259052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6c8ed-7da2-4bd5-8645-370f153ce28b None admin] PATH_INFO: `/v3/users/de0e63889fbe45d987b145a98c6e598b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:30.260266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6c8ed-7da2-4bd5-8645-370f153ce28b None admin] RBAC: Authorizing `identity:get_user(user_id=de0e63889fbe45d987b145a98c6e598b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:30.261742 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6c8ed-7da2-4bd5-8645-370f153ce28b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:30.263668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 140/289] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:29 2022] GET /identity/v3/users/de0e63889fbe45d987b145a98c6e598b => generated 297 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:30.281457 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6c8ed-7da2-4bd5-8645-370f153ce28b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:30.301199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f980d-c6d1-47f3-aa24-38a9ce8687eb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:30.377626 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4cad0-ab49-49eb-844c-805eef7295f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:30.378293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4cad0-ab49-49eb-844c-805eef7295f1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:30.378559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4cad0-ab49-49eb-844c-805eef7295f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:30.379005 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4cad0-ab49-49eb-844c-805eef7295f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:30.395754 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6c8ed-7da2-4bd5-8645-370f153ce28b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:30.439275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013e91d-0e6f-4234-bc14-fc3ad8261d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:30.440960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013e91d-0e6f-4234-bc14-fc3ad8261d78 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:30.441549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013e91d-0e6f-4234-bc14-fc3ad8261d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:30.442300 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013e91d-0e6f-4234-bc14-fc3ad8261d78 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:30.443859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013e91d-0e6f-4234-bc14-fc3ad8261d78 None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:30.446280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013e91d-0e6f-4234-bc14-fc3ad8261d78 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:30.449226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 141/290] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:30 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:30.461332 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013e91d-0e6f-4234-bc14-fc3ad8261d78 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:30.462753 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4cad0-ab49-49eb-844c-805eef7295f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:30.466564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4cad0-ab49-49eb-844c-805eef7295f1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:30.645916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 150/291] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 20:45:30.647738 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4cad0-ab49-49eb-844c-805eef7295f1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:30.654795 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013e91d-0e6f-4234-bc14-fc3ad8261d78 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:30.746072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4cad0-ab49-49eb-844c-805eef7295f1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:30.746274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75024e8f-51cb-402d-ae2a-89a481ceca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:30.747083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75024e8f-51cb-402d-ae2a-89a481ceca3a None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:30.747366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75024e8f-51cb-402d-ae2a-89a481ceca3a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:30.747643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75024e8f-51cb-402d-ae2a-89a481ceca3a None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618/users/de0e63889fbe45d987b145a98c6e598b/roles/12cfd45464bc4f27ba33f6b1038f3d31` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:30.754310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75024e8f-51cb-402d-ae2a-89a481ceca3a None admin] RBAC: Authorizing `identity:create_grant(project_id=e4df84ef89b243829f2a079628e9e618, user_id=de0e63889fbe45d987b145a98c6e598b, role_id=12cfd45464bc4f27ba33f6b1038f3d31)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:30.755762 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75024e8f-51cb-402d-ae2a-89a481ceca3a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:30.781183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07803176-f60c-4c61-bed0-decc4259f224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:30.782119 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07803176-f60c-4c61-bed0-decc4259f224 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:30.782409 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07803176-f60c-4c61-bed0-decc4259f224 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:30.782718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07803176-f60c-4c61-bed0-decc4259f224 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:30.783872 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07803176-f60c-4c61-bed0-decc4259f224 None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:30.785304 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07803176-f60c-4c61-bed0-decc4259f224 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:30.791911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 151/292] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:30 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:30.793100 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07803176-f60c-4c61-bed0-decc4259f224 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:30.884039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 142/293] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:45:30 2022] PUT /identity/v3/projects/e4df84ef89b243829f2a079628e9e618/users/de0e63889fbe45d987b145a98c6e598b/roles/12cfd45464bc4f27ba33f6b1038f3d31 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 20:45:30.914959 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07803176-f60c-4c61-bed0-decc4259f224 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:30.958552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1c0ff-cc11-4205-9031-e945b2d075bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:30.959283 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c0ff-cc11-4205-9031-e945b2d075bb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:30.959575 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c0ff-cc11-4205-9031-e945b2d075bb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:30.959851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1c0ff-cc11-4205-9031-e945b2d075bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:30.960765 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c0ff-cc11-4205-9031-e945b2d075bb None admin] RBAC: Adding query filter params (role.id=a211713995b7409ca158916c665f73b6, scope.project.id=e4df84ef89b243829f2a079628e9e618, user.id=b3d0fed593f74c6d81eeceb04b01ea6e) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:30.961091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c0ff-cc11-4205-9031-e945b2d075bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:30.962639 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1c0ff-cc11-4205-9031-e945b2d075bb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:30.972874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 152/294] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:30 2022] GET /identity/v3/role_assignments?user.id=b3d0fed593f74c6d81eeceb04b01ea6e&scope.project.id=e4df84ef89b243829f2a079628e9e618&role.id=a211713995b7409ca158916c665f73b6 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:32.049635 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918096ed-f663-4a13-acd0-3addb03fbb50 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:32.050333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918096ed-f663-4a13-acd0-3addb03fbb50 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:32.050333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918096ed-f663-4a13-acd0-3addb03fbb50 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:32.051790 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 143/295] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:32.057190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a2f01-30e9-4deb-8115-d48111d2f1ec None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:32.057709 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a2f01-30e9-4deb-8115-d48111d2f1ec None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:32.057884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a2f01-30e9-4deb-8115-d48111d2f1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:32.074233 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-be4a2f01-30e9-4deb-8115-d48111d2f1ec None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:32.075403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-be4a2f01-30e9-4deb-8115-d48111d2f1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:32.147251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 153/296] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:32.154358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc37d8-138e-45aa-bf39-9d0397574b32 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:32.154646 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc37d8-138e-45aa-bf39-9d0397574b32 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:32.154926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc37d8-138e-45aa-bf39-9d0397574b32 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:32.156520 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 144/297] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:32.161435 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8417468-236d-48c8-bfae-60996bbd106a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:32.161755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8417468-236d-48c8-bfae-60996bbd106a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:32.162042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8417468-236d-48c8-bfae-60996bbd106a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:32.170185 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc37d8-138e-45aa-bf39-9d0397574b32 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:32.182179 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d8417468-236d-48c8-bfae-60996bbd106a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:32.183355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d8417468-236d-48c8-bfae-60996bbd106a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:32.251130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 154/298] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:32.252298 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d469ecc-187f-4629-ade2-0d140e9b0fb2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:32.252588 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d469ecc-187f-4629-ade2-0d140e9b0fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:32.252869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d469ecc-187f-4629-ade2-0d140e9b0fb2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:32.254285 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 155/299] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:32.259524 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8c73-c114-4598-82e1-e7d602abaab9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:32.259820 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8c73-c114-4598-82e1-e7d602abaab9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:32.260099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8c73-c114-4598-82e1-e7d602abaab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:32.286212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc37d8-138e-45aa-bf39-9d0397574b32 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:32.286405 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9c2d8c73-c114-4598-82e1-e7d602abaab9 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:32.287379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9c2d8c73-c114-4598-82e1-e7d602abaab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:32.319453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad4504-da4e-4b06-aaf8-6ab596e9ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:32.320416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad4504-da4e-4b06-aaf8-6ab596e9ca0e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:32.320724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad4504-da4e-4b06-aaf8-6ab596e9ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:32.320970 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad4504-da4e-4b06-aaf8-6ab596e9ca0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:32.322156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad4504-da4e-4b06-aaf8-6ab596e9ca0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:32.323608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad4504-da4e-4b06-aaf8-6ab596e9ca0e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:32.325209 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 145/300] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:32.325993 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad4504-da4e-4b06-aaf8-6ab596e9ca0e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:32.369562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 156/301] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:32.369562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d8c73-c114-4598-82e1-e7d602abaab9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:32.439478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad4504-da4e-4b06-aaf8-6ab596e9ca0e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:32.460616 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d8c73-c114-4598-82e1-e7d602abaab9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:32.472257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7902ecc-33e2-4529-95c2-f3561b1aea32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:32.473043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7902ecc-33e2-4529-95c2-f3561b1aea32 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:32.473326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7902ecc-33e2-4529-95c2-f3561b1aea32 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:32.473633 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7902ecc-33e2-4529-95c2-f3561b1aea32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:32.483908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7902ecc-33e2-4529-95c2-f3561b1aea32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f7902ecc-33e2-4529-95c2-f3561b1aea32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:32.492009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:32.492905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:32.493834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:32.493834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:32.493834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:32.493834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:32.493834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:32.493834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:32.493834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:32.493834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:32.493834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:32.493834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:32.493834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:32.493834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:32.493834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 146/302] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:32.495086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7902ecc-33e2-4529-95c2-f3561b1aea32 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:32.500439 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f392-dec3-43a3-8cbd-1c9e47b6b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:32.501113 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f392-dec3-43a3-8cbd-1c9e47b6b8a2 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:32.501397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f392-dec3-43a3-8cbd-1c9e47b6b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:32.501729 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94f392-dec3-43a3-8cbd-1c9e47b6b8a2 None admin] PATH_INFO: `/v3/groups` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:32.502425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94f392-dec3-43a3-8cbd-1c9e47b6b8a2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:32.504289 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94f392-dec3-43a3-8cbd-1c9e47b6b8a2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:32.587944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7902ecc-33e2-4529-95c2-f3561b1aea32 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:32.594549 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 157/303] 10.222.0.35 () {60 vars in 1134 bytes} [Wed May 11 20:45:32 2022] POST /identity/v3/groups => generated 229 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:45:32.595346 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f392-dec3-43a3-8cbd-1c9e47b6b8a2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:32.646183 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63be36-61bc-4cf2-9220-b95d098b86a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:32.647539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63be36-61bc-4cf2-9220-b95d098b86a1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:32.648227 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63be36-61bc-4cf2-9220-b95d098b86a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:32.648978 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63be36-61bc-4cf2-9220-b95d098b86a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:32.664199 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63be36-61bc-4cf2-9220-b95d098b86a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6b63be36-61bc-4cf2-9220-b95d098b86a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:32.674735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:32.675719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:32.676550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:32.676550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:32.676550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:32.676550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:32.676550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:32.676550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:32.676550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:32.676550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:32.676550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:32.676550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:32.676550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:32.676550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:32.681114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 147/304] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:32.682713 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63be36-61bc-4cf2-9220-b95d098b86a1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:32.711844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94f392-dec3-43a3-8cbd-1c9e47b6b8a2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:32.758188 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e04b8-0dcb-4312-b8df-ec8c2f94ba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:32.759366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e04b8-0dcb-4312-b8df-ec8c2f94ba08 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:32.759733 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e04b8-0dcb-4312-b8df-ec8c2f94ba08 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:32.760086 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e04b8-0dcb-4312-b8df-ec8c2f94ba08 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:32.761209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e04b8-0dcb-4312-b8df-ec8c2f94ba08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:32.761628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e04b8-0dcb-4312-b8df-ec8c2f94ba08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:32.763147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e04b8-0dcb-4312-b8df-ec8c2f94ba08 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:32.774911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 158/305] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:32.780643 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e04b8-0dcb-4312-b8df-ec8c2f94ba08 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:32.806730 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63be36-61bc-4cf2-9220-b95d098b86a1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:32.848024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259134ce-eda3-46b6-ad53-f619c05cffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:32.848024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259134ce-eda3-46b6-ad53-f619c05cffd1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:32.848024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259134ce-eda3-46b6-ad53-f619c05cffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:32.848024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259134ce-eda3-46b6-ad53-f619c05cffd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:32.848544 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259134ce-eda3-46b6-ad53-f619c05cffd1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:32.849002 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259134ce-eda3-46b6-ad53-f619c05cffd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:32.850894 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259134ce-eda3-46b6-ad53-f619c05cffd1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:32.863301 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 148/306] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:32.869088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259134ce-eda3-46b6-ad53-f619c05cffd1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:32.907885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e04b8-0dcb-4312-b8df-ec8c2f94ba08 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:32.952927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaee1a1-1b6d-4ae8-9df7-3c57a32bdab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:32.954114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaee1a1-1b6d-4ae8-9df7-3c57a32bdab8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:32.954539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaee1a1-1b6d-4ae8-9df7-3c57a32bdab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:32.954953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaee1a1-1b6d-4ae8-9df7-3c57a32bdab8 None admin] PATH_INFO: `/v3/users/760374d0f2124a6dbb48abe6ad4149cb` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:32.956742 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaee1a1-1b6d-4ae8-9df7-3c57a32bdab8 None admin] RBAC: Authorizing `identity:get_user(user_id=760374d0f2124a6dbb48abe6ad4149cb)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:32.958976 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaee1a1-1b6d-4ae8-9df7-3c57a32bdab8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:32.961396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 159/307] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:32 2022] GET /identity/v3/users/760374d0f2124a6dbb48abe6ad4149cb => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:32.968530 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaee1a1-1b6d-4ae8-9df7-3c57a32bdab8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:32.987625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259134ce-eda3-46b6-ad53-f619c05cffd1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:33.028251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8596fc-62e4-40d7-b70b-2720618c2677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:33.029131 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8596fc-62e4-40d7-b70b-2720618c2677 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:33.029970 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8596fc-62e4-40d7-b70b-2720618c2677 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:33.030248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8596fc-62e4-40d7-b70b-2720618c2677 None admin] PATH_INFO: `/v3/users/7068a1c2bf1a4302b50d79cc53ba4dba` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:33.047314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8596fc-62e4-40d7-b70b-2720618c2677 None admin] RBAC: Authorizing `identity:get_user(user_id=7068a1c2bf1a4302b50d79cc53ba4dba)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:33.049270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8596fc-62e4-40d7-b70b-2720618c2677 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:33.056218 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 149/308] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:32 2022] GET /identity/v3/users/7068a1c2bf1a4302b50d79cc53ba4dba => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:33.058091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8596fc-62e4-40d7-b70b-2720618c2677 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:33.084969 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaee1a1-1b6d-4ae8-9df7-3c57a32bdab8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:33.118719 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264104a-6170-4dc9-84ee-189a0f665ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:33.119580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264104a-6170-4dc9-84ee-189a0f665ff4 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:33.119862 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264104a-6170-4dc9-84ee-189a0f665ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:33.120135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264104a-6170-4dc9-84ee-189a0f665ff4 None admin] PATH_INFO: `/v3/system/users/760374d0f2124a6dbb48abe6ad4149cb/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:33.122014 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264104a-6170-4dc9-84ee-189a0f665ff4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=760374d0f2124a6dbb48abe6ad4149cb, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:33.123328 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264104a-6170-4dc9-84ee-189a0f665ff4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:33.161888 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8596fc-62e4-40d7-b70b-2720618c2677 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:33.202029 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa298fc-5c0c-4211-b520-7dc9164d720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:33.202752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa298fc-5c0c-4211-b520-7dc9164d720e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:33.203043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa298fc-5c0c-4211-b520-7dc9164d720e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:33.203393 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa298fc-5c0c-4211-b520-7dc9164d720e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:33.204223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa298fc-5c0c-4211-b520-7dc9164d720e None admin] RBAC: Adding query filter params (role.id=12cfd45464bc4f27ba33f6b1038f3d31, user.id=7068a1c2bf1a4302b50d79cc53ba4dba, scope.system=all) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:33.204535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa298fc-5c0c-4211-b520-7dc9164d720e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:33.206001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa298fc-5c0c-4211-b520-7dc9164d720e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:33.211172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 150/309] 10.222.0.35 () {56 vars in 1308 bytes} [Wed May 11 20:45:33 2022] GET /identity/v3/role_assignments?user.id=7068a1c2bf1a4302b50d79cc53ba4dba&scope.system=all&role.id=12cfd45464bc4f27ba33f6b1038f3d31 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:33.225072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 160/310] 10.222.0.35 () {58 vars in 1334 bytes} [Wed May 11 20:45:32 2022] PUT /identity/v3/system/users/760374d0f2124a6dbb48abe6ad4149cb/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:33.366948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cb01b-c444-4ecd-b9e1-f035a3c0ddb6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:33.367321 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cb01b-c444-4ecd-b9e1-f035a3c0ddb6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:33.367523 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cb01b-c444-4ecd-b9e1-f035a3c0ddb6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:33.369280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 151/311] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:33.375309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440772f7-a8de-4858-8f93-131fbd1fa93d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:33.375617 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440772f7-a8de-4858-8f93-131fbd1fa93d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:33.375875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440772f7-a8de-4858-8f93-131fbd1fa93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:33.401579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-440772f7-a8de-4858-8f93-131fbd1fa93d None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:33.401579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-440772f7-a8de-4858-8f93-131fbd1fa93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:33.476232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 161/312] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:45:33.499064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cb01b-c444-4ecd-b9e1-f035a3c0ddb6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:33.601809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cb01b-c444-4ecd-b9e1-f035a3c0ddb6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:33.636766 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cae1a-c12c-4360-99fc-03c619107996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:33.637965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cae1a-c12c-4360-99fc-03c619107996 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:33.638525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cae1a-c12c-4360-99fc-03c619107996 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:33.639633 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cae1a-c12c-4360-99fc-03c619107996 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:33.650615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cae1a-c12c-4360-99fc-03c619107996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-cb5cae1a-c12c-4360-99fc-03c619107996 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:33.658805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:33.659698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:33.660521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:33.660521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:33.660521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:33.660521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:33.660521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:33.660521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:33.660521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:33.660521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:33.660521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:33.660521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:33.660521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:33.660521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:33.663214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 152/313] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:33.668588 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440772f7-a8de-4858-8f93-131fbd1fa93d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:33.768642 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440772f7-a8de-4858-8f93-131fbd1fa93d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:33.805253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7962f-d515-4291-a9df-00402315de72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:33.806345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7962f-d515-4291-a9df-00402315de72 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:33.806853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7962f-d515-4291-a9df-00402315de72 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:33.807323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7962f-d515-4291-a9df-00402315de72 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:33.808424 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7962f-d515-4291-a9df-00402315de72 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:33.808934 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7962f-d515-4291-a9df-00402315de72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:33.811051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7962f-d515-4291-a9df-00402315de72 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:33.821104 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 162/314] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:33.830621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cae1a-c12c-4360-99fc-03c619107996 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:33.939907 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cae1a-c12c-4360-99fc-03c619107996 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:33.973662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3b14-b5bf-4d49-a20e-6c8b3c62ebc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:33.974540 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3b14-b5bf-4d49-a20e-6c8b3c62ebc8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:33.974814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3b14-b5bf-4d49-a20e-6c8b3c62ebc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:33.975088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a3b14-b5bf-4d49-a20e-6c8b3c62ebc8 None admin] PATH_INFO: `/v3/users/de0e63889fbe45d987b145a98c6e598b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:33.976270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3b14-b5bf-4d49-a20e-6c8b3c62ebc8 None admin] RBAC: Authorizing `identity:get_user(user_id=de0e63889fbe45d987b145a98c6e598b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:33.977745 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a3b14-b5bf-4d49-a20e-6c8b3c62ebc8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:33.979350 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 153/315] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:33 2022] GET /identity/v3/users/de0e63889fbe45d987b145a98c6e598b => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:33.986864 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7962f-d515-4291-a9df-00402315de72 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:34.085310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7962f-d515-4291-a9df-00402315de72 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:34.122380 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91cbaf-8e02-484e-80c7-dbb8f05e6227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:34.123921 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91cbaf-8e02-484e-80c7-dbb8f05e6227 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:34.124435 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91cbaf-8e02-484e-80c7-dbb8f05e6227 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:34.124916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91cbaf-8e02-484e-80c7-dbb8f05e6227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:34.191732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91cbaf-8e02-484e-80c7-dbb8f05e6227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:34.193564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91cbaf-8e02-484e-80c7-dbb8f05e6227 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:34.290746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 163/316] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:34.301550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3b14-b5bf-4d49-a20e-6c8b3c62ebc8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:34.399917 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a3b14-b5bf-4d49-a20e-6c8b3c62ebc8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:34.434741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761ccc0-a372-4c0b-a445-ce9196e46f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:34.435663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ccc0-a372-4c0b-a445-ce9196e46f3f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:34.435950 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ccc0-a372-4c0b-a445-ce9196e46f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:34.436229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761ccc0-a372-4c0b-a445-ce9196e46f3f None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:34.437651 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761ccc0-a372-4c0b-a445-ce9196e46f3f None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:34.439165 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761ccc0-a372-4c0b-a445-ce9196e46f3f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:34.441366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 154/317] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:34 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:34.450722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91cbaf-8e02-484e-80c7-dbb8f05e6227 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:34.550556 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91cbaf-8e02-484e-80c7-dbb8f05e6227 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:34.583729 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd03a5-431b-48ae-8f98-9b51e53feb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:34.584390 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd03a5-431b-48ae-8f98-9b51e53feb2a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:34.584674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd03a5-431b-48ae-8f98-9b51e53feb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:34.584950 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd03a5-431b-48ae-8f98-9b51e53feb2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:34.585819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd03a5-431b-48ae-8f98-9b51e53feb2a None admin] RBAC: Adding query filter params (role.id=12cfd45464bc4f27ba33f6b1038f3d31, scope.project.id=e4df84ef89b243829f2a079628e9e618, user.id=de0e63889fbe45d987b145a98c6e598b) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:34.586134 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd03a5-431b-48ae-8f98-9b51e53feb2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:34.587584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd03a5-431b-48ae-8f98-9b51e53feb2a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:34.594349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 164/318] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:45:34 2022] GET /identity/v3/role_assignments?user.id=de0e63889fbe45d987b145a98c6e598b&scope.project.id=e4df84ef89b243829f2a079628e9e618&role.id=12cfd45464bc4f27ba33f6b1038f3d31 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:34.943572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3794-c75e-4b78-b21e-a15ce1956969 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:34.943895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3794-c75e-4b78-b21e-a15ce1956969 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:34.944171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d3794-c75e-4b78-b21e-a15ce1956969 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:34.945740 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 155/319] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:34.950874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ec0da-e973-4389-8ad2-e97a62163f2f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:34.951208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ec0da-e973-4389-8ad2-e97a62163f2f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:34.951489 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ec0da-e973-4389-8ad2-e97a62163f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:34.967929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-478ec0da-e973-4389-8ad2-e97a62163f2f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:34.969117 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-478ec0da-e973-4389-8ad2-e97a62163f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:35.033856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 165/320] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:35.056573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d3794-c75e-4b78-b21e-a15ce1956969 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:35.156258 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d3794-c75e-4b78-b21e-a15ce1956969 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:35.188298 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad9527-0106-4999-b7fe-78cff4b64196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:35.189088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad9527-0106-4999-b7fe-78cff4b64196 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:35.189376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad9527-0106-4999-b7fe-78cff4b64196 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:35.189682 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad9527-0106-4999-b7fe-78cff4b64196 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:35.190859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad9527-0106-4999-b7fe-78cff4b64196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:35.192305 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad9527-0106-4999-b7fe-78cff4b64196 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:35.194121 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 156/321] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:35.199634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ec0da-e973-4389-8ad2-e97a62163f2f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:35.293016 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ec0da-e973-4389-8ad2-e97a62163f2f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:35.330044 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd1537-2e95-4bec-926c-2a56ec159529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:35.330732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1537-2e95-4bec-926c-2a56ec159529 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:35.331018 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1537-2e95-4bec-926c-2a56ec159529 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:35.331298 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd1537-2e95-4bec-926c-2a56ec159529 None admin] PATH_INFO: `/v3/groups` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:35.332013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd1537-2e95-4bec-926c-2a56ec159529 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:35.333514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd1537-2e95-4bec-926c-2a56ec159529 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:35.449865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 166/322] 10.222.0.35 () {60 vars in 1134 bytes} [Wed May 11 20:45:35 2022] POST /identity/v3/groups => generated 226 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:45:35.500884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58631-23d2-4b2d-be66-7c26f8c1fe95 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:35.501399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58631-23d2-4b2d-be66-7c26f8c1fe95 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:35.501508 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c58631-23d2-4b2d-be66-7c26f8c1fe95 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:35.503080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 157/323] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:35.508589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47845c80-f5d3-4435-ab3b-994839de4e2b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:35.508880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47845c80-f5d3-4435-ab3b-994839de4e2b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:35.509148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47845c80-f5d3-4435-ab3b-994839de4e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:35.526912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-47845c80-f5d3-4435-ab3b-994839de4e2b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:35.528127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-47845c80-f5d3-4435-ab3b-994839de4e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:35.590044 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f1727-bbcf-4f40-93ac-94122dec937e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:35.590422 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f1727-bbcf-4f40-93ac-94122dec937e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:35.590775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f1727-bbcf-4f40-93ac-94122dec937e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:35.592370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 158/324] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:45:35.601627 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 167/325] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:35.601823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f592d-97c0-4e37-9da8-54023599fea9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:35.601823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f592d-97c0-4e37-9da8-54023599fea9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:35.601823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f592d-97c0-4e37-9da8-54023599fea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:35.616874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bb3f592d-97c0-4e37-9da8-54023599fea9 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:35.618112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bb3f592d-97c0-4e37-9da8-54023599fea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:35.620343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47845c80-f5d3-4435-ab3b-994839de4e2b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:35.696012 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 159/326] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:35.719298 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f592d-97c0-4e37-9da8-54023599fea9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:35.735383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47845c80-f5d3-4435-ab3b-994839de4e2b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:35.782514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee6a40-953e-40db-bab8-f69e83fd802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:35.783317 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee6a40-953e-40db-bab8-f69e83fd802f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:35.783601 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee6a40-953e-40db-bab8-f69e83fd802f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:35.783877 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee6a40-953e-40db-bab8-f69e83fd802f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:35.800132 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee6a40-953e-40db-bab8-f69e83fd802f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4aee6a40-953e-40db-bab8-f69e83fd802f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:35.808462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:35.815272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:35.816098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:35.816098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:35.816098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:35.816098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:35.816098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:35.816098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:35.816098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:35.816098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:35.816098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:35.816098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:35.816098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:35.816098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:35.816098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 168/327] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:45:35.817470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee6a40-953e-40db-bab8-f69e83fd802f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:35.859963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f592d-97c0-4e37-9da8-54023599fea9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:35.908490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c6e61-8f09-4b20-8c0e-a88607fe155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:35.909279 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c6e61-8f09-4b20-8c0e-a88607fe155b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:35.909599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c6e61-8f09-4b20-8c0e-a88607fe155b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:35.909879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c6e61-8f09-4b20-8c0e-a88607fe155b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:35.925501 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c6e61-8f09-4b20-8c0e-a88607fe155b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-be0c6e61-8f09-4b20-8c0e-a88607fe155b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:35.934710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:35.935684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:35.936483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:35.936483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:35.936483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:35.936483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:35.936483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:35.936483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:35.936483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:35.936483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:35.936483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:35.936483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:35.936483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:35.936483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:35.938948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 160/328] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:45:35.942976 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee6a40-953e-40db-bab8-f69e83fd802f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:35.945805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c6e61-8f09-4b20-8c0e-a88607fe155b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:35.990020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c7b1f-7bb6-4d17-ba43-a8b71d975272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:35.995199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c7b1f-7bb6-4d17-ba43-a8b71d975272 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:35.995718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c7b1f-7bb6-4d17-ba43-a8b71d975272 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:35.996216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c7b1f-7bb6-4d17-ba43-a8b71d975272 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:35.997199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c7b1f-7bb6-4d17-ba43-a8b71d975272 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:35.997753 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c7b1f-7bb6-4d17-ba43-a8b71d975272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:35.999393 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c7b1f-7bb6-4d17-ba43-a8b71d975272 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:36.008893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 169/329] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:36.014362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c7b1f-7bb6-4d17-ba43-a8b71d975272 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:36.095749 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c6e61-8f09-4b20-8c0e-a88607fe155b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:36.126199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c7b1f-7bb6-4d17-ba43-a8b71d975272 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:36.165521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2736338-48aa-4217-9e9e-888664aab43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:36.165760 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2736338-48aa-4217-9e9e-888664aab43e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:36.165934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2736338-48aa-4217-9e9e-888664aab43e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:36.166185 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2736338-48aa-4217-9e9e-888664aab43e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:36.166935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2736338-48aa-4217-9e9e-888664aab43e None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:36.167245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2736338-48aa-4217-9e9e-888664aab43e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:36.169447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2736338-48aa-4217-9e9e-888664aab43e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:36.173712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0c38e-bb4a-42b6-9f39-33d836bcadbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:36.174855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0c38e-bb4a-42b6-9f39-33d836bcadbe None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:36.175356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0c38e-bb4a-42b6-9f39-33d836bcadbe None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:36.175845 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0c38e-bb4a-42b6-9f39-33d836bcadbe None admin] PATH_INFO: `/v3/users/7068a1c2bf1a4302b50d79cc53ba4dba` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:36.177395 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0c38e-bb4a-42b6-9f39-33d836bcadbe None admin] RBAC: Authorizing `identity:get_user(user_id=7068a1c2bf1a4302b50d79cc53ba4dba)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:36.179150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0c38e-bb4a-42b6-9f39-33d836bcadbe None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:36.180610 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 161/330] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:36.181317 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 170/331] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:36 2022] GET /identity/v3/users/7068a1c2bf1a4302b50d79cc53ba4dba => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:36.186729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2736338-48aa-4217-9e9e-888664aab43e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:36.187807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0c38e-bb4a-42b6-9f39-33d836bcadbe None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:36.291126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0c38e-bb4a-42b6-9f39-33d836bcadbe None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:36.296204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2736338-48aa-4217-9e9e-888664aab43e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:36.328745 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fe2e2-e113-48ef-90ba-927e40036e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:36.329742 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fe2e2-e113-48ef-90ba-927e40036e17 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:36.330025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fe2e2-e113-48ef-90ba-927e40036e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:36.330218 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab1509-28f5-4d42-8a79-93518a147a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:36.330327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fe2e2-e113-48ef-90ba-927e40036e17 None admin] PATH_INFO: `/v3/system/users/7068a1c2bf1a4302b50d79cc53ba4dba/roles/12cfd45464bc4f27ba33f6b1038f3d31` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:36.331128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab1509-28f5-4d42-8a79-93518a147a81 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:36.331343 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab1509-28f5-4d42-8a79-93518a147a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:36.331644 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab1509-28f5-4d42-8a79-93518a147a81 None admin] PATH_INFO: `/v3/users/760374d0f2124a6dbb48abe6ad4149cb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:36.332839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab1509-28f5-4d42-8a79-93518a147a81 None admin] RBAC: Authorizing `identity:get_user(user_id=760374d0f2124a6dbb48abe6ad4149cb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:36.332948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fe2e2-e113-48ef-90ba-927e40036e17 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7068a1c2bf1a4302b50d79cc53ba4dba, role_id=12cfd45464bc4f27ba33f6b1038f3d31)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:36.334289 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fe2e2-e113-48ef-90ba-927e40036e17 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:36.334397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab1509-28f5-4d42-8a79-93518a147a81 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:36.336144 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 162/332] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:36 2022] GET /identity/v3/users/760374d0f2124a6dbb48abe6ad4149cb => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:36.341643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab1509-28f5-4d42-8a79-93518a147a81 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:36.427696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 171/333] 10.222.0.35 () {58 vars in 1334 bytes} [Wed May 11 20:45:36 2022] PUT /identity/v3/system/users/7068a1c2bf1a4302b50d79cc53ba4dba/roles/12cfd45464bc4f27ba33f6b1038f3d31 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:36.444151 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab1509-28f5-4d42-8a79-93518a147a81 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:36.481319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e9794-5fd5-4926-b348-8d5d7831b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:36.482089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e9794-5fd5-4926-b348-8d5d7831b102 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:36.482425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e9794-5fd5-4926-b348-8d5d7831b102 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:36.482705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e9794-5fd5-4926-b348-8d5d7831b102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:36.483555 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e9794-5fd5-4926-b348-8d5d7831b102 None admin] RBAC: Adding query filter params (role.id=a211713995b7409ca158916c665f73b6, user.id=760374d0f2124a6dbb48abe6ad4149cb, scope.system=all) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:36.483873 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e9794-5fd5-4926-b348-8d5d7831b102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:36.485328 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e9794-5fd5-4926-b348-8d5d7831b102 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:36.498806 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 163/334] 10.222.0.35 () {56 vars in 1308 bytes} [Wed May 11 20:45:36 2022] GET /identity/v3/role_assignments?user.id=760374d0f2124a6dbb48abe6ad4149cb&scope.system=all&role.id=a211713995b7409ca158916c665f73b6 => generated 510 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:38.336211 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbbf81-2a4c-42d9-992a-46a37b51673e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:38.336918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbbf81-2a4c-42d9-992a-46a37b51673e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:38.336918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbbf81-2a4c-42d9-992a-46a37b51673e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:38.338451 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 172/335] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:38.347049 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30527600-f952-4814-a6f9-bb939a51657c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:38.347618 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30527600-f952-4814-a6f9-bb939a51657c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:38.347618 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30527600-f952-4814-a6f9-bb939a51657c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:38.369461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-30527600-f952-4814-a6f9-bb939a51657c None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:38.370734 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-30527600-f952-4814-a6f9-bb939a51657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:38.458260 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 164/336] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:38.493678 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbbf81-2a4c-42d9-992a-46a37b51673e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:38.606517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbbf81-2a4c-42d9-992a-46a37b51673e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:38.642495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b2373-f080-459d-b68d-05e8a476a261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:38.643319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2373-f080-459d-b68d-05e8a476a261 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:38.643604 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2373-f080-459d-b68d-05e8a476a261 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:38.643876 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b2373-f080-459d-b68d-05e8a476a261 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:38.646736 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb309-d5ff-4927-ae9f-fee0e6e85019 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:38.647018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb309-d5ff-4927-ae9f-fee0e6e85019 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:38.647295 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feb309-d5ff-4927-ae9f-fee0e6e85019 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:38.648686 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 165/337] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:45:38.654431 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30617a8f-d791-4e09-a2d9-98cffb30348f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:38.654703 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30617a8f-d791-4e09-a2d9-98cffb30348f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:38.654983 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30617a8f-d791-4e09-a2d9-98cffb30348f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:38.682625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-30617a8f-d791-4e09-a2d9-98cffb30348f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:38.683820 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-30617a8f-d791-4e09-a2d9-98cffb30348f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:38.687031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b2373-f080-459d-b68d-05e8a476a261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-8e8b2373-f080-459d-b68d-05e8a476a261 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:38.695571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:38.696523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:38.697373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:38.697373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:38.697373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:38.697373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:38.697373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:38.697373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:38.697373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:38.697373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:38.697373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:38.697373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:38.697373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:38.697373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:38.704231 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 173/338] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:45:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:38.705387 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b2373-f080-459d-b68d-05e8a476a261 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:38.802031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 166/339] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:45:38.846177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30617a8f-d791-4e09-a2d9-98cffb30348f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:38.870251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b2373-f080-459d-b68d-05e8a476a261 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:38.933873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b771b4-d6b2-4d1a-9010-68d7c43cc7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:38.934559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b771b4-d6b2-4d1a-9010-68d7c43cc7ff None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:38.934841 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b771b4-d6b2-4d1a-9010-68d7c43cc7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:38.935118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b771b4-d6b2-4d1a-9010-68d7c43cc7ff None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:38.936589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b771b4-d6b2-4d1a-9010-68d7c43cc7ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:38.936906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b771b4-d6b2-4d1a-9010-68d7c43cc7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:38.938788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b771b4-d6b2-4d1a-9010-68d7c43cc7ff None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:38.952009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 174/340] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:45:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:38.953344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3426786-292c-43a1-ab72-24821b65da47 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:38.953658 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3426786-292c-43a1-ab72-24821b65da47 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:38.953940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3426786-292c-43a1-ab72-24821b65da47 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:38.958534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 175/341] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:38.958534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3426786-292c-43a1-ab72-24821b65da47 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:39.000553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30617a8f-d791-4e09-a2d9-98cffb30348f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:39.038472 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2184a-c4b3-4bd7-9201-88e8149f8b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:39.039321 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2184a-c4b3-4bd7-9201-88e8149f8b66 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:39.039606 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2184a-c4b3-4bd7-9201-88e8149f8b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:39.039880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2184a-c4b3-4bd7-9201-88e8149f8b66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:39.053283 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2184a-c4b3-4bd7-9201-88e8149f8b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2ab2184a-c4b3-4bd7-9201-88e8149f8b66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:39.062549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:39.063460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:39.064942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:39.064942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:39.064942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:39.064942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:39.064942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:39.064942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:39.064942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:39.064942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:39.064942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:39.064942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:39.064942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:39.064942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:39.064942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 167/342] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:39.065788 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3d1a3-90ae-4a62-b330-23af9c4282e3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:39.065788 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3d1a3-90ae-4a62-b330-23af9c4282e3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:39.065922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3d1a3-90ae-4a62-b330-23af9c4282e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:39.090666 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cbf3d1a3-90ae-4a62-b330-23af9c4282e3 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:39.092426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cbf3d1a3-90ae-4a62-b330-23af9c4282e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:39.094814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3426786-292c-43a1-ab72-24821b65da47 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:39.159158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979915d1-7b7e-4b4b-83dc-a1cb72b30002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:39.159799 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979915d1-7b7e-4b4b-83dc-a1cb72b30002 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:39.160085 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979915d1-7b7e-4b4b-83dc-a1cb72b30002 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:39.160360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979915d1-7b7e-4b4b-83dc-a1cb72b30002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:39.222523 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 168/343] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:39.223252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3d1a3-90ae-4a62-b330-23af9c4282e3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:39.268186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979915d1-7b7e-4b4b-83dc-a1cb72b30002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:39.269952 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979915d1-7b7e-4b4b-83dc-a1cb72b30002 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:39.332302 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3d1a3-90ae-4a62-b330-23af9c4282e3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:39.367408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb497f98-b9b6-42b2-9ce0-f80b13e19ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:39.368065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497f98-b9b6-42b2-9ce0-f80b13e19ffc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:39.368353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497f98-b9b6-42b2-9ce0-f80b13e19ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:39.368888 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497f98-b9b6-42b2-9ce0-f80b13e19ffc None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:39.369439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb497f98-b9b6-42b2-9ce0-f80b13e19ffc None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:39.369820 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb497f98-b9b6-42b2-9ce0-f80b13e19ffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:39.371206 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb497f98-b9b6-42b2-9ce0-f80b13e19ffc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:39.382522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 169/344] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:39.383426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb497f98-b9b6-42b2-9ce0-f80b13e19ffc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:39.413045 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 176/345] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:39.414603 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979915d1-7b7e-4b4b-83dc-a1cb72b30002 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:39.490297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb497f98-b9b6-42b2-9ce0-f80b13e19ffc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:39.524596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979915d1-7b7e-4b4b-83dc-a1cb72b30002 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:39.525103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347301e-1db6-41be-acb7-3ecea8c056bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:39.525939 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347301e-1db6-41be-acb7-3ecea8c056bb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:39.526226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347301e-1db6-41be-acb7-3ecea8c056bb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:39.526505 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347301e-1db6-41be-acb7-3ecea8c056bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:39.537545 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347301e-1db6-41be-acb7-3ecea8c056bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b347301e-1db6-41be-acb7-3ecea8c056bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:39.545944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:39.546881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:39.552368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:39.552368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:39.552368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:39.552368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:39.552368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:39.552368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:39.552368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:39.552368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:39.552368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:39.552368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:39.552368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:39.552368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:39.552368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 170/346] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:39.552368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347301e-1db6-41be-acb7-3ecea8c056bb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:39.570561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73ce37-fcb7-470c-981c-bea292e34afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:39.571571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73ce37-fcb7-470c-981c-bea292e34afd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:39.572084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73ce37-fcb7-470c-981c-bea292e34afd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:39.572584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73ce37-fcb7-470c-981c-bea292e34afd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:39.657111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347301e-1db6-41be-acb7-3ecea8c056bb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:39.691712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cbbce-917b-4787-ac47-f8f211c6b80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:39.692501 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cbbce-917b-4787-ac47-f8f211c6b80f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:39.692783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cbbce-917b-4787-ac47-f8f211c6b80f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:39.693063 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920cbbce-917b-4787-ac47-f8f211c6b80f None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:39.694280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cbbce-917b-4787-ac47-f8f211c6b80f None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:39.695745 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920cbbce-917b-4787-ac47-f8f211c6b80f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:39.697775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 171/347] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:39 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:39.698574 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cbbce-917b-4787-ac47-f8f211c6b80f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:39.706153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73ce37-fcb7-470c-981c-bea292e34afd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:39.707669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73ce37-fcb7-470c-981c-bea292e34afd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:39.801365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920cbbce-917b-4787-ac47-f8f211c6b80f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:39.838984 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223083cd-f68a-4bc3-831d-592175d4b962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:39.840173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223083cd-f68a-4bc3-831d-592175d4b962 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:39.840465 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223083cd-f68a-4bc3-831d-592175d4b962 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:39.840746 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223083cd-f68a-4bc3-831d-592175d4b962 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:39.842166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223083cd-f68a-4bc3-831d-592175d4b962 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:39.842790 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223083cd-f68a-4bc3-831d-592175d4b962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:39.844529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223083cd-f68a-4bc3-831d-592175d4b962 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:39.854539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 172/348] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:39.855185 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223083cd-f68a-4bc3-831d-592175d4b962 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:39.933777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 177/349] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:39.934951 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73ce37-fcb7-470c-981c-bea292e34afd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:39.977945 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223083cd-f68a-4bc3-831d-592175d4b962 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:40.018224 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74969c41-9b2c-4bc0-ab15-98c1aaa0a780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:40.019606 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74969c41-9b2c-4bc0-ab15-98c1aaa0a780 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:40.020055 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74969c41-9b2c-4bc0-ab15-98c1aaa0a780 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:40.020631 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74969c41-9b2c-4bc0-ab15-98c1aaa0a780 None admin] PATH_INFO: `/v3/groups/fee03e2ffe74487f86275873337addeb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:40.029768 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74969c41-9b2c-4bc0-ab15-98c1aaa0a780 None admin] RBAC: Authorizing `identity:get_group(group_id=fee03e2ffe74487f86275873337addeb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:40.031451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74969c41-9b2c-4bc0-ab15-98c1aaa0a780 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:40.033690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 173/350] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:39 2022] GET /identity/v3/groups/fee03e2ffe74487f86275873337addeb => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:40.034626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74969c41-9b2c-4bc0-ab15-98c1aaa0a780 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:40.151802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74969c41-9b2c-4bc0-ab15-98c1aaa0a780 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:40.181122 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73ce37-fcb7-470c-981c-bea292e34afd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:40.195294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1501a-03c5-41d7-b24e-86c5ddb7ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:40.196575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1501a-03c5-41d7-b24e-86c5ddb7ce05 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:40.197388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1501a-03c5-41d7-b24e-86c5ddb7ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:40.197866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1501a-03c5-41d7-b24e-86c5ddb7ce05 None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:40.199526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1501a-03c5-41d7-b24e-86c5ddb7ce05 None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:40.202126 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da1501a-03c5-41d7-b24e-86c5ddb7ce05 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:40.205066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 174/351] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:40 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:40.206350 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1501a-03c5-41d7-b24e-86c5ddb7ce05 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:40.218746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9addc86-f80a-4c28-98fa-2f9482540f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:40.219751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9addc86-f80a-4c28-98fa-2f9482540f97 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:40.220241 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9addc86-f80a-4c28-98fa-2f9482540f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:40.220714 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9addc86-f80a-4c28-98fa-2f9482540f97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:40.298248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9addc86-f80a-4c28-98fa-2f9482540f97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:40.300112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9addc86-f80a-4c28-98fa-2f9482540f97 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:40.339733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1501a-03c5-41d7-b24e-86c5ddb7ce05 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:40.378263 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf4424-963e-4ea3-b3f0-cf1012bb4738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:40.379607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf4424-963e-4ea3-b3f0-cf1012bb4738 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:40.380058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf4424-963e-4ea3-b3f0-cf1012bb4738 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:40.380477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf4424-963e-4ea3-b3f0-cf1012bb4738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:40.381458 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf4424-963e-4ea3-b3f0-cf1012bb4738 None admin] RBAC: Adding query filter params (group.id=fee03e2ffe74487f86275873337addeb, role.id=6437cf432fe44cc28aa54208759f1265, scope.project.id=07752e1fa91d4fec8615e3b11c555cb7) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:40.381952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf4424-963e-4ea3-b3f0-cf1012bb4738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:40.383512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf4424-963e-4ea3-b3f0-cf1012bb4738 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:40.395956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 175/352] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 11 20:45:40 2022] GET /identity/v3/role_assignments?group.id=fee03e2ffe74487f86275873337addeb&scope.project.id=07752e1fa91d4fec8615e3b11c555cb7&role.id=6437cf432fe44cc28aa54208759f1265 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:40.397640 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8fe81-d152-4c81-896d-1b5794cf8eb8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:40.398134 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8fe81-d152-4c81-896d-1b5794cf8eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:40.398631 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8fe81-d152-4c81-896d-1b5794cf8eb8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:40.400451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 176/353] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:40.401485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8fe81-d152-4c81-896d-1b5794cf8eb8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:40.417118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 178/354] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:40.419127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c0715-4f3d-42de-9371-ad2928028d03 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:40.419262 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c0715-4f3d-42de-9371-ad2928028d03 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:40.419540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c0715-4f3d-42de-9371-ad2928028d03 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:40.425558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 179/355] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:40.425558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a9c13-a76f-46a5-a06c-7555ab4d8117 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:40.425558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a9c13-a76f-46a5-a06c-7555ab4d8117 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:40.425558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a9c13-a76f-46a5-a06c-7555ab4d8117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:40.446163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6f9a9c13-a76f-46a5-a06c-7555ab4d8117 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:40.448579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6f9a9c13-a76f-46a5-a06c-7555ab4d8117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:40.532400 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8fe81-d152-4c81-896d-1b5794cf8eb8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:40.541293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 180/356] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:40.545581 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a9c13-a76f-46a5-a06c-7555ab4d8117 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:40.576527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459def8e-96e7-4ebb-b569-4b3a52b77c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:40.577364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459def8e-96e7-4ebb-b569-4b3a52b77c74 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:40.577664 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459def8e-96e7-4ebb-b569-4b3a52b77c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:40.577940 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459def8e-96e7-4ebb-b569-4b3a52b77c74 None admin] PATH_INFO: `/v3/groups/fee03e2ffe74487f86275873337addeb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:40.579590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459def8e-96e7-4ebb-b569-4b3a52b77c74 None admin] RBAC: Authorizing `identity:get_group(group_id=fee03e2ffe74487f86275873337addeb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:40.581362 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459def8e-96e7-4ebb-b569-4b3a52b77c74 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:40.582972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 177/357] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:40 2022] GET /identity/v3/groups/fee03e2ffe74487f86275873337addeb => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:40.584060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54f181-5df8-4b71-9714-cfda6549f4ae None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:40.584342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54f181-5df8-4b71-9714-cfda6549f4ae None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:40.584613 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54f181-5df8-4b71-9714-cfda6549f4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:40.602106 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ac54f181-5df8-4b71-9714-cfda6549f4ae None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:40.603287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ac54f181-5df8-4b71-9714-cfda6549f4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:40.675980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 178/358] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:40.677557 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bc397-ce4d-4bde-b1a8-5d7efa7adc10 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:40.677992 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bc397-ce4d-4bde-b1a8-5d7efa7adc10 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:40.678412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bc397-ce4d-4bde-b1a8-5d7efa7adc10 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:40.680176 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 179/359] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:40.681014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bc397-ce4d-4bde-b1a8-5d7efa7adc10 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:40.687779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a9c13-a76f-46a5-a06c-7555ab4d8117 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:40.728454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8324b-ad28-4bb0-96e3-9d01f67604c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:40.729338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8324b-ad28-4bb0-96e3-9d01f67604c8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:40.729758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8324b-ad28-4bb0-96e3-9d01f67604c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:40.730046 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8324b-ad28-4bb0-96e3-9d01f67604c8 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:40.731238 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8324b-ad28-4bb0-96e3-9d01f67604c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:40.733559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8324b-ad28-4bb0-96e3-9d01f67604c8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:40.735425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 181/360] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:40 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:40.735894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8324b-ad28-4bb0-96e3-9d01f67604c8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:40.806141 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bc397-ce4d-4bde-b1a8-5d7efa7adc10 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:40.855797 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b7e39-494b-4fae-b93e-c65245081930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:40.856593 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b7e39-494b-4fae-b93e-c65245081930 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:40.856872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b7e39-494b-4fae-b93e-c65245081930 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:40.857725 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b7e39-494b-4fae-b93e-c65245081930 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:40.868720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b7e39-494b-4fae-b93e-c65245081930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:40.875306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8324b-ad28-4bb0-96e3-9d01f67604c8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-581b7e39-494b-4fae-b93e-c65245081930 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:40.877805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:40.878726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:40.879539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:40.879539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:40.879539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:40.879539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:40.879539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:40.879539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:40.879539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:40.879539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:40.879539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:40.879539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:40.879539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 11 20:45:40.879539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:40.879539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 180/361] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:40.880217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc7841-4ee5-46a0-a9ff-633f769f544d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:40.880782 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc7841-4ee5-46a0-a9ff-633f769f544d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:40.880782 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc7841-4ee5-46a0-a9ff-633f769f544d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:40.902312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0ecc7841-4ee5-46a0-a9ff-633f769f544d None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:40.906008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0ecc7841-4ee5-46a0-a9ff-633f769f544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:40.922627 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d51f45-47d2-4991-bb99-804e2ec8ec36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:40.923301 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d51f45-47d2-4991-bb99-804e2ec8ec36 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:40.923678 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d51f45-47d2-4991-bb99-804e2ec8ec36 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:40.924373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d51f45-47d2-4991-bb99-804e2ec8ec36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:40.924693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d51f45-47d2-4991-bb99-804e2ec8ec36 None admin] RBAC: Adding query filter params (group.id=fee03e2ffe74487f86275873337addeb, role.id=a211713995b7409ca158916c665f73b6, scope.project.id=07752e1fa91d4fec8615e3b11c555cb7) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:40.925006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d51f45-47d2-4991-bb99-804e2ec8ec36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:40.926510 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d51f45-47d2-4991-bb99-804e2ec8ec36 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:40.933433 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 182/362] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 11 20:45:40 2022] GET /identity/v3/role_assignments?group.id=fee03e2ffe74487f86275873337addeb&scope.project.id=07752e1fa91d4fec8615e3b11c555cb7&role.id=a211713995b7409ca158916c665f73b6 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:40.936326 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d51f45-47d2-4991-bb99-804e2ec8ec36 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:41.005716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 181/363] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:41.006765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc7841-4ee5-46a0-a9ff-633f769f544d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:41.058884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d51f45-47d2-4991-bb99-804e2ec8ec36 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:41.095582 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5d615-60ad-4d80-84dd-6da1d4133afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:41.096778 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5d615-60ad-4d80-84dd-6da1d4133afb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:41.097267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5d615-60ad-4d80-84dd-6da1d4133afb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:41.097784 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5d615-60ad-4d80-84dd-6da1d4133afb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:41.110426 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5d615-60ad-4d80-84dd-6da1d4133afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f9d5d615-60ad-4d80-84dd-6da1d4133afb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:41.119081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:41.120049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:41.120882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:41.120882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:41.120882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:41.120882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:41.120882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:41.120882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:41.120882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:41.120882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:41.120882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:41.120882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:41.120882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:41.120882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:41.123447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 183/364] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:45:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:41.124531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5d615-60ad-4d80-84dd-6da1d4133afb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:41.134595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc7841-4ee5-46a0-a9ff-633f769f544d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:41.174181 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54116c-50b5-4005-a1eb-e132c3012f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:41.175043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54116c-50b5-4005-a1eb-e132c3012f7d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:41.175333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54116c-50b5-4005-a1eb-e132c3012f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:41.175611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54116c-50b5-4005-a1eb-e132c3012f7d None admin] PATH_INFO: `/v3/groups/fee03e2ffe74487f86275873337addeb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:41.176791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54116c-50b5-4005-a1eb-e132c3012f7d None admin] RBAC: Authorizing `identity:get_group(group_id=fee03e2ffe74487f86275873337addeb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:41.178276 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54116c-50b5-4005-a1eb-e132c3012f7d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:41.180060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 182/365] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:41 2022] GET /identity/v3/groups/fee03e2ffe74487f86275873337addeb => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:41.181724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54116c-50b5-4005-a1eb-e132c3012f7d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:41.249565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5d615-60ad-4d80-84dd-6da1d4133afb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:41.286946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53388458-f236-48ba-bf91-22311519e671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:41.287623 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53388458-f236-48ba-bf91-22311519e671 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:41.287906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53388458-f236-48ba-bf91-22311519e671 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:41.288182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53388458-f236-48ba-bf91-22311519e671 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:41.288919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53388458-f236-48ba-bf91-22311519e671 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:41.289226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53388458-f236-48ba-bf91-22311519e671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:41.290746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53388458-f236-48ba-bf91-22311519e671 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:41.300413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 184/366] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:41.301377 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53388458-f236-48ba-bf91-22311519e671 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:41.310016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54116c-50b5-4005-a1eb-e132c3012f7d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:41.346242 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd7d06-b5d6-4728-92e7-ad33a71bd800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:41.347384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd7d06-b5d6-4728-92e7-ad33a71bd800 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:41.347889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd7d06-b5d6-4728-92e7-ad33a71bd800 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:41.348381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd7d06-b5d6-4728-92e7-ad33a71bd800 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:41.360013 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd7d06-b5d6-4728-92e7-ad33a71bd800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4ebd7d06-b5d6-4728-92e7-ad33a71bd800 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:41.368024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:41.368926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:41.369769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:41.369769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:41.369769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:41.369769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:41.369769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:41.369769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:41.369769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:41.369769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:41.369769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:41.369769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:41.369769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:41.369769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:41.372418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 183/367] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:45:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:41.373450 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd7d06-b5d6-4728-92e7-ad33a71bd800 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:41.402310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53388458-f236-48ba-bf91-22311519e671 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:41.438560 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe17c94-9845-435b-9371-e5fe035877b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:41.439219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe17c94-9845-435b-9371-e5fe035877b9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:41.439429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe17c94-9845-435b-9371-e5fe035877b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:41.439709 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe17c94-9845-435b-9371-e5fe035877b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:41.440523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe17c94-9845-435b-9371-e5fe035877b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:41.440759 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe17c94-9845-435b-9371-e5fe035877b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:41.442233 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe17c94-9845-435b-9371-e5fe035877b9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:41.450270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 185/368] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:45:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:41.451110 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe17c94-9845-435b-9371-e5fe035877b9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:41.482720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd7d06-b5d6-4728-92e7-ad33a71bd800 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:41.517479 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57874122-87c4-4a61-afea-bf159c6c7264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:41.518535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57874122-87c4-4a61-afea-bf159c6c7264 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:41.519045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57874122-87c4-4a61-afea-bf159c6c7264 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:41.519764 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57874122-87c4-4a61-afea-bf159c6c7264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:41.520872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57874122-87c4-4a61-afea-bf159c6c7264 None admin] RBAC: Adding query filter params (group.id=fee03e2ffe74487f86275873337addeb, role.id=a211713995b7409ca158916c665f73b6, scope.project.id=e4df84ef89b243829f2a079628e9e618) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:41.521386 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57874122-87c4-4a61-afea-bf159c6c7264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:41.523124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57874122-87c4-4a61-afea-bf159c6c7264 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:41.530079 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 184/369] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 11 20:45:41 2022] GET /identity/v3/role_assignments?group.id=fee03e2ffe74487f86275873337addeb&scope.project.id=e4df84ef89b243829f2a079628e9e618&role.id=a211713995b7409ca158916c665f73b6 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:41.531187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57874122-87c4-4a61-afea-bf159c6c7264 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:41.558288 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe17c94-9845-435b-9371-e5fe035877b9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:41.598198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1414b12-05cc-4584-8512-c836ef380e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:41.598999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1414b12-05cc-4584-8512-c836ef380e0b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:41.599277 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1414b12-05cc-4584-8512-c836ef380e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:41.599548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1414b12-05cc-4584-8512-c836ef380e0b None admin] PATH_INFO: `/v3/users/7068a1c2bf1a4302b50d79cc53ba4dba` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:41.604744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1414b12-05cc-4584-8512-c836ef380e0b None admin] RBAC: Authorizing `identity:get_user(user_id=7068a1c2bf1a4302b50d79cc53ba4dba)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:41.604744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1414b12-05cc-4584-8512-c836ef380e0b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:41.605156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 186/370] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:45:41 2022] GET /identity/v3/users/7068a1c2bf1a4302b50d79cc53ba4dba => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:41.606012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1414b12-05cc-4584-8512-c836ef380e0b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:41.725215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57874122-87c4-4a61-afea-bf159c6c7264 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:41.792412 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1414b12-05cc-4584-8512-c836ef380e0b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:41.795807 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea30b5-32f7-4fb8-b867-6239726fd84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:41.796775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea30b5-32f7-4fb8-b867-6239726fd84e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:41.797262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea30b5-32f7-4fb8-b867-6239726fd84e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:41.797779 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea30b5-32f7-4fb8-b867-6239726fd84e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:41.798750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea30b5-32f7-4fb8-b867-6239726fd84e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:41.799272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea30b5-32f7-4fb8-b867-6239726fd84e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:41.800848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea30b5-32f7-4fb8-b867-6239726fd84e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:41.812771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 185/371] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:41.814312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea30b5-32f7-4fb8-b867-6239726fd84e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:41.853608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81d333-4e25-4789-9793-4b2382108f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:41.853608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d333-4e25-4789-9793-4b2382108f07 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:41.853608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d333-4e25-4789-9793-4b2382108f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:41.853608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81d333-4e25-4789-9793-4b2382108f07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:41.968931 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea30b5-32f7-4fb8-b867-6239726fd84e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:41.976840 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81d333-4e25-4789-9793-4b2382108f07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:41.978368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81d333-4e25-4789-9793-4b2382108f07 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:42.005350 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275adbe-3321-4983-877e-b2f058c53cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:42.006046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275adbe-3321-4983-877e-b2f058c53cbf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:42.006333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275adbe-3321-4983-877e-b2f058c53cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:42.006615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275adbe-3321-4983-877e-b2f058c53cbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:42.007448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275adbe-3321-4983-877e-b2f058c53cbf None admin] RBAC: Adding query filter params (role.id=12cfd45464bc4f27ba33f6b1038f3d31, user.id=7068a1c2bf1a4302b50d79cc53ba4dba, scope.system=all) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:42.007767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275adbe-3321-4983-877e-b2f058c53cbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:42.009212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275adbe-3321-4983-877e-b2f058c53cbf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:42.023365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 186/372] 10.222.0.35 () {56 vars in 1308 bytes} [Wed May 11 20:45:41 2022] GET /identity/v3/role_assignments?user.id=7068a1c2bf1a4302b50d79cc53ba4dba&scope.system=all&role.id=12cfd45464bc4f27ba33f6b1038f3d31 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:42.024347 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275adbe-3321-4983-877e-b2f058c53cbf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:42.128216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 187/373] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:42.133717 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81d333-4e25-4789-9793-4b2382108f07 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:42.175803 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275adbe-3321-4983-877e-b2f058c53cbf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:42.245693 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460d370-2b11-4887-aca7-0689c737c427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:42.246358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460d370-2b11-4887-aca7-0689c737c427 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:42.246640 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460d370-2b11-4887-aca7-0689c737c427 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:42.246918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460d370-2b11-4887-aca7-0689c737c427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:42.292725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81d333-4e25-4789-9793-4b2382108f07 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:42.353823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6fbeb-0408-4112-9078-e773ce879750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:42.354717 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6fbeb-0408-4112-9078-e773ce879750 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:42.355010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6fbeb-0408-4112-9078-e773ce879750 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:42.355291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6fbeb-0408-4112-9078-e773ce879750 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:42.355719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460d370-2b11-4887-aca7-0689c737c427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:42.356548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6fbeb-0408-4112-9078-e773ce879750 None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:42.358570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6fbeb-0408-4112-9078-e773ce879750 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:42.358947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460d370-2b11-4887-aca7-0689c737c427 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:42.360311 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 188/374] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:42 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:42.366561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6fbeb-0408-4112-9078-e773ce879750 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:42.517138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 187/375] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:42.524241 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460d370-2b11-4887-aca7-0689c737c427 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:42.577897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6fbeb-0408-4112-9078-e773ce879750 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:42.616484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c15a3-290d-49c9-84a8-2ae9386926d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:42.617730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c15a3-290d-49c9-84a8-2ae9386926d2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:42.618218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c15a3-290d-49c9-84a8-2ae9386926d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:42.618721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c15a3-290d-49c9-84a8-2ae9386926d2 None admin] PATH_INFO: `/v3/groups/fee03e2ffe74487f86275873337addeb` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:42.620143 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c15a3-290d-49c9-84a8-2ae9386926d2 None admin] RBAC: Authorizing `identity:get_group(group_id=fee03e2ffe74487f86275873337addeb)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:42.621833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c15a3-290d-49c9-84a8-2ae9386926d2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:42.624531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 189/376] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:42 2022] GET /identity/v3/groups/fee03e2ffe74487f86275873337addeb => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:42.630011 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c15a3-290d-49c9-84a8-2ae9386926d2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:42.660794 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460d370-2b11-4887-aca7-0689c737c427 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:42.699778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e86ca-bf4b-4785-9a61-1cfd3e5756f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:42.701230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e86ca-bf4b-4785-9a61-1cfd3e5756f5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:42.701472 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e86ca-bf4b-4785-9a61-1cfd3e5756f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:42.701805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e86ca-bf4b-4785-9a61-1cfd3e5756f5 None admin] PATH_INFO: `/v3/projects/2831911a3b2e4e6f87ef9844395d784e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:42.703708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e86ca-bf4b-4785-9a61-1cfd3e5756f5 None admin] RBAC: Authorizing `identity:get_project(project_id=2831911a3b2e4e6f87ef9844395d784e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:42.705149 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e86ca-bf4b-4785-9a61-1cfd3e5756f5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:42.707187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 188/377] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:42 2022] GET /identity/v3/projects/2831911a3b2e4e6f87ef9844395d784e => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:42.713667 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e86ca-bf4b-4785-9a61-1cfd3e5756f5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:42.772721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c15a3-290d-49c9-84a8-2ae9386926d2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:42.811348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba221dd-a18d-4acd-b0c2-4f8d1522e2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:42.811348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba221dd-a18d-4acd-b0c2-4f8d1522e2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:42.811348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba221dd-a18d-4acd-b0c2-4f8d1522e2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:42.811348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba221dd-a18d-4acd-b0c2-4f8d1522e2d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:42.811987 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba221dd-a18d-4acd-b0c2-4f8d1522e2d6 None admin] RBAC: Adding query filter params (group.id=fee03e2ffe74487f86275873337addeb, role.id=6437cf432fe44cc28aa54208759f1265, scope.project.id=e4df84ef89b243829f2a079628e9e618) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:42.812352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba221dd-a18d-4acd-b0c2-4f8d1522e2d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:42.813816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba221dd-a18d-4acd-b0c2-4f8d1522e2d6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:42.820051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 190/378] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 11 20:45:42 2022] GET /identity/v3/role_assignments?group.id=fee03e2ffe74487f86275873337addeb&scope.project.id=e4df84ef89b243829f2a079628e9e618&role.id=6437cf432fe44cc28aa54208759f1265 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:42.861395 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e86ca-bf4b-4785-9a61-1cfd3e5756f5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:42.898838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce13cfe-a0da-4334-89b8-5c90a6075406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:42.899724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce13cfe-a0da-4334-89b8-5c90a6075406 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:42.900008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce13cfe-a0da-4334-89b8-5c90a6075406 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:42.900286 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce13cfe-a0da-4334-89b8-5c90a6075406 None admin] PATH_INFO: `/v3/groups/f3df655c346a4006baf350b13be3009a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:42.907070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce13cfe-a0da-4334-89b8-5c90a6075406 None admin] RBAC: Authorizing `identity:get_group(group_id=f3df655c346a4006baf350b13be3009a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:42.908552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce13cfe-a0da-4334-89b8-5c90a6075406 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:42.910728 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 189/379] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:42 2022] GET /identity/v3/groups/f3df655c346a4006baf350b13be3009a => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:42.916250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba221dd-a18d-4acd-b0c2-4f8d1522e2d6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:43.091140 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba221dd-a18d-4acd-b0c2-4f8d1522e2d6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:43.129917 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005dd7a6-8b73-4c82-b9e9-c9ee7948ca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:43.130589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dd7a6-8b73-4c82-b9e9-c9ee7948ca65 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:43.130875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dd7a6-8b73-4c82-b9e9-c9ee7948ca65 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:43.131160 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dd7a6-8b73-4c82-b9e9-c9ee7948ca65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:43.131991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005dd7a6-8b73-4c82-b9e9-c9ee7948ca65 None admin] RBAC: Adding query filter params (group.id=f3df655c346a4006baf350b13be3009a, role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=2831911a3b2e4e6f87ef9844395d784e) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:43.132310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005dd7a6-8b73-4c82-b9e9-c9ee7948ca65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:43.133770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005dd7a6-8b73-4c82-b9e9-c9ee7948ca65 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:43.143823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 191/380] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 11 20:45:42 2022] GET /identity/v3/role_assignments?group.id=f3df655c346a4006baf350b13be3009a&scope.project.id=2831911a3b2e4e6f87ef9844395d784e&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:43.176742 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d278915-5daa-437b-99b6-b6f80fb55af7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:43.177368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d278915-5daa-437b-99b6-b6f80fb55af7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:43.177906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d278915-5daa-437b-99b6-b6f80fb55af7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:43.179787 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 190/381] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:43.185885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2787b0-680f-4b0d-a863-4a5cb9c7c5ae None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:43.186454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2787b0-680f-4b0d-a863-4a5cb9c7c5ae None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:43.186963 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2787b0-680f-4b0d-a863-4a5cb9c7c5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:43.210894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fe2787b0-680f-4b0d-a863-4a5cb9c7c5ae None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:43.212521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fe2787b0-680f-4b0d-a863-4a5cb9c7c5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:43.304258 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 192/382] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:43.336295 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d278915-5daa-437b-99b6-b6f80fb55af7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:43.487443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d278915-5daa-437b-99b6-b6f80fb55af7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:43.527713 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e429c2-f92a-442f-8b9c-56aa9f5634b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:43.528533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e429c2-f92a-442f-8b9c-56aa9f5634b2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:43.528868 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e429c2-f92a-442f-8b9c-56aa9f5634b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:43.529147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e429c2-f92a-442f-8b9c-56aa9f5634b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:43.539662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e429c2-f92a-442f-8b9c-56aa9f5634b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f8e429c2-f92a-442f-8b9c-56aa9f5634b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:43.548103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:43.548988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:43.549846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:43.549846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:43.549846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:43.549846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:43.549846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:43.549846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:43.549846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:43.549846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:43.549846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:43.549846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:43.549846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:43.549846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:43.549846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 191/383] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:45:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:43.556947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2787b0-680f-4b0d-a863-4a5cb9c7c5ae None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:43.674777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2787b0-680f-4b0d-a863-4a5cb9c7c5ae None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:43.717881 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1362a3f-3dc8-4dbd-a477-223de073f853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:43.718857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1362a3f-3dc8-4dbd-a477-223de073f853 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:43.719343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1362a3f-3dc8-4dbd-a477-223de073f853 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:43.719815 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1362a3f-3dc8-4dbd-a477-223de073f853 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:43.720798 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1362a3f-3dc8-4dbd-a477-223de073f853 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:43.721342 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1362a3f-3dc8-4dbd-a477-223de073f853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:43.722925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1362a3f-3dc8-4dbd-a477-223de073f853 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:43.733806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 193/384] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:45:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:43.739072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1362a3f-3dc8-4dbd-a477-223de073f853 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:43.739499 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b6d6d-a223-4083-9496-7810a26ea554 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:43.739886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b6d6d-a223-4083-9496-7810a26ea554 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:43.740316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b6d6d-a223-4083-9496-7810a26ea554 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:43.742049 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 192/385] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:43.746963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abec541-5cc5-4b70-8baa-92e69fc9317d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:43.747321 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abec541-5cc5-4b70-8baa-92e69fc9317d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:43.747722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abec541-5cc5-4b70-8baa-92e69fc9317d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:43.780796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3abec541-5cc5-4b70-8baa-92e69fc9317d None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:43.782123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3abec541-5cc5-4b70-8baa-92e69fc9317d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:43.882577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1362a3f-3dc8-4dbd-a477-223de073f853 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:43.917221 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 193/386] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:45:43.931356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798c0f3-aeca-419a-84b0-be289938a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:43.932222 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798c0f3-aeca-419a-84b0-be289938a6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:43.932503 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798c0f3-aeca-419a-84b0-be289938a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:43.932773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798c0f3-aeca-419a-84b0-be289938a6d3 None admin] PATH_INFO: `/v3/groups/fee03e2ffe74487f86275873337addeb` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:43.933965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798c0f3-aeca-419a-84b0-be289938a6d3 None admin] RBAC: Authorizing `identity:get_group(group_id=fee03e2ffe74487f86275873337addeb)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:43.935982 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798c0f3-aeca-419a-84b0-be289938a6d3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:43.937881 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 194/387] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:43 2022] GET /identity/v3/groups/fee03e2ffe74487f86275873337addeb => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:43.943404 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abec541-5cc5-4b70-8baa-92e69fc9317d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:43.955949 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798c0f3-aeca-419a-84b0-be289938a6d3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:44.106678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abec541-5cc5-4b70-8baa-92e69fc9317d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:44.145521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798c0f3-aeca-419a-84b0-be289938a6d3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:44.155125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534d12e-bc3f-4364-8b4c-a582b796589c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:44.157559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534d12e-bc3f-4364-8b4c-a582b796589c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:44.157559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534d12e-bc3f-4364-8b4c-a582b796589c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:44.157559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534d12e-bc3f-4364-8b4c-a582b796589c None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:44.158203 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534d12e-bc3f-4364-8b4c-a582b796589c None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:44.159666 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534d12e-bc3f-4364-8b4c-a582b796589c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:44.162078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 194/388] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:43 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:44.167848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534d12e-bc3f-4364-8b4c-a582b796589c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:44.211574 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53de12a-bad5-47e3-b32e-de3dedefcdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:44.212374 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53de12a-bad5-47e3-b32e-de3dedefcdbc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:44.213354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53de12a-bad5-47e3-b32e-de3dedefcdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:44.213661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53de12a-bad5-47e3-b32e-de3dedefcdbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:44.236782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53de12a-bad5-47e3-b32e-de3dedefcdbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d53de12a-bad5-47e3-b32e-de3dedefcdbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:44.245618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:44.246511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:44.248345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:44.248345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:44.248345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:44.248345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:44.248345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:44.248345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:44.248345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:44.248345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:44.248345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:44.248345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:44.248345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:44.248345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:44.248345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 195/389] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:45:44.258857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53de12a-bad5-47e3-b32e-de3dedefcdbc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:44.380500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53de12a-bad5-47e3-b32e-de3dedefcdbc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:44.387675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534d12e-bc3f-4364-8b4c-a582b796589c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:44.417899 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4448c36-5b10-4645-b48b-a5fd5f13a418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:44.418715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4448c36-5b10-4645-b48b-a5fd5f13a418 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:44.419004 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4448c36-5b10-4645-b48b-a5fd5f13a418 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:44.419323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4448c36-5b10-4645-b48b-a5fd5f13a418 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:44.420067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4448c36-5b10-4645-b48b-a5fd5f13a418 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:44.420460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4448c36-5b10-4645-b48b-a5fd5f13a418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:44.422111 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4448c36-5b10-4645-b48b-a5fd5f13a418 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:44.432071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 196/390] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:44.441708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4448c36-5b10-4645-b48b-a5fd5f13a418 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:44.455351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aa7ab-8b09-47fc-b5dc-5646780632e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:44.456552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aa7ab-8b09-47fc-b5dc-5646780632e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:44.457087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aa7ab-8b09-47fc-b5dc-5646780632e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:44.457601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aa7ab-8b09-47fc-b5dc-5646780632e9 None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7/groups/fee03e2ffe74487f86275873337addeb/roles/6437cf432fe44cc28aa54208759f1265` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:44.464216 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8aa7ab-8b09-47fc-b5dc-5646780632e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=07752e1fa91d4fec8615e3b11c555cb7, group_id=fee03e2ffe74487f86275873337addeb, role_id=6437cf432fe44cc28aa54208759f1265)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:44.466022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8aa7ab-8b09-47fc-b5dc-5646780632e9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:44.550204 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4448c36-5b10-4645-b48b-a5fd5f13a418 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:44.560054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 195/391] 10.222.0.35 () {58 vars in 1442 bytes} [Wed May 11 20:45:44 2022] PUT /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7/groups/fee03e2ffe74487f86275873337addeb/roles/6437cf432fe44cc28aa54208759f1265 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:44.588846 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048dc45-3191-4802-878a-8c18644db17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:44.589762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048dc45-3191-4802-878a-8c18644db17c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:44.590052 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048dc45-3191-4802-878a-8c18644db17c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:44.590335 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048dc45-3191-4802-878a-8c18644db17c None admin] PATH_INFO: `/v3/groups/fee03e2ffe74487f86275873337addeb` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:44.591677 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048dc45-3191-4802-878a-8c18644db17c None admin] RBAC: Authorizing `identity:get_group(group_id=fee03e2ffe74487f86275873337addeb)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:44.593160 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048dc45-3191-4802-878a-8c18644db17c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:44.595227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 197/392] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:44 2022] GET /identity/v3/groups/fee03e2ffe74487f86275873337addeb => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:44.600961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aa7ab-8b09-47fc-b5dc-5646780632e9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:44.734174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aa7ab-8b09-47fc-b5dc-5646780632e9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:44.773152 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a186621-ab36-4adb-adbe-347ac305f082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:44.774379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a186621-ab36-4adb-adbe-347ac305f082 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:44.784154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a186621-ab36-4adb-adbe-347ac305f082 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:44.784154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a186621-ab36-4adb-adbe-347ac305f082 None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:44.784154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a186621-ab36-4adb-adbe-347ac305f082 None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:44.784154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a186621-ab36-4adb-adbe-347ac305f082 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:44.784154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 196/393] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:44 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:44.786083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048dc45-3191-4802-878a-8c18644db17c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:44.831182 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ab5c4-0405-4e00-8444-c0c51b4b29a3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:44.831807 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ab5c4-0405-4e00-8444-c0c51b4b29a3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:44.832266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ab5c4-0405-4e00-8444-c0c51b4b29a3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:44.834254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 197/394] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:45:44.845406 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970e924-b4cd-4876-bd92-94322d87d37f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:44.845681 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970e924-b4cd-4876-bd92-94322d87d37f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:44.845858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970e924-b4cd-4876-bd92-94322d87d37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:44.868210 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2970e924-b4cd-4876-bd92-94322d87d37f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:44.870024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2970e924-b4cd-4876-bd92-94322d87d37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:44.937275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048dc45-3191-4802-878a-8c18644db17c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:44.976555 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c2a63-7413-48ad-a5d6-2ca996f6065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:44.977454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c2a63-7413-48ad-a5d6-2ca996f6065d None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:44.977782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c2a63-7413-48ad-a5d6-2ca996f6065d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:44.978056 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c2a63-7413-48ad-a5d6-2ca996f6065d None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7/groups/fee03e2ffe74487f86275873337addeb/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:44.980016 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c2a63-7413-48ad-a5d6-2ca996f6065d None admin] RBAC: Authorizing `identity:create_grant(project_id=07752e1fa91d4fec8615e3b11c555cb7, group_id=fee03e2ffe74487f86275873337addeb, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:44.981499 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c2a63-7413-48ad-a5d6-2ca996f6065d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:44.989068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 198/395] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:45.010985 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970e924-b4cd-4876-bd92-94322d87d37f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:45.090919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 198/396] 10.222.0.35 () {58 vars in 1442 bytes} [Wed May 11 20:45:44 2022] PUT /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7/groups/fee03e2ffe74487f86275873337addeb/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:45.124913 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970e924-b4cd-4876-bd92-94322d87d37f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:45.163934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d60197-b1ce-4173-b91b-e845cb615fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:45.164752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d60197-b1ce-4173-b91b-e845cb615fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:45.165035 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d60197-b1ce-4173-b91b-e845cb615fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:45.165308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d60197-b1ce-4173-b91b-e845cb615fe5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:45.178256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d60197-b1ce-4173-b91b-e845cb615fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c0d60197-b1ce-4173-b91b-e845cb615fe5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:45.186361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:45.187306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:45.188109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:45.188109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:45.188109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:45.188109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:45.188109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:45.188109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:45.188109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:45.188109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:45.188109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:45.188109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:45.188109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:45.188109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:45.188109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 199/397] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:45.196877 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c2a63-7413-48ad-a5d6-2ca996f6065d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:45.305613 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c2a63-7413-48ad-a5d6-2ca996f6065d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:45.342570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9854e82-3d22-4e55-8a36-56a208902f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:45.343263 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9854e82-3d22-4e55-8a36-56a208902f60 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:45.343587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9854e82-3d22-4e55-8a36-56a208902f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:45.343876 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9854e82-3d22-4e55-8a36-56a208902f60 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:45.344644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9854e82-3d22-4e55-8a36-56a208902f60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:45.344954 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9854e82-3d22-4e55-8a36-56a208902f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:45.346419 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9854e82-3d22-4e55-8a36-56a208902f60 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:45.356110 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 199/398] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:45.361958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d60197-b1ce-4173-b91b-e845cb615fe5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:45.467962 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d60197-b1ce-4173-b91b-e845cb615fe5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:45.503446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7b07d-9242-4ff0-9085-0d6b73afcbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:45.504373 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b07d-9242-4ff0-9085-0d6b73afcbfa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:45.504661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b07d-9242-4ff0-9085-0d6b73afcbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:45.504940 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b07d-9242-4ff0-9085-0d6b73afcbfa None admin] PATH_INFO: `/v3/groups/fee03e2ffe74487f86275873337addeb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:45.506151 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7b07d-9242-4ff0-9085-0d6b73afcbfa None admin] RBAC: Authorizing `identity:get_group(group_id=fee03e2ffe74487f86275873337addeb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:45.507606 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7b07d-9242-4ff0-9085-0d6b73afcbfa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:45.509559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 200/399] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:45 2022] GET /identity/v3/groups/fee03e2ffe74487f86275873337addeb => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:45.515541 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9854e82-3d22-4e55-8a36-56a208902f60 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:45.640473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9854e82-3d22-4e55-8a36-56a208902f60 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:45.674185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceba04e-9a93-4567-ba4b-598125c95a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:45.675059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceba04e-9a93-4567-ba4b-598125c95a97 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:45.675344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceba04e-9a93-4567-ba4b-598125c95a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:45.675621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceba04e-9a93-4567-ba4b-598125c95a97 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:45.676807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceba04e-9a93-4567-ba4b-598125c95a97 None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:45.678283 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceba04e-9a93-4567-ba4b-598125c95a97 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:45.680366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 200/400] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:45 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:45.686586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7b07d-9242-4ff0-9085-0d6b73afcbfa None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:45.832362 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7b07d-9242-4ff0-9085-0d6b73afcbfa None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:45.879592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a5522-92f9-4e45-a129-e6170b4bde19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:45.880831 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a5522-92f9-4e45-a129-e6170b4bde19 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:45.881332 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a5522-92f9-4e45-a129-e6170b4bde19 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:45.881836 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a5522-92f9-4e45-a129-e6170b4bde19 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618/groups/fee03e2ffe74487f86275873337addeb/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:45.885923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a5522-92f9-4e45-a129-e6170b4bde19 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4df84ef89b243829f2a079628e9e618, group_id=fee03e2ffe74487f86275873337addeb, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:45.887617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a5522-92f9-4e45-a129-e6170b4bde19 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:46.008268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 201/401] 10.222.0.35 () {58 vars in 1442 bytes} [Wed May 11 20:45:45 2022] PUT /identity/v3/projects/e4df84ef89b243829f2a079628e9e618/groups/fee03e2ffe74487f86275873337addeb/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:46.037327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b5044-1e07-4b66-a230-042f29e61292 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:46.037868 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b5044-1e07-4b66-a230-042f29e61292 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:46.037974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b5044-1e07-4b66-a230-042f29e61292 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:46.039553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 201/402] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:46.046652 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094ab1d-2199-477b-8e8b-57991c1ffa68 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:46.047042 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094ab1d-2199-477b-8e8b-57991c1ffa68 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:46.047378 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094ab1d-2199-477b-8e8b-57991c1ffa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:46.054924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05703c3c-ccb9-4af4-8d23-81f1136669f6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:46.055357 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05703c3c-ccb9-4af4-8d23-81f1136669f6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:46.055704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05703c3c-ccb9-4af4-8d23-81f1136669f6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:46.057828 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 202/403] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:45:46.063482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddaa69-19c3-4958-9744-28d3e4d38713 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:46.063790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddaa69-19c3-4958-9744-28d3e4d38713 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:46.064049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddaa69-19c3-4958-9744-28d3e4d38713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:46.084216 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b094ab1d-2199-477b-8e8b-57991c1ffa68 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:46.085453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b094ab1d-2199-477b-8e8b-57991c1ffa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:46.096941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-92ddaa69-19c3-4958-9744-28d3e4d38713 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:46.098879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-92ddaa69-19c3-4958-9744-28d3e4d38713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:46.219942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 202/404] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:46.233539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 203/405] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:46.239402 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094ab1d-2199-477b-8e8b-57991c1ffa68 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:46.258539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddaa69-19c3-4958-9744-28d3e4d38713 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:46.356195 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094ab1d-2199-477b-8e8b-57991c1ffa68 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:46.381802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddaa69-19c3-4958-9744-28d3e4d38713 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:46.390851 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff55af5-6970-44e3-ad2f-54382ad0798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:46.391657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff55af5-6970-44e3-ad2f-54382ad0798a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:46.391992 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff55af5-6970-44e3-ad2f-54382ad0798a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:46.392222 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff55af5-6970-44e3-ad2f-54382ad0798a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:46.402915 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff55af5-6970-44e3-ad2f-54382ad0798a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0ff55af5-6970-44e3-ad2f-54382ad0798a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:46.411120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:46.412032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:46.412829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:46.412829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:46.412829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:46.412829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:46.412829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:46.412829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:46.412829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:46.412829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:46.412829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:46.412829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:46.412829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:46.412829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:46.412829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 203/406] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:45:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:46.420684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff55af5-6970-44e3-ad2f-54382ad0798a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:46.429550 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdd473-85fd-49dd-b5f4-7029407d8bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:46.429550 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdd473-85fd-49dd-b5f4-7029407d8bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:46.429550 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdd473-85fd-49dd-b5f4-7029407d8bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:46.429550 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdd473-85fd-49dd-b5f4-7029407d8bd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:46.440113 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdd473-85fd-49dd-b5f4-7029407d8bd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0ffdd473-85fd-49dd-b5f4-7029407d8bd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:46.448459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:46.449356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:46.450232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:46.450232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:46.450232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:46.450232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:46.450232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:46.450232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:46.450232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:46.450232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:46.450232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:46.450232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:46.450232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:46.450232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:46.450232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 204/407] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:45:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:45:46.455902 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdd473-85fd-49dd-b5f4-7029407d8bd5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:46.577783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff55af5-6970-44e3-ad2f-54382ad0798a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:46.585154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdd473-85fd-49dd-b5f4-7029407d8bd5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:46.612922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ade087-eed8-4fd9-80e2-b570014d500d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:46.613639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ade087-eed8-4fd9-80e2-b570014d500d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:46.613932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ade087-eed8-4fd9-80e2-b570014d500d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:46.614215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ade087-eed8-4fd9-80e2-b570014d500d None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:46.614960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ade087-eed8-4fd9-80e2-b570014d500d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:46.615271 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ade087-eed8-4fd9-80e2-b570014d500d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:46.617025 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ade087-eed8-4fd9-80e2-b570014d500d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:46.619362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520031af-5850-4650-9712-164cdafe3443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:46.620032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520031af-5850-4650-9712-164cdafe3443 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:46.620317 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520031af-5850-4650-9712-164cdafe3443 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:46.620593 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520031af-5850-4650-9712-164cdafe3443 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:46.621341 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520031af-5850-4650-9712-164cdafe3443 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:46.621681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520031af-5850-4650-9712-164cdafe3443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:46.623096 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520031af-5850-4650-9712-164cdafe3443 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:46.631296 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 204/408] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:46.631620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 205/409] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:45:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:46.633223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ade087-eed8-4fd9-80e2-b570014d500d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:46.637772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520031af-5850-4650-9712-164cdafe3443 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:46.736215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ade087-eed8-4fd9-80e2-b570014d500d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:46.740701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520031af-5850-4650-9712-164cdafe3443 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:46.771411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2914a30-bde0-42c1-92f2-18f12624d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:46.772394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2914a30-bde0-42c1-92f2-18f12624d526 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:46.772680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2914a30-bde0-42c1-92f2-18f12624d526 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:46.773048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2914a30-bde0-42c1-92f2-18f12624d526 None admin] PATH_INFO: `/v3/groups/f3df655c346a4006baf350b13be3009a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:46.775249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2914a30-bde0-42c1-92f2-18f12624d526 None admin] RBAC: Authorizing `identity:get_group(group_id=f3df655c346a4006baf350b13be3009a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:46.777071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2914a30-bde0-42c1-92f2-18f12624d526 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:46.777393 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9c646-c5cc-49cb-a3f6-30971f80a615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:46.778503 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9c646-c5cc-49cb-a3f6-30971f80a615 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:46.779531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9c646-c5cc-49cb-a3f6-30971f80a615 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:46.780017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9c646-c5cc-49cb-a3f6-30971f80a615 None admin] PATH_INFO: `/v3/groups/fee03e2ffe74487f86275873337addeb` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:46.784172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 205/410] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:46 2022] GET /identity/v3/groups/f3df655c346a4006baf350b13be3009a => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:46.785067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9c646-c5cc-49cb-a3f6-30971f80a615 None admin] RBAC: Authorizing `identity:get_group(group_id=fee03e2ffe74487f86275873337addeb)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:46.785456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2914a30-bde0-42c1-92f2-18f12624d526 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:46.786911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9c646-c5cc-49cb-a3f6-30971f80a615 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:46.791793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 206/411] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:46 2022] GET /identity/v3/groups/fee03e2ffe74487f86275873337addeb => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:46.797098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9c646-c5cc-49cb-a3f6-30971f80a615 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:46.911811 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2914a30-bde0-42c1-92f2-18f12624d526 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:46.959890 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9c646-c5cc-49cb-a3f6-30971f80a615 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:46.970156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418c17d-93ff-4324-91fc-e9d200143629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:46.971316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418c17d-93ff-4324-91fc-e9d200143629 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:46.971818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418c17d-93ff-4324-91fc-e9d200143629 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:46.972291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418c17d-93ff-4324-91fc-e9d200143629 None admin] PATH_INFO: `/v3/projects/2831911a3b2e4e6f87ef9844395d784e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:46.976476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418c17d-93ff-4324-91fc-e9d200143629 None admin] RBAC: Authorizing `identity:get_project(project_id=2831911a3b2e4e6f87ef9844395d784e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:46.978241 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418c17d-93ff-4324-91fc-e9d200143629 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:46.980181 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 206/412] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:46 2022] GET /identity/v3/projects/2831911a3b2e4e6f87ef9844395d784e => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:46.986014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418c17d-93ff-4324-91fc-e9d200143629 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:47.033602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f7185-340d-40d1-b967-d25c7dc0953b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:47.034832 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f7185-340d-40d1-b967-d25c7dc0953b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:47.035383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f7185-340d-40d1-b967-d25c7dc0953b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:47.035872 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f7185-340d-40d1-b967-d25c7dc0953b None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:47.039027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f7185-340d-40d1-b967-d25c7dc0953b None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:47.041137 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f7185-340d-40d1-b967-d25c7dc0953b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:47.043690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 207/413] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:46 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:47.049434 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f7185-340d-40d1-b967-d25c7dc0953b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:47.157941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f7185-340d-40d1-b967-d25c7dc0953b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:47.170965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418c17d-93ff-4324-91fc-e9d200143629 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:47.206223 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb26dc-1270-4d0a-8b72-daab732cfc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:47.207482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb26dc-1270-4d0a-8b72-daab732cfc37 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:47.207997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb26dc-1270-4d0a-8b72-daab732cfc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:47.208472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb26dc-1270-4d0a-8b72-daab732cfc37 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618/groups/fee03e2ffe74487f86275873337addeb/roles/6437cf432fe44cc28aa54208759f1265` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:47.211172 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb26dc-1270-4d0a-8b72-daab732cfc37 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4df84ef89b243829f2a079628e9e618, group_id=fee03e2ffe74487f86275873337addeb, role_id=6437cf432fe44cc28aa54208759f1265)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:47.212851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb26dc-1270-4d0a-8b72-daab732cfc37 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:47.214579 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31de44-1c6a-47da-942d-b62a23965143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:47.215488 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31de44-1c6a-47da-942d-b62a23965143 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:47.215809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31de44-1c6a-47da-942d-b62a23965143 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:47.216050 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31de44-1c6a-47da-942d-b62a23965143 None admin] PATH_INFO: `/v3/projects/2831911a3b2e4e6f87ef9844395d784e/groups/f3df655c346a4006baf350b13be3009a/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:47.225558 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31de44-1c6a-47da-942d-b62a23965143 None admin] RBAC: Authorizing `identity:create_grant(project_id=2831911a3b2e4e6f87ef9844395d784e, group_id=f3df655c346a4006baf350b13be3009a, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:47.225558 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31de44-1c6a-47da-942d-b62a23965143 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:47.292457 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 208/414] 10.222.0.35 () {58 vars in 1442 bytes} [Wed May 11 20:45:47 2022] PUT /identity/v3/projects/e4df84ef89b243829f2a079628e9e618/groups/fee03e2ffe74487f86275873337addeb/roles/6437cf432fe44cc28aa54208759f1265 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:47.321657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 207/415] 10.222.0.35 () {58 vars in 1442 bytes} [Wed May 11 20:45:46 2022] PUT /identity/v3/projects/2831911a3b2e4e6f87ef9844395d784e/groups/f3df655c346a4006baf350b13be3009a/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:45:47.531197 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd92d5-15ca-49a6-a070-18b3bc9f91f4 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:47.531514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd92d5-15ca-49a6-a070-18b3bc9f91f4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:47.531762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd92d5-15ca-49a6-a070-18b3bc9f91f4 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:47.533223 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 209/416] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:47.539367 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42f126-40ff-4dc4-bc07-ef8a8e18e38e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:47.539735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42f126-40ff-4dc4-bc07-ef8a8e18e38e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:47.539935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42f126-40ff-4dc4-bc07-ef8a8e18e38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:47.566801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3c42f126-40ff-4dc4-bc07-ef8a8e18e38e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:47.568051 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3c42f126-40ff-4dc4-bc07-ef8a8e18e38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:47.660628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 208/417] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:47.683683 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd92d5-15ca-49a6-a070-18b3bc9f91f4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:47.823802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd92d5-15ca-49a6-a070-18b3bc9f91f4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:47.875025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd999c4-ea05-4b2e-a219-a7a622254305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:47.875857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd999c4-ea05-4b2e-a219-a7a622254305 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:47.876139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd999c4-ea05-4b2e-a219-a7a622254305 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:47.876723 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd999c4-ea05-4b2e-a219-a7a622254305 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:47.898136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd999c4-ea05-4b2e-a219-a7a622254305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4fd999c4-ea05-4b2e-a219-a7a622254305 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:47.906818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:47.907721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:47.908531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:47.908531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:47.908531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:47.908531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:47.908531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:47.908531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:47.908531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:47.908531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:47.908531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:47.908531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:47.908531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:47.908531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:47.908531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 210/418] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:45:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:47.915259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42f126-40ff-4dc4-bc07-ef8a8e18e38e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:48.042828 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42f126-40ff-4dc4-bc07-ef8a8e18e38e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:48.077781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873a1b5-1986-4c39-850e-58479334f50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:48.078805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873a1b5-1986-4c39-850e-58479334f50f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:48.079284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873a1b5-1986-4c39-850e-58479334f50f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:48.079751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873a1b5-1986-4c39-850e-58479334f50f None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:48.080679 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873a1b5-1986-4c39-850e-58479334f50f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:48.081177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873a1b5-1986-4c39-850e-58479334f50f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:48.082853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873a1b5-1986-4c39-850e-58479334f50f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:48.092130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 209/419] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:45:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:48.097882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd999c4-ea05-4b2e-a219-a7a622254305 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:48.176420 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b32d-4362-4c1b-9afb-272785a875da None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:48.176705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b32d-4362-4c1b-9afb-272785a875da None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:48.177155 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3b32d-4362-4c1b-9afb-272785a875da None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:48.178611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 210/420] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:45:48.184037 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff241-026a-4b1d-a4af-e83dc0330562 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:48.184396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff241-026a-4b1d-a4af-e83dc0330562 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:48.184775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff241-026a-4b1d-a4af-e83dc0330562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:48.209575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f13ff241-026a-4b1d-a4af-e83dc0330562 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:48.210841 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f13ff241-026a-4b1d-a4af-e83dc0330562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:48.251622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd999c4-ea05-4b2e-a219-a7a622254305 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:48.279217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 211/421] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:45:48.296370 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92313691-6052-43d1-810e-71fb5c0116a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:48.297031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92313691-6052-43d1-810e-71fb5c0116a6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:48.297316 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92313691-6052-43d1-810e-71fb5c0116a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:48.297620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92313691-6052-43d1-810e-71fb5c0116a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:48.330893 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ff241-026a-4b1d-a4af-e83dc0330562 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:48.446290 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ff241-026a-4b1d-a4af-e83dc0330562 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:48.449598 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92313691-6052-43d1-810e-71fb5c0116a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:48.451113 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92313691-6052-43d1-810e-71fb5c0116a6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:48.484538 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16478f-e2d6-41d5-a249-62f44a56ff05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:48.485342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16478f-e2d6-41d5-a249-62f44a56ff05 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:48.485651 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16478f-e2d6-41d5-a249-62f44a56ff05 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:48.485926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16478f-e2d6-41d5-a249-62f44a56ff05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:48.496700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16478f-e2d6-41d5-a249-62f44a56ff05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-aa16478f-e2d6-41d5-a249-62f44a56ff05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:48.505878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:48.506813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:48.508275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:48.508275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:48.508275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:48.508275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:48.508275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:48.508275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:48.508275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:48.508275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:48.508275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:48.508275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:48.508275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:48.508275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:48.508275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 212/422] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:45:48.514845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16478f-e2d6-41d5-a249-62f44a56ff05 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:48.617888 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 211/423] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:48.623684 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92313691-6052-43d1-810e-71fb5c0116a6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:48.736338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92313691-6052-43d1-810e-71fb5c0116a6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:48.750937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16478f-e2d6-41d5-a249-62f44a56ff05 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:48.784028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429e40c-f222-4e25-ad15-9fc1c7b7e7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:48.785336 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429e40c-f222-4e25-ad15-9fc1c7b7e7dc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:48.785552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd88d0-dec4-4844-b2fe-6200208361b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:48.786085 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429e40c-f222-4e25-ad15-9fc1c7b7e7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:48.786426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd88d0-dec4-4844-b2fe-6200208361b1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:48.786711 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd88d0-dec4-4844-b2fe-6200208361b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:48.786980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd88d0-dec4-4844-b2fe-6200208361b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:48.787258 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429e40c-f222-4e25-ad15-9fc1c7b7e7dc None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:48.787727 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd88d0-dec4-4844-b2fe-6200208361b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:48.788038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd88d0-dec4-4844-b2fe-6200208361b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:48.789091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429e40c-f222-4e25-ad15-9fc1c7b7e7dc None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:48.789399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd88d0-dec4-4844-b2fe-6200208361b1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:48.791021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429e40c-f222-4e25-ad15-9fc1c7b7e7dc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:48.793209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 212/424] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:48 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:48.795179 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bc3e7-99e3-451a-8cc1-e4ad1cecae61 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:48.795687 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bc3e7-99e3-451a-8cc1-e4ad1cecae61 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:48.796188 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bc3e7-99e3-451a-8cc1-e4ad1cecae61 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:48.801746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 213/425] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:48.802658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 213/426] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:48.803526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faf845-78ee-42a3-894f-55077e2de445 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:48.804037 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faf845-78ee-42a3-894f-55077e2de445 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:48.804208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd88d0-dec4-4844-b2fe-6200208361b1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:48.804671 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faf845-78ee-42a3-894f-55077e2de445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:48.827421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a8faf845-78ee-42a3-894f-55077e2de445 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:48.829042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a8faf845-78ee-42a3-894f-55077e2de445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:48.905743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 214/427] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:48.907166 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faf845-78ee-42a3-894f-55077e2de445 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:48.911562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd88d0-dec4-4844-b2fe-6200208361b1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:48.947356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f062d-2474-4d52-9f54-3c48b64ec40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:48.948230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f062d-2474-4d52-9f54-3c48b64ec40c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:48.948398 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f062d-2474-4d52-9f54-3c48b64ec40c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:48.948676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f062d-2474-4d52-9f54-3c48b64ec40c None admin] PATH_INFO: `/v3/groups/fee03e2ffe74487f86275873337addeb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:48.954174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f062d-2474-4d52-9f54-3c48b64ec40c None admin] RBAC: Authorizing `identity:get_group(group_id=fee03e2ffe74487f86275873337addeb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:48.954174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f062d-2474-4d52-9f54-3c48b64ec40c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:48.954174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 214/428] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:48 2022] GET /identity/v3/groups/fee03e2ffe74487f86275873337addeb => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:48.958834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f062d-2474-4d52-9f54-3c48b64ec40c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:49.030979 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faf845-78ee-42a3-894f-55077e2de445 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:49.060762 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f062d-2474-4d52-9f54-3c48b64ec40c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:49.065258 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb7c83-5f1d-4e15-a2e0-62d38c65f976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:49.066199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb7c83-5f1d-4e15-a2e0-62d38c65f976 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:49.066684 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb7c83-5f1d-4e15-a2e0-62d38c65f976 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:49.067155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb7c83-5f1d-4e15-a2e0-62d38c65f976 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:49.094603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242431b-c5aa-4bca-9dcf-de22f7d8de85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:49.095312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242431b-c5aa-4bca-9dcf-de22f7d8de85 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:49.095595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242431b-c5aa-4bca-9dcf-de22f7d8de85 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:49.095872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242431b-c5aa-4bca-9dcf-de22f7d8de85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:49.096745 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242431b-c5aa-4bca-9dcf-de22f7d8de85 None admin] RBAC: Adding query filter params (group.id=fee03e2ffe74487f86275873337addeb, role.id=6437cf432fe44cc28aa54208759f1265, scope.project.id=07752e1fa91d4fec8615e3b11c555cb7) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:49.097298 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242431b-c5aa-4bca-9dcf-de22f7d8de85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:49.098500 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242431b-c5aa-4bca-9dcf-de22f7d8de85 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:49.104533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 215/429] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 11 20:45:48 2022] GET /identity/v3/role_assignments?group.id=fee03e2ffe74487f86275873337addeb&scope.project.id=07752e1fa91d4fec8615e3b11c555cb7&role.id=6437cf432fe44cc28aa54208759f1265 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:49.105056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242431b-c5aa-4bca-9dcf-de22f7d8de85 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:49.138603 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb7c83-5f1d-4e15-a2e0-62d38c65f976 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:49.140803 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb7c83-5f1d-4e15-a2e0-62d38c65f976 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:49.243535 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 215/430] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:49.250085 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb7c83-5f1d-4e15-a2e0-62d38c65f976 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:49.300548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242431b-c5aa-4bca-9dcf-de22f7d8de85 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:49.355356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb7c83-5f1d-4e15-a2e0-62d38c65f976 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:49.370391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6adc6c-fde6-4ddf-8a12-54e7613311cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:49.371229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6adc6c-fde6-4ddf-8a12-54e7613311cd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:49.371516 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6adc6c-fde6-4ddf-8a12-54e7613311cd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:49.371795 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6adc6c-fde6-4ddf-8a12-54e7613311cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:49.386998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6adc6c-fde6-4ddf-8a12-54e7613311cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1b6adc6c-fde6-4ddf-8a12-54e7613311cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:49.395926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:49.396839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:49.397709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:49.397709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:49.397709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:49.397709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:49.397709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:49.397709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:49.397709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:49.397709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:49.397709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:49.397709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:49.397709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 11 20:45:49.397709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:49.399010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2248286-f21b-4c1e-af9b-6e47d6022dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:49.400109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248286-f21b-4c1e-af9b-6e47d6022dee None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:49.400586 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248286-f21b-4c1e-af9b-6e47d6022dee None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:49.401056 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248286-f21b-4c1e-af9b-6e47d6022dee None admin] PATH_INFO: `/v3/projects/07752e1fa91d4fec8615e3b11c555cb7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:49.402570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2248286-f21b-4c1e-af9b-6e47d6022dee None admin] RBAC: Authorizing `identity:get_project(project_id=07752e1fa91d4fec8615e3b11c555cb7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:49.404770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2248286-f21b-4c1e-af9b-6e47d6022dee None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:49.405337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 216/431] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:49.406683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6adc6c-fde6-4ddf-8a12-54e7613311cd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:49.407410 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 216/432] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:49 2022] GET /identity/v3/projects/07752e1fa91d4fec8615e3b11c555cb7 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:49.412777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2248286-f21b-4c1e-af9b-6e47d6022dee None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:49.518867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6adc6c-fde6-4ddf-8a12-54e7613311cd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:49.533430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2248286-f21b-4c1e-af9b-6e47d6022dee None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:49.566311 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c61769-d9cf-46a0-ad79-8673251a183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:49.566986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c61769-d9cf-46a0-ad79-8673251a183c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:49.567268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c61769-d9cf-46a0-ad79-8673251a183c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:49.567540 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c61769-d9cf-46a0-ad79-8673251a183c None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:49.568292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c61769-d9cf-46a0-ad79-8673251a183c None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:49.568599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c61769-d9cf-46a0-ad79-8673251a183c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:49.570013 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c61769-d9cf-46a0-ad79-8673251a183c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:49.575635 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ca71d-f0a8-4e30-91a0-a6107e4fa8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:49.576532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ca71d-f0a8-4e30-91a0-a6107e4fa8ff None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:49.576821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ca71d-f0a8-4e30-91a0-a6107e4fa8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:49.577093 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ca71d-f0a8-4e30-91a0-a6107e4fa8ff None admin] PATH_INFO: `/v3/groups/fee03e2ffe74487f86275873337addeb` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:49.578335 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ca71d-f0a8-4e30-91a0-a6107e4fa8ff None admin] RBAC: Authorizing `identity:get_group(group_id=fee03e2ffe74487f86275873337addeb)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:49.579795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ca71d-f0a8-4e30-91a0-a6107e4fa8ff None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:49.584253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 217/434] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:49 2022] GET /identity/v3/groups/fee03e2ffe74487f86275873337addeb => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:49.584460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 217/434] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:45:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:49.593652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ca71d-f0a8-4e30-91a0-a6107e4fa8ff None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:49.593800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c61769-d9cf-46a0-ad79-8673251a183c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:49.705518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c61769-d9cf-46a0-ad79-8673251a183c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:49.705729 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ca71d-f0a8-4e30-91a0-a6107e4fa8ff None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:49.741392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e154e4-e641-4a5f-8a35-c0359425c1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:49.742080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e154e4-e641-4a5f-8a35-c0359425c1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:49.742366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e154e4-e641-4a5f-8a35-c0359425c1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:49.742643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e154e4-e641-4a5f-8a35-c0359425c1e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:49.743470 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e154e4-e641-4a5f-8a35-c0359425c1e9 None admin] RBAC: Adding query filter params (group.id=fee03e2ffe74487f86275873337addeb, role.id=a211713995b7409ca158916c665f73b6, scope.project.id=07752e1fa91d4fec8615e3b11c555cb7) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:49.743784 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e154e4-e641-4a5f-8a35-c0359425c1e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:49.745214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e154e4-e641-4a5f-8a35-c0359425c1e9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:49.748022 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64823fa3-7db0-429d-99a6-713157299ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:49.748928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64823fa3-7db0-429d-99a6-713157299ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:49.749423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64823fa3-7db0-429d-99a6-713157299ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:49.749934 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64823fa3-7db0-429d-99a6-713157299ef7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:49.757555 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 218/435] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 11 20:45:49 2022] GET /identity/v3/role_assignments?group.id=fee03e2ffe74487f86275873337addeb&scope.project.id=07752e1fa91d4fec8615e3b11c555cb7&role.id=a211713995b7409ca158916c665f73b6 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:49.836802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64823fa3-7db0-429d-99a6-713157299ef7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:49.838344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64823fa3-7db0-429d-99a6-713157299ef7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:49.955686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 218/436] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:49.961000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e154e4-e641-4a5f-8a35-c0359425c1e9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:50.055298 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160467f8-5bec-4874-b3f2-ff39878e58d4 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:50.055589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160467f8-5bec-4874-b3f2-ff39878e58d4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:50.055868 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160467f8-5bec-4874-b3f2-ff39878e58d4 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:50.057421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 219/437] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:45:50.062485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6480923-640a-4bb3-aa12-77b7399325ec None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:50.062770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6480923-640a-4bb3-aa12-77b7399325ec None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:50.063063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6480923-640a-4bb3-aa12-77b7399325ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:50.075087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e154e4-e641-4a5f-8a35-c0359425c1e9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:50.079983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c6480923-640a-4bb3-aa12-77b7399325ec None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:50.081172 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c6480923-640a-4bb3-aa12-77b7399325ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:50.117077 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8303c-40b2-4b72-9f93-7fe21ad06ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:50.117951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8303c-40b2-4b72-9f93-7fe21ad06ffa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:50.118233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8303c-40b2-4b72-9f93-7fe21ad06ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:50.118508 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8303c-40b2-4b72-9f93-7fe21ad06ffa None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:50.120258 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8303c-40b2-4b72-9f93-7fe21ad06ffa None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:50.121862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8303c-40b2-4b72-9f93-7fe21ad06ffa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:50.124109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 219/438] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:49 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:50.125313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8c87f-40ce-4307-82d1-7cf1c2c6c36e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:50.127379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8c87f-40ce-4307-82d1-7cf1c2c6c36e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:50.127379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8c87f-40ce-4307-82d1-7cf1c2c6c36e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:50.127379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 220/439] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:50.130444 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8c87f-40ce-4307-82d1-7cf1c2c6c36e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:50.160573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 220/440] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:45:50.162576 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cfda1-3403-4208-b5ee-01a57a76d76d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:50.163057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cfda1-3403-4208-b5ee-01a57a76d76d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:50.163339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cfda1-3403-4208-b5ee-01a57a76d76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:50.182672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c28cfda1-3403-4208-b5ee-01a57a76d76d None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:50.184159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c28cfda1-3403-4208-b5ee-01a57a76d76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:50.242491 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8c87f-40ce-4307-82d1-7cf1c2c6c36e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:50.257939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 221/441] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:50.258868 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cfda1-3403-4208-b5ee-01a57a76d76d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:50.282635 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeb5bc-328c-4ffc-b413-c122aa35edc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:50.283493 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeb5bc-328c-4ffc-b413-c122aa35edc0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:50.283775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeb5bc-328c-4ffc-b413-c122aa35edc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:50.284052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeb5bc-328c-4ffc-b413-c122aa35edc0 None admin] PATH_INFO: `/v3/groups/fee03e2ffe74487f86275873337addeb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:50.285219 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeb5bc-328c-4ffc-b413-c122aa35edc0 None admin] RBAC: Authorizing `identity:get_group(group_id=fee03e2ffe74487f86275873337addeb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:50.286726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeb5bc-328c-4ffc-b413-c122aa35edc0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:50.288642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 221/442] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:50 2022] GET /identity/v3/groups/fee03e2ffe74487f86275873337addeb => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:50.289421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeb5bc-328c-4ffc-b413-c122aa35edc0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:50.369775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cfda1-3403-4208-b5ee-01a57a76d76d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:50.398185 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeb5bc-328c-4ffc-b413-c122aa35edc0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:50.402704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e26a1f-2aee-4765-9ef4-ea2856bc1862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:50.403532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e26a1f-2aee-4765-9ef4-ea2856bc1862 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:50.403815 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e26a1f-2aee-4765-9ef4-ea2856bc1862 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:50.404092 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e26a1f-2aee-4765-9ef4-ea2856bc1862 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:50.413637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e26a1f-2aee-4765-9ef4-ea2856bc1862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f0e26a1f-2aee-4765-9ef4-ea2856bc1862 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:50.421244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:50.422214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:50.423042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:50.423042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:50.423042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:50.423042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:50.423042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:50.423042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:50.423042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:50.423042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:50.423042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:50.423042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:50.423042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:45:50.423042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:50.423042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 222/443] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:45:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:50.423715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e26a1f-2aee-4765-9ef4-ea2856bc1862 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:50.432598 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480db60a-afcb-420b-b85b-bd032d203f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:50.433397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480db60a-afcb-420b-b85b-bd032d203f20 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:50.433722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480db60a-afcb-420b-b85b-bd032d203f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:50.433997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480db60a-afcb-420b-b85b-bd032d203f20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:50.444304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480db60a-afcb-420b-b85b-bd032d203f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-480db60a-afcb-420b-b85b-bd032d203f20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:50.452885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:50.453805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:50.454622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:50.454622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:50.454622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:50.454622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:50.454622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:50.454622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:50.454622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:50.454622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:50.454622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:50.454622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:50.454622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:50.454622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:50.454622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 222/444] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:45:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:50.455282 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480db60a-afcb-420b-b85b-bd032d203f20 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:50.517348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e26a1f-2aee-4765-9ef4-ea2856bc1862 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:50.548869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349d8a4-ea68-47b0-b7aa-0b86da846e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:50.549513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349d8a4-ea68-47b0-b7aa-0b86da846e31 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:50.549673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480db60a-afcb-420b-b85b-bd032d203f20 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:50.549824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349d8a4-ea68-47b0-b7aa-0b86da846e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:50.550108 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349d8a4-ea68-47b0-b7aa-0b86da846e31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:50.550932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349d8a4-ea68-47b0-b7aa-0b86da846e31 None admin] RBAC: Adding query filter params (group.id=fee03e2ffe74487f86275873337addeb, role.id=a211713995b7409ca158916c665f73b6, scope.project.id=e4df84ef89b243829f2a079628e9e618) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:50.551247 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349d8a4-ea68-47b0-b7aa-0b86da846e31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:50.552686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349d8a4-ea68-47b0-b7aa-0b86da846e31 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:50.558230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 223/445] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 11 20:45:50 2022] GET /identity/v3/role_assignments?group.id=fee03e2ffe74487f86275873337addeb&scope.project.id=e4df84ef89b243829f2a079628e9e618&role.id=a211713995b7409ca158916c665f73b6 => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:50.558997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349d8a4-ea68-47b0-b7aa-0b86da846e31 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:50.595584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652079f2-2048-4b70-8c95-163f47b19ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:50.596318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652079f2-2048-4b70-8c95-163f47b19ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:50.596622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652079f2-2048-4b70-8c95-163f47b19ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:50.596931 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652079f2-2048-4b70-8c95-163f47b19ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:50.597800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652079f2-2048-4b70-8c95-163f47b19ce5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:50.598146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652079f2-2048-4b70-8c95-163f47b19ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:50.599882 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652079f2-2048-4b70-8c95-163f47b19ce5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:50.615173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 223/446] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:45:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:50.616174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652079f2-2048-4b70-8c95-163f47b19ce5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:50.673118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349d8a4-ea68-47b0-b7aa-0b86da846e31 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:50.707720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb7a0f-9887-4e79-a83c-79f93023d626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:50.708404 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7a0f-9887-4e79-a83c-79f93023d626 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:50.708686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7a0f-9887-4e79-a83c-79f93023d626 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:50.708964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7a0f-9887-4e79-a83c-79f93023d626 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:50.709761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb7a0f-9887-4e79-a83c-79f93023d626 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:50.710073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb7a0f-9887-4e79-a83c-79f93023d626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:50.711487 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb7a0f-9887-4e79-a83c-79f93023d626 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:50.724773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 224/447] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:45:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:50.724973 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652079f2-2048-4b70-8c95-163f47b19ce5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:50.726091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb7a0f-9887-4e79-a83c-79f93023d626 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:50.760981 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3213dbb-e8ed-427b-b5b0-0fb8182c8357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:50.761665 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3213dbb-e8ed-427b-b5b0-0fb8182c8357 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:50.761947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3213dbb-e8ed-427b-b5b0-0fb8182c8357 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:50.762218 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3213dbb-e8ed-427b-b5b0-0fb8182c8357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:50.835273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb7a0f-9887-4e79-a83c-79f93023d626 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:50.845230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3213dbb-e8ed-427b-b5b0-0fb8182c8357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:50.846761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3213dbb-e8ed-427b-b5b0-0fb8182c8357 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:50.873214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef75a5f-11b1-4610-91ec-c1582d429e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:50.873917 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75a5f-11b1-4610-91ec-c1582d429e2a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:50.874203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75a5f-11b1-4610-91ec-c1582d429e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:50.874486 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef75a5f-11b1-4610-91ec-c1582d429e2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:50.952089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 224/448] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 20:45:50.956897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef75a5f-11b1-4610-91ec-c1582d429e2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:50.957464 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3213dbb-e8ed-427b-b5b0-0fb8182c8357 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:50.958443 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef75a5f-11b1-4610-91ec-c1582d429e2a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:51.050829 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 225/449] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:45:51.051459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3213dbb-e8ed-427b-b5b0-0fb8182c8357 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:51.056506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef75a5f-11b1-4610-91ec-c1582d429e2a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:51.083903 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e63c1-e846-4cdd-b34e-f66c8ddebca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:51.084740 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e63c1-e846-4cdd-b34e-f66c8ddebca3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:51.085021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e63c1-e846-4cdd-b34e-f66c8ddebca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:51.085293 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e63c1-e846-4cdd-b34e-f66c8ddebca3 None admin] PATH_INFO: `/v3/projects/2831911a3b2e4e6f87ef9844395d784e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:51.086492 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e63c1-e846-4cdd-b34e-f66c8ddebca3 None admin] RBAC: Authorizing `identity:get_project(project_id=2831911a3b2e4e6f87ef9844395d784e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:51.087935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e63c1-e846-4cdd-b34e-f66c8ddebca3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:51.089615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 225/450] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:50 2022] GET /identity/v3/projects/2831911a3b2e4e6f87ef9844395d784e => generated 344 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:51.095489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e63c1-e846-4cdd-b34e-f66c8ddebca3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:51.148009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef75a5f-11b1-4610-91ec-c1582d429e2a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:51.179928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1104a2-77c1-48fa-972e-c2d185a2fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:51.180795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1104a2-77c1-48fa-972e-c2d185a2fb76 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:51.181090 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1104a2-77c1-48fa-972e-c2d185a2fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:51.181361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1104a2-77c1-48fa-972e-c2d185a2fb76 None admin] PATH_INFO: `/v3/projects/e4df84ef89b243829f2a079628e9e618` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:51.182620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1104a2-77c1-48fa-972e-c2d185a2fb76 None admin] RBAC: Authorizing `identity:get_project(project_id=e4df84ef89b243829f2a079628e9e618)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:51.184054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1104a2-77c1-48fa-972e-c2d185a2fb76 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:51.185749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 226/451] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:45:51 2022] GET /identity/v3/projects/e4df84ef89b243829f2a079628e9e618 => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:51.187259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e63c1-e846-4cdd-b34e-f66c8ddebca3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:51.191010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1104a2-77c1-48fa-972e-c2d185a2fb76 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:51.219424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b938325-75e6-471c-9393-6af11a65462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:51.220199 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b938325-75e6-471c-9393-6af11a65462b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:51.220477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b938325-75e6-471c-9393-6af11a65462b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:51.220748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b938325-75e6-471c-9393-6af11a65462b None admin] PATH_INFO: `/v3/groups/f3df655c346a4006baf350b13be3009a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:51.221940 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b938325-75e6-471c-9393-6af11a65462b None admin] RBAC: Authorizing `identity:get_group(group_id=f3df655c346a4006baf350b13be3009a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:51.223359 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b938325-75e6-471c-9393-6af11a65462b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:51.224941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 226/452] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:51 2022] GET /identity/v3/groups/f3df655c346a4006baf350b13be3009a => generated 229 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:51.230481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b938325-75e6-471c-9393-6af11a65462b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:51.283273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1104a2-77c1-48fa-972e-c2d185a2fb76 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:51.313925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f158912-a37a-4da3-a890-94f5d1a86203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:51.314768 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f158912-a37a-4da3-a890-94f5d1a86203 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:51.315047 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f158912-a37a-4da3-a890-94f5d1a86203 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:51.315319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f158912-a37a-4da3-a890-94f5d1a86203 None admin] PATH_INFO: `/v3/groups/fee03e2ffe74487f86275873337addeb` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:51.316479 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f158912-a37a-4da3-a890-94f5d1a86203 None admin] RBAC: Authorizing `identity:get_group(group_id=fee03e2ffe74487f86275873337addeb)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:51.317944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f158912-a37a-4da3-a890-94f5d1a86203 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:51.319522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 227/453] 10.222.0.35 () {56 vars in 1180 bytes} [Wed May 11 20:45:51 2022] GET /identity/v3/groups/fee03e2ffe74487f86275873337addeb => generated 226 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:51.321637 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b938325-75e6-471c-9393-6af11a65462b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:51.325712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f158912-a37a-4da3-a890-94f5d1a86203 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:51.354508 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d4984-866a-48c8-9181-1f183fff93f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:51.355146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d4984-866a-48c8-9181-1f183fff93f8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:51.355431 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d4984-866a-48c8-9181-1f183fff93f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:51.355706 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d4984-866a-48c8-9181-1f183fff93f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:51.356525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d4984-866a-48c8-9181-1f183fff93f8 None admin] RBAC: Adding query filter params (group.id=f3df655c346a4006baf350b13be3009a, role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=2831911a3b2e4e6f87ef9844395d784e) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:51.356837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d4984-866a-48c8-9181-1f183fff93f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:51.358305 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d4984-866a-48c8-9181-1f183fff93f8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:51.363858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 227/454] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 11 20:45:51 2022] GET /identity/v3/role_assignments?group.id=f3df655c346a4006baf350b13be3009a&scope.project.id=2831911a3b2e4e6f87ef9844395d784e&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:51.422653 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f158912-a37a-4da3-a890-94f5d1a86203 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:51.457908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749d6b4-eb7c-4ca3-8db5-6b6bb7fe0ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:51.458574 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d6b4-eb7c-4ca3-8db5-6b6bb7fe0ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:51.458874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d6b4-eb7c-4ca3-8db5-6b6bb7fe0ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:51.459148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d6b4-eb7c-4ca3-8db5-6b6bb7fe0ef7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:51.459995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749d6b4-eb7c-4ca3-8db5-6b6bb7fe0ef7 None admin] RBAC: Adding query filter params (group.id=fee03e2ffe74487f86275873337addeb, role.id=6437cf432fe44cc28aa54208759f1265, scope.project.id=e4df84ef89b243829f2a079628e9e618) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:51.460305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749d6b4-eb7c-4ca3-8db5-6b6bb7fe0ef7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:51.461793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749d6b4-eb7c-4ca3-8db5-6b6bb7fe0ef7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:51.468653 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 228/455] 10.222.0.35 () {56 vars in 1376 bytes} [Wed May 11 20:45:51 2022] GET /identity/v3/role_assignments?group.id=fee03e2ffe74487f86275873337addeb&scope.project.id=e4df84ef89b243829f2a079628e9e618&role.id=6437cf432fe44cc28aa54208759f1265 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:45:54.214435 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa0465-1367-4069-b6c1-ba35a1e9e5ef None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:54.214929 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa0465-1367-4069-b6c1-ba35a1e9e5ef None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:54.214929 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa0465-1367-4069-b6c1-ba35a1e9e5ef None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:54.216547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 228/456] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:54.222118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478be384-5d4a-47ed-80a2-d4d1b2f3f621 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:54.222570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478be384-5d4a-47ed-80a2-d4d1b2f3f621 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:54.222747 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478be384-5d4a-47ed-80a2-d4d1b2f3f621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:54.245737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-478be384-5d4a-47ed-80a2-d4d1b2f3f621 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:54.246916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-478be384-5d4a-47ed-80a2-d4d1b2f3f621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:54.337307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 229/457] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:54.365507 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa0465-1367-4069-b6c1-ba35a1e9e5ef None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:54.514829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa0465-1367-4069-b6c1-ba35a1e9e5ef None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:54.556655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909eefed-758b-47e2-8a32-1c650c7d47b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:54.557819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eefed-758b-47e2-8a32-1c650c7d47b4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:54.558348 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eefed-758b-47e2-8a32-1c650c7d47b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:54.558838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eefed-758b-47e2-8a32-1c650c7d47b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:54.575342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909eefed-758b-47e2-8a32-1c650c7d47b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:54.577664 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909eefed-758b-47e2-8a32-1c650c7d47b4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-909eefed-758b-47e2-8a32-1c650c7d47b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:45:54.599039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:54.600001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:54.600846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:45:54.600846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:45:54.600846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:45:54.600846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:54.603294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 229/458] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:54.608952 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478be384-5d4a-47ed-80a2-d4d1b2f3f621 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:54.619408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60653c26-4bcf-426d-8687-b57b98747367 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:54.620047 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60653c26-4bcf-426d-8687-b57b98747367 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:54.620570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60653c26-4bcf-426d-8687-b57b98747367 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:54.622529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 230/459] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:54.628981 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a667-9741-41ee-b002-35458d4995e7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:54.629622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a667-9741-41ee-b002-35458d4995e7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:54.630110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a667-9741-41ee-b002-35458d4995e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:54.649427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1217a667-9741-41ee-b002-35458d4995e7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:54.651169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1217a667-9741-41ee-b002-35458d4995e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:54.724904 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 231/460] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:45:54.735779 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd28597-81a9-433b-8563-06d8e250259e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:54.736346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd28597-81a9-433b-8563-06d8e250259e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:54.736867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd28597-81a9-433b-8563-06d8e250259e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:54.738893 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 232/461] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:54.744372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085b0da-dbb1-4d85-acb3-4cb5e17cbf4c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:54.744887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085b0da-dbb1-4d85-acb3-4cb5e17cbf4c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:54.745387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085b0da-dbb1-4d85-acb3-4cb5e17cbf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:54.771040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d085b0da-dbb1-4d85-acb3-4cb5e17cbf4c None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:54.772712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d085b0da-dbb1-4d85-acb3-4cb5e17cbf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:54.792910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478be384-5d4a-47ed-80a2-d4d1b2f3f621 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:54.837865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f56f52-4d41-4d98-a5dc-9dfbcceb7241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:54.839017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f56f52-4d41-4d98-a5dc-9dfbcceb7241 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:54.839551 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f56f52-4d41-4d98-a5dc-9dfbcceb7241 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:54.840020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f56f52-4d41-4d98-a5dc-9dfbcceb7241 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:54.840940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f56f52-4d41-4d98-a5dc-9dfbcceb7241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:54.841453 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f56f52-4d41-4d98-a5dc-9dfbcceb7241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:54.845905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f56f52-4d41-4d98-a5dc-9dfbcceb7241 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:54.849510 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 233/462] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:54.850393 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085b0da-dbb1-4d85-acb3-4cb5e17cbf4c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:54.866155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 230/463] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:54.867825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae353a54-322b-47e6-acc0-5cbb8b64c930 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:54.868326 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae353a54-322b-47e6-acc0-5cbb8b64c930 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:54.868812 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae353a54-322b-47e6-acc0-5cbb8b64c930 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:54.870276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 231/464] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:54.872398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae353a54-322b-47e6-acc0-5cbb8b64c930 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:54.959633 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085b0da-dbb1-4d85-acb3-4cb5e17cbf4c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:54.972914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae353a54-322b-47e6-acc0-5cbb8b64c930 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:54.994879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f7276-05d7-490e-9148-d284c467a46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:54.995660 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7276-05d7-490e-9148-d284c467a46d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:54.995938 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7276-05d7-490e-9148-d284c467a46d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:54.996204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7276-05d7-490e-9148-d284c467a46d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:55.007200 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89dd8f-f46c-4ad4-80c3-0e69279fe198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:55.007941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89dd8f-f46c-4ad4-80c3-0e69279fe198 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:55.008169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f7276-05d7-490e-9148-d284c467a46d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:55.008271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89dd8f-f46c-4ad4-80c3-0e69279fe198 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:55.008487 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89dd8f-f46c-4ad4-80c3-0e69279fe198 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:55.009197 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89dd8f-f46c-4ad4-80c3-0e69279fe198 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:55.009651 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f7276-05d7-490e-9148-d284c467a46d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:55.010676 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89dd8f-f46c-4ad4-80c3-0e69279fe198 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-671f7276-05d7-490e-9148-d284c467a46d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:45:55.027088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:55.028191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:55.029118 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:45:55.029118 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:45:55.029118 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:45:55.029118 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:55.029118 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 234/465] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:55.029751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f391-0322-4794-bd00-d92874fd60e4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:55.030034 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f391-0322-4794-bd00-d92874fd60e4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:55.030307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6f391-0322-4794-bd00-d92874fd60e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:55.046313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d8e6f391-0322-4794-bd00-d92874fd60e4 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:55.047477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d8e6f391-0322-4794-bd00-d92874fd60e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:55.111877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 235/466] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:55.112716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6f391-0322-4794-bd00-d92874fd60e4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:55.122825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 232/467] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:45:54 2022] POST /identity/v3/users => generated 246 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:45:55.124182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89dd8f-f46c-4ad4-80c3-0e69279fe198 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:55.237966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6f391-0322-4794-bd00-d92874fd60e4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:55.255756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89dd8f-f46c-4ad4-80c3-0e69279fe198 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:55.275185 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b611f0-cdee-46d8-b379-5b0503d3418b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:55.276151 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b611f0-cdee-46d8-b379-5b0503d3418b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:55.276424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b611f0-cdee-46d8-b379-5b0503d3418b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:55.276771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b611f0-cdee-46d8-b379-5b0503d3418b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:55.288158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b611f0-cdee-46d8-b379-5b0503d3418b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:55.289772 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b611f0-cdee-46d8-b379-5b0503d3418b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:55.295842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef22e-b1cf-4ef1-bd15-6022d60cf442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:55.296914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef22e-b1cf-4ef1-bd15-6022d60cf442 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:55.297373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef22e-b1cf-4ef1-bd15-6022d60cf442 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:55.297834 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef22e-b1cf-4ef1-bd15-6022d60cf442 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:55.298746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bef22e-b1cf-4ef1-bd15-6022d60cf442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:55.299230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bef22e-b1cf-4ef1-bd15-6022d60cf442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:55.300962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bef22e-b1cf-4ef1-bd15-6022d60cf442 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f4b611f0-cdee-46d8-b379-5b0503d3418b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:45:55.309923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:55.311694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:55.312586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:45:55.312586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:45:55.312586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:45:55.312586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:55.312586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 236/468] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:55.312870 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b611f0-cdee-46d8-b379-5b0503d3418b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:55.320367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 233/469] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:55.321316 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef22e-b1cf-4ef1-bd15-6022d60cf442 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:55.425824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b611f0-cdee-46d8-b379-5b0503d3418b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:55.450092 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef22e-b1cf-4ef1-bd15-6022d60cf442 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:55.460481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21157be5-7a18-4924-9189-b00647f62aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:55.461296 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21157be5-7a18-4924-9189-b00647f62aee None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:55.461623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21157be5-7a18-4924-9189-b00647f62aee None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:55.461902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21157be5-7a18-4924-9189-b00647f62aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:55.473097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21157be5-7a18-4924-9189-b00647f62aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:55.474641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21157be5-7a18-4924-9189-b00647f62aee None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:55.489247 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d736a16-e664-49d3-b5eb-eee6f30e16fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:55.490219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d736a16-e664-49d3-b5eb-eee6f30e16fb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:55.490699 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d736a16-e664-49d3-b5eb-eee6f30e16fb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:55.491184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d736a16-e664-49d3-b5eb-eee6f30e16fb None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:55.492115 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d736a16-e664-49d3-b5eb-eee6f30e16fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:55.492623 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d736a16-e664-49d3-b5eb-eee6f30e16fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-21157be5-7a18-4924-9189-b00647f62aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:45:55.493314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:55.494171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:55.495033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:45:55.495033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:45:55.495033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:45:55.495033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:55.495033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 237/470] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:55.495693 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21157be5-7a18-4924-9189-b00647f62aee None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:55.496874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d736a16-e664-49d3-b5eb-eee6f30e16fb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:55.509385 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 234/471] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:55.510527 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d736a16-e664-49d3-b5eb-eee6f30e16fb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:55.601431 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21157be5-7a18-4924-9189-b00647f62aee None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:55.609667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d736a16-e664-49d3-b5eb-eee6f30e16fb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:55.637168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26099a0a-71c8-4c40-9151-64d61672a5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:55.637884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26099a0a-71c8-4c40-9151-64d61672a5a5 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:55.638169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26099a0a-71c8-4c40-9151-64d61672a5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:55.638445 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26099a0a-71c8-4c40-9151-64d61672a5a5 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:55.639196 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26099a0a-71c8-4c40-9151-64d61672a5a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:55.640638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26099a0a-71c8-4c40-9151-64d61672a5a5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:55.645254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157dd0a3-a7af-4990-b8de-8c50c4e0cc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:55.646181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dd0a3-a7af-4990-b8de-8c50c4e0cc16 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:55.646679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dd0a3-a7af-4990-b8de-8c50c4e0cc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:55.647241 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dd0a3-a7af-4990-b8de-8c50c4e0cc16 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:55.648149 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157dd0a3-a7af-4990-b8de-8c50c4e0cc16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:55.648661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157dd0a3-a7af-4990-b8de-8c50c4e0cc16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:55.650239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157dd0a3-a7af-4990-b8de-8c50c4e0cc16 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:55.663483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 235/472] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:55.664494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157dd0a3-a7af-4990-b8de-8c50c4e0cc16 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:55.718238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 238/473] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:45:55 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:45:55.719322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26099a0a-71c8-4c40-9151-64d61672a5a5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:55.821102 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157dd0a3-a7af-4990-b8de-8c50c4e0cc16 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:55.852941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26099a0a-71c8-4c40-9151-64d61672a5a5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:55.890261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76c667-e9fe-4d04-80f8-fca2e8d2de73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:55.891486 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76c667-e9fe-4d04-80f8-fca2e8d2de73 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:55.891971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76c667-e9fe-4d04-80f8-fca2e8d2de73 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:55.892513 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76c667-e9fe-4d04-80f8-fca2e8d2de73 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:55.893469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76c667-e9fe-4d04-80f8-fca2e8d2de73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:55.895613 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76c667-e9fe-4d04-80f8-fca2e8d2de73 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:55.898954 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8baf435-dea1-4037-90cb-db2d37c70e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:55.899647 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baf435-dea1-4037-90cb-db2d37c70e6d None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:55.899935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baf435-dea1-4037-90cb-db2d37c70e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:55.900213 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baf435-dea1-4037-90cb-db2d37c70e6d None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:55.900928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8baf435-dea1-4037-90cb-db2d37c70e6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:55.902424 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8baf435-dea1-4037-90cb-db2d37c70e6d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:55.989382 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 239/474] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:45:55 2022] POST /identity/v3/users => generated 249 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:45:55.990826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb71a6-1748-424b-8cf7-a1bbfaab2180 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:55.991117 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb71a6-1748-424b-8cf7-a1bbfaab2180 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:55.991393 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb71a6-1748-424b-8cf7-a1bbfaab2180 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:55.994223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 240/475] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:55.999172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c35e2-0db7-47c1-88a0-67d5fd9e24a7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:55.999458 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c35e2-0db7-47c1-88a0-67d5fd9e24a7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:55.999738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c35e2-0db7-47c1-88a0-67d5fd9e24a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:56.018853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-656c35e2-0db7-47c1-88a0-67d5fd9e24a7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:56.019886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 236/476] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:45:55 2022] POST /identity/v3/users => generated 248 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:45:56.020347 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-656c35e2-0db7-47c1-88a0-67d5fd9e24a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:56.104275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 241/477] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:45:56.145681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8baf435-dea1-4037-90cb-db2d37c70e6d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:56.282432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8baf435-dea1-4037-90cb-db2d37c70e6d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:56.317217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dfe2a-685d-4a66-868e-2580a9e44ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:56.317934 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dfe2a-685d-4a66-868e-2580a9e44ae0 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:56.318221 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dfe2a-685d-4a66-868e-2580a9e44ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:56.318499 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dfe2a-685d-4a66-868e-2580a9e44ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:56.319243 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763dfe2a-685d-4a66-868e-2580a9e44ae0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:56.320678 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763dfe2a-685d-4a66-868e-2580a9e44ae0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:56.360065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.sql.core [None req-763dfe2a-685d-4a66-868e-2580a9e44ae0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 20:45:56.360065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 11 20:45:56.360065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [parameters: {'id': '453a3face69b4352995af7c58bf8bb97', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 11 20:45:56.360065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80193) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-763dfe2a-685d-4a66-868e-2580a9e44ae0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = self._query(query) May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application conn.query(q) May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application result.read() May 11 20:45:56.376838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return ref.to_dict() May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 20:45:56.377919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application next(self.gen) May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application yield resource May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application next(self.gen) May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.session.rollback() May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.force_reraise() May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise self.value May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application session.commit() May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 20:45:56.379274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._prepare_impl() May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.session.flush() May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._flush(objects) May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application compat.raise_( May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application flush_context.execute() May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rec.execute(self) May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 20:45:56.380126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 20:45:56.381091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application result = self._query(query) May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application conn.query(q) May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application result.read() May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 20:45:56.382968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [parameters: {'id': '453a3face69b4352995af7c58bf8bb97', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:56.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 11 20:45:56.391139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:56.393125 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 237/478] 10.222.0.35 () {60 vars in 1131 bytes} [Wed May 11 20:45:56 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:56.397326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c35e2-0db7-47c1-88a0-67d5fd9e24a7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:56.499180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c35e2-0db7-47c1-88a0-67d5fd9e24a7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:56.535100 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6746bef-da74-402b-a1ba-25a568b82593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:56.536272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6746bef-da74-402b-a1ba-25a568b82593 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:56.536751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6746bef-da74-402b-a1ba-25a568b82593 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:56.537242 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6746bef-da74-402b-a1ba-25a568b82593 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:56.548069 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6746bef-da74-402b-a1ba-25a568b82593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c6746bef-da74-402b-a1ba-25a568b82593 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:56.556449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:56.557388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:56.558256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:56.558256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:56.558256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:56.558256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:56.558256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:56.558256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:56.558256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:56.558256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:56.558256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:56.558256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:56.558256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 11 20:45:56.558256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:56.565738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 242/479] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:45:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:56.567587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dfe2a-685d-4a66-868e-2580a9e44ae0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:56.669400 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dfe2a-685d-4a66-868e-2580a9e44ae0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:56.704107 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe59e4f-2eaf-4d8d-ab4d-3129a114a8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:56.705148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe59e4f-2eaf-4d8d-ab4d-3129a114a8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:56.705682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe59e4f-2eaf-4d8d-ab4d-3129a114a8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:56.706159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe59e4f-2eaf-4d8d-ab4d-3129a114a8c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:56.707104 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe59e4f-2eaf-4d8d-ab4d-3129a114a8c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:56.707609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe59e4f-2eaf-4d8d-ab4d-3129a114a8c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:56.709185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe59e4f-2eaf-4d8d-ab4d-3129a114a8c8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:56.725896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 238/480] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:45:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:57.887086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2993a28-eaf1-49e9-8765-7f903dbfff14 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:57.888107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2993a28-eaf1-49e9-8765-7f903dbfff14 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:57.888580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2993a28-eaf1-49e9-8765-7f903dbfff14 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:57.890542 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 243/481] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:57.895801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe6dc-c5e0-4880-a7c8-81fc24033e95 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:57.896629 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe6dc-c5e0-4880-a7c8-81fc24033e95 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:57.897103 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe6dc-c5e0-4880-a7c8-81fc24033e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:57.918531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-495fe6dc-c5e0-4880-a7c8-81fc24033e95 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:57.920046 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-495fe6dc-c5e0-4880-a7c8-81fc24033e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:58.012147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 239/482] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:58.047367 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2993a28-eaf1-49e9-8765-7f903dbfff14 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:58.195241 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2993a28-eaf1-49e9-8765-7f903dbfff14 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:58.242388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fcb09-5630-43b5-9220-d264760c7535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:58.243234 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fcb09-5630-43b5-9220-d264760c7535 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:58.243519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fcb09-5630-43b5-9220-d264760c7535 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:58.243799 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fcb09-5630-43b5-9220-d264760c7535 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:58.260515 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fcb09-5630-43b5-9220-d264760c7535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-800fcb09-5630-43b5-9220-d264760c7535 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:58.268608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:58.269890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:58.271351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:58.271351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:58.271351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:58.271351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:58.271351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:58.271351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:58.271351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:58.271351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:58.271351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:58.271351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:58.271351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:45:58.271351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:58.271351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 244/483] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:45:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:58.278304 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe6dc-c5e0-4880-a7c8-81fc24033e95 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:58.424117 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe6dc-c5e0-4880-a7c8-81fc24033e95 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:58.479265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bc875-0d26-49b9-a15d-0d57e96aeace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:58.479872 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bc875-0d26-49b9-a15d-0d57e96aeace None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:58.480161 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bc875-0d26-49b9-a15d-0d57e96aeace None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:58.480440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bc875-0d26-49b9-a15d-0d57e96aeace None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:58.481197 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bc875-0d26-49b9-a15d-0d57e96aeace None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:58.481507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bc875-0d26-49b9-a15d-0d57e96aeace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:58.483092 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bc875-0d26-49b9-a15d-0d57e96aeace None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:58.497230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 240/484] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:45:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:58.502869 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fcb09-5630-43b5-9220-d264760c7535 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:58.559555 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042fcef-7d0b-4b0f-9fff-8ca2a1d6026d None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:58.560193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042fcef-7d0b-4b0f-9fff-8ca2a1d6026d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:58.561214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042fcef-7d0b-4b0f-9fff-8ca2a1d6026d None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:58.563518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 241/485] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:45:58.570346 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085efc7-b765-46f3-9c86-cc3db8d9208f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:58.571978 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085efc7-b765-46f3-9c86-cc3db8d9208f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:58.572461 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085efc7-b765-46f3-9c86-cc3db8d9208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:58.606253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4085efc7-b765-46f3-9c86-cc3db8d9208f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:58.609202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4085efc7-b765-46f3-9c86-cc3db8d9208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:58.711753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fcb09-5630-43b5-9220-d264760c7535 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:58.729697 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 242/486] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:58.731343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197a513-073c-49fe-9ab0-c69845ddbd64 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:58.731828 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197a513-073c-49fe-9ab0-c69845ddbd64 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:58.732314 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197a513-073c-49fe-9ab0-c69845ddbd64 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:58.734736 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 243/487] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:58.740200 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa493-7cf2-4463-831e-5e479b4bd376 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:58.740717 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa493-7cf2-4463-831e-5e479b4bd376 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:58.741204 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa493-7cf2-4463-831e-5e479b4bd376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:58.757827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8969c2a-6c10-4cd9-bacf-062fb396d36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:58.758607 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-646fa493-7cf2-4463-831e-5e479b4bd376 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:58.758716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8969c2a-6c10-4cd9-bacf-062fb396d36a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:58.758947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8969c2a-6c10-4cd9-bacf-062fb396d36a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:58.759227 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8969c2a-6c10-4cd9-bacf-062fb396d36a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:58.760565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-646fa493-7cf2-4463-831e-5e479b4bd376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:58.777492 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8969c2a-6c10-4cd9-bacf-062fb396d36a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:58.779144 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8969c2a-6c10-4cd9-bacf-062fb396d36a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a8969c2a-6c10-4cd9-bacf-062fb396d36a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:45:58.797802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:58.798692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:58.799551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:45:58.799551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:45:58.799551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:45:58.799551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:58.803679 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 245/488] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:58.805262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8969c2a-6c10-4cd9-bacf-062fb396d36a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:58.834322 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 244/489] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:58.835664 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fa493-7cf2-4463-831e-5e479b4bd376 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:58.938489 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fa493-7cf2-4463-831e-5e479b4bd376 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:58.950559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8969c2a-6c10-4cd9-bacf-062fb396d36a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:59.035676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba26f4a-759b-47d4-a01f-b0c689e0dcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:59.035870 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b1ff7-5588-436f-b5b7-12f66c470383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:59.036434 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b1ff7-5588-436f-b5b7-12f66c470383 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.036532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26f4a-759b-47d4-a01f-b0c689e0dcfb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.036720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b1ff7-5588-436f-b5b7-12f66c470383 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.036814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26f4a-759b-47d4-a01f-b0c689e0dcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.037000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b1ff7-5588-436f-b5b7-12f66c470383 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.037094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26f4a-759b-47d4-a01f-b0c689e0dcfb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.037769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b1ff7-5588-436f-b5b7-12f66c470383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:59.038082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b1ff7-5588-436f-b5b7-12f66c470383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:59.039456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b1ff7-5588-436f-b5b7-12f66c470383 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:59.051343 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba26f4a-759b-47d4-a01f-b0c689e0dcfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:59.056044 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 245/490] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:59.056044 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b1ff7-5588-436f-b5b7-12f66c470383 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-eba26f4a-759b-47d4-a01f-b0c689e0dcfb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:59.059384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:59.060310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:59.062000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:59.062000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:59.062000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:59.062000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:59.062000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:59.062000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:59.062000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:59.062000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:59.062000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:59.062000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:59.062000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:45:59.062000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:59.062000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 246/491] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:45:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:59.062951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f396-2b20-4dda-a806-1219cd30a8fa None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.062951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f396-2b20-4dda-a806-1219cd30a8fa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.062951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f396-2b20-4dda-a806-1219cd30a8fa None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.067518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 247/492] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:59.068465 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611f396-2b20-4dda-a806-1219cd30a8fa None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:59.157252 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b1ff7-5588-436f-b5b7-12f66c470383 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:59.169033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611f396-2b20-4dda-a806-1219cd30a8fa None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:59.190367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a3186-fc09-4143-804e-5d28555a953d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:59.191171 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a3186-fc09-4143-804e-5d28555a953d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.191456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a3186-fc09-4143-804e-5d28555a953d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.191733 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a3186-fc09-4143-804e-5d28555a953d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.203559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661a295-7d15-44d1-b752-dba433b16401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:59.204425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661a295-7d15-44d1-b752-dba433b16401 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.204610 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a3186-fc09-4143-804e-5d28555a953d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:59.204747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661a295-7d15-44d1-b752-dba433b16401 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.205007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661a295-7d15-44d1-b752-dba433b16401 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-850a3186-fc09-4143-804e-5d28555a953d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:59.212269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:59.213181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:59.214039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:59.214039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:59.214039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:59.214039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:59.214039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:59.214039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:59.214039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:59.214039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:59.214039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:59.214039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:59.214039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:45:59.214039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:59.214653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661a295-7d15-44d1-b752-dba433b16401 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:59.214721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 246/493] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:45:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:59.214795 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661a295-7d15-44d1-b752-dba433b16401 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:59.214872 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a3186-fc09-4143-804e-5d28555a953d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5661a295-7d15-44d1-b752-dba433b16401 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:45:59.231409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:59.232384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:59.234005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:59.234005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:59.234005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:45:59.234005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:45:59.234005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:45:59.234005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:45:59.234005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:45:59.234005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:45:59.234005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 20:45:59.234005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:59.234005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 248/494] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 11 20:45:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:59.235242 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dd6f1-7088-4ae0-bc2a-7d21c01315da None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.235242 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dd6f1-7088-4ae0-bc2a-7d21c01315da None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.235242 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dd6f1-7088-4ae0-bc2a-7d21c01315da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.251292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-456dd6f1-7088-4ae0-bc2a-7d21c01315da None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:45:59.252472 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-456dd6f1-7088-4ae0-bc2a-7d21c01315da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:45:59.317256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 249/495] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:45:59.318138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dd6f1-7088-4ae0-bc2a-7d21c01315da None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:59.329084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a3186-fc09-4143-804e-5d28555a953d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:59.368938 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db241c-06fb-4cd9-9033-2627cfd0393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:59.369643 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db241c-06fb-4cd9-9033-2627cfd0393e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.369932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db241c-06fb-4cd9-9033-2627cfd0393e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.370211 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db241c-06fb-4cd9-9033-2627cfd0393e None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.370965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db241c-06fb-4cd9-9033-2627cfd0393e None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:59.371282 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db241c-06fb-4cd9-9033-2627cfd0393e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:59.372668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db241c-06fb-4cd9-9033-2627cfd0393e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:59.380666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 247/496] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:45:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:59.381458 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db241c-06fb-4cd9-9033-2627cfd0393e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:59.427774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dd6f1-7088-4ae0-bc2a-7d21c01315da None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:59.468325 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4685-5f29-4b54-a5ef-595c4c86225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:59.468988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4685-5f29-4b54-a5ef-595c4c86225a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.469272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4685-5f29-4b54-a5ef-595c4c86225a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.469797 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4685-5f29-4b54-a5ef-595c4c86225a None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.470304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4685-5f29-4b54-a5ef-595c4c86225a None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:59.470616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4685-5f29-4b54-a5ef-595c4c86225a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:59.472004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4685-5f29-4b54-a5ef-595c4c86225a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:59.477858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db241c-06fb-4cd9-9033-2627cfd0393e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:59.484835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 250/497] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:45:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:59.484835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4685-5f29-4b54-a5ef-595c4c86225a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:59.516304 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14590d66-e74b-4b70-af19-8bc66dadd52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:59.516978 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14590d66-e74b-4b70-af19-8bc66dadd52b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.517265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14590d66-e74b-4b70-af19-8bc66dadd52b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.517569 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14590d66-e74b-4b70-af19-8bc66dadd52b None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.518417 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14590d66-e74b-4b70-af19-8bc66dadd52b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:59.518732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14590d66-e74b-4b70-af19-8bc66dadd52b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:59.520550 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14590d66-e74b-4b70-af19-8bc66dadd52b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:59.556047 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 248/498] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 11 20:45:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:59.557550 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14590d66-e74b-4b70-af19-8bc66dadd52b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:59.580327 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4685-5f29-4b54-a5ef-595c4c86225a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:59.612001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b430b2-1457-4d1f-b9e8-edc533e399e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:59.612790 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b430b2-1457-4d1f-b9e8-edc533e399e9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.613073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b430b2-1457-4d1f-b9e8-edc533e399e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.613352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b430b2-1457-4d1f-b9e8-edc533e399e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.624070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b430b2-1457-4d1f-b9e8-edc533e399e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f5b430b2-1457-4d1f-b9e8-edc533e399e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:45:59.631747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:59.632814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:59.638447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:59.638447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:59.638447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:59.638447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:59.638447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:45:59.638447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:45:59.638447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:45:59.638447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:45:59.638447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:45:59.638447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:45:59.638447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:45:59.638447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:59.638447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 251/499] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:45:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:59.638447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b430b2-1457-4d1f-b9e8-edc533e399e9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:59.650504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14590d66-e74b-4b70-af19-8bc66dadd52b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:59.682266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884914d-f39a-40bc-8e0b-69dac9dbcaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:59.683050 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884914d-f39a-40bc-8e0b-69dac9dbcaff None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.683334 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884914d-f39a-40bc-8e0b-69dac9dbcaff None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.683611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884914d-f39a-40bc-8e0b-69dac9dbcaff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.693698 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884914d-f39a-40bc-8e0b-69dac9dbcaff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:59.695171 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884914d-f39a-40bc-8e0b-69dac9dbcaff None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-9884914d-f39a-40bc-8e0b-69dac9dbcaff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:45:59.712972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:59.714062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:59.715067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:45:59.715067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:45:59.715067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:45:59.715067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:45:59.715067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 249/500] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:59.716794 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099b4f7-4732-4d01-a4e6-b097680352c6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.717192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099b4f7-4732-4d01-a4e6-b097680352c6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.717554 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099b4f7-4732-4d01-a4e6-b097680352c6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.718932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 250/501] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:45:59.719700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099b4f7-4732-4d01-a4e6-b097680352c6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:59.730538 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b430b2-1457-4d1f-b9e8-edc533e399e9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:59.762465 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9c52f-1253-4746-9170-b015d9374080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:59.763253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9c52f-1253-4746-9170-b015d9374080 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.763537 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9c52f-1253-4746-9170-b015d9374080 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.763843 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9c52f-1253-4746-9170-b015d9374080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.774117 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9c52f-1253-4746-9170-b015d9374080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:59.775574 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9c52f-1253-4746-9170-b015d9374080 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-19b9c52f-1253-4746-9170-b015d9374080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:45:59.791965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:45:59.792986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:45:59.799004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:45:59.799004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:45:59.799004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:45:59.799004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:45:59.799004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 252/502] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:45:59.799004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9c52f-1253-4746-9170-b015d9374080 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:45:59.816694 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099b4f7-4732-4d01-a4e6-b097680352c6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:59.851811 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c4ffb-c2f7-479d-8d8a-1dd3c94eaacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:59.852463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c4ffb-c2f7-479d-8d8a-1dd3c94eaacd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.852749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c4ffb-c2f7-479d-8d8a-1dd3c94eaacd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.853025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c4ffb-c2f7-479d-8d8a-1dd3c94eaacd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.889435 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9c52f-1253-4746-9170-b015d9374080 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:45:59.915923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c4ffb-c2f7-479d-8d8a-1dd3c94eaacd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:59.917390 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c4ffb-c2f7-479d-8d8a-1dd3c94eaacd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:59.921171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d7452-4f19-4f79-bada-93c0c19991a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:45:59.921860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7452-4f19-4f79-bada-93c0c19991a7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:45:59.922143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7452-4f19-4f79-bada-93c0c19991a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:45:59.922417 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d7452-4f19-4f79-bada-93c0c19991a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:45:59.923154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d7452-4f19-4f79-bada-93c0c19991a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:45:59.923461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d7452-4f19-4f79-bada-93c0c19991a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:45:59.924808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d7452-4f19-4f79-bada-93c0c19991a7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:45:59.932442 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 253/503] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:45:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:45:59.934407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d7452-4f19-4f79-bada-93c0c19991a7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:00.010083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 251/504] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:46:00.011429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd91a-c74e-40d2-ab81-94b0724640a9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:00.011718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd91a-c74e-40d2-ab81-94b0724640a9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:00.011994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd91a-c74e-40d2-ab81-94b0724640a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:00.028785 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d7452-4f19-4f79-bada-93c0c19991a7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:00.029274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6dcbd91a-c74e-40d2-ab81-94b0724640a9 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:00.030696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6dcbd91a-c74e-40d2-ab81-94b0724640a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:00.061065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56563562-3dcf-40f6-bebc-f6b13dfa1fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:00.061741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56563562-3dcf-40f6-bebc-f6b13dfa1fac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:00.062032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56563562-3dcf-40f6-bebc-f6b13dfa1fac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:00.062310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56563562-3dcf-40f6-bebc-f6b13dfa1fac None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:00.063020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56563562-3dcf-40f6-bebc-f6b13dfa1fac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:00.063328 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56563562-3dcf-40f6-bebc-f6b13dfa1fac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:00.064688 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56563562-3dcf-40f6-bebc-f6b13dfa1fac None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:00.075928 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 254/505] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:00.076736 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56563562-3dcf-40f6-bebc-f6b13dfa1fac None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:00.092583 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 252/506] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:00.093334 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbd91a-c74e-40d2-ab81-94b0724640a9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:00.169184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56563562-3dcf-40f6-bebc-f6b13dfa1fac None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:00.184856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbd91a-c74e-40d2-ab81-94b0724640a9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:00.200991 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4ba70-9f7e-4951-a260-0eb0ce2ee94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:00.202188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4ba70-9f7e-4951-a260-0eb0ce2ee94e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:00.202473 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4ba70-9f7e-4951-a260-0eb0ce2ee94e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:00.202750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4ba70-9f7e-4951-a260-0eb0ce2ee94e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:00.203460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4ba70-9f7e-4951-a260-0eb0ce2ee94e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:00.203770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4ba70-9f7e-4951-a260-0eb0ce2ee94e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:00.205134 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4ba70-9f7e-4951-a260-0eb0ce2ee94e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:00.215802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 255/507] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:00.216570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4ba70-9f7e-4951-a260-0eb0ce2ee94e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:00.221080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d2858-6021-4dbc-b9b7-865bcacb54a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:00.221898 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d2858-6021-4dbc-b9b7-865bcacb54a5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:00.222179 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d2858-6021-4dbc-b9b7-865bcacb54a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:00.222452 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d2858-6021-4dbc-b9b7-865bcacb54a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:00.232270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d2858-6021-4dbc-b9b7-865bcacb54a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:00.234422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d2858-6021-4dbc-b9b7-865bcacb54a5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d17d2858-6021-4dbc-b9b7-865bcacb54a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:00.251227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:00.252297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:00.257801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:00.257801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:00.257801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:00.257801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:00.257801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 253/508] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:00.257801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d2858-6021-4dbc-b9b7-865bcacb54a5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:00.311275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4ba70-9f7e-4951-a260-0eb0ce2ee94e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:00.342233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113009b-3b3d-46cd-ab8e-425533e808f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:00.343010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113009b-3b3d-46cd-ab8e-425533e808f2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:00.343291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113009b-3b3d-46cd-ab8e-425533e808f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:00.343568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113009b-3b3d-46cd-ab8e-425533e808f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:00.344008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d2858-6021-4dbc-b9b7-865bcacb54a5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:00.353701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113009b-3b3d-46cd-ab8e-425533e808f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:00.355153 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113009b-3b3d-46cd-ab8e-425533e808f2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d113009b-3b3d-46cd-ab8e-425533e808f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:00.372249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:00.373356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:00.374452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:00.374452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:00.374452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:00.374452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:00.374452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 256/509] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:00.374452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113009b-3b3d-46cd-ab8e-425533e808f2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:00.377544 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a4f2d-31e4-44ee-ab16-d3fccee76383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:00.378347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a4f2d-31e4-44ee-ab16-d3fccee76383 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:00.378632 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a4f2d-31e4-44ee-ab16-d3fccee76383 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:00.378908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a4f2d-31e4-44ee-ab16-d3fccee76383 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:00.385944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a4f2d-31e4-44ee-ab16-d3fccee76383 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:00.387386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a4f2d-31e4-44ee-ab16-d3fccee76383 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-423a4f2d-31e4-44ee-ab16-d3fccee76383 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:00.403689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:00.405347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:00.410997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:00.410997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:00.410997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:00.410997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:00.410997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:00.410997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:00.410997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:00.410997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:00.410997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 20:46:00.410997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:00.410997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 254/510] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:46:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:00.410997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a4f2d-31e4-44ee-ab16-d3fccee76383 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:00.470740 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113009b-3b3d-46cd-ab8e-425533e808f2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:00.501061 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a4f2d-31e4-44ee-ab16-d3fccee76383 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:00.501459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad8e78-0fe7-4dbe-96c6-249c28d2bb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:00.502266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad8e78-0fe7-4dbe-96c6-249c28d2bb48 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:00.502551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad8e78-0fe7-4dbe-96c6-249c28d2bb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:00.502825 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad8e78-0fe7-4dbe-96c6-249c28d2bb48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:00.512891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad8e78-0fe7-4dbe-96c6-249c28d2bb48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:00.514963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad8e78-0fe7-4dbe-96c6-249c28d2bb48 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c6ad8e78-0fe7-4dbe-96c6-249c28d2bb48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:00.532043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:00.533060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:00.534007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:00.534007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:00.534007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:00.534007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:00.534007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 257/511] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:00.534303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad8e78-0fe7-4dbe-96c6-249c28d2bb48 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:00.535099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac19c4-dd8d-4f21-8634-955f541e4fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:00.535889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac19c4-dd8d-4f21-8634-955f541e4fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:00.536174 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac19c4-dd8d-4f21-8634-955f541e4fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:00.536448 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac19c4-dd8d-4f21-8634-955f541e4fe0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:00.543698 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac19c4-dd8d-4f21-8634-955f541e4fe0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:00.545185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac19c4-dd8d-4f21-8634-955f541e4fe0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-80ac19c4-dd8d-4f21-8634-955f541e4fe0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:00.559266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:00.560307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:00.561816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:00.561816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:00.561816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:00.561816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:00.561816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:00.561816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:00.561816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:00.561816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:00.561816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 20:46:00.561816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:00.561816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 255/512] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:46:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:00.562427 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac19c4-dd8d-4f21-8634-955f541e4fe0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:00.630842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad8e78-0fe7-4dbe-96c6-249c28d2bb48 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:00.656948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac19c4-dd8d-4f21-8634-955f541e4fe0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:00.662477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374fab5-3f07-47d5-bdb2-8c0a3e2618e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:00.663127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374fab5-3f07-47d5-bdb2-8c0a3e2618e0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:00.663411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374fab5-3f07-47d5-bdb2-8c0a3e2618e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:00.663684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374fab5-3f07-47d5-bdb2-8c0a3e2618e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:00.664392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374fab5-3f07-47d5-bdb2-8c0a3e2618e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:00.664696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374fab5-3f07-47d5-bdb2-8c0a3e2618e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:00.666093 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374fab5-3f07-47d5-bdb2-8c0a3e2618e0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:00.677202 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 258/513] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:00.678014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374fab5-3f07-47d5-bdb2-8c0a3e2618e0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:00.692803 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c08f2f-7eee-4e2a-b8ba-c23eaa7c89e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:00.693460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c08f2f-7eee-4e2a-b8ba-c23eaa7c89e7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:00.693771 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c08f2f-7eee-4e2a-b8ba-c23eaa7c89e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:00.694048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c08f2f-7eee-4e2a-b8ba-c23eaa7c89e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:00.694764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c08f2f-7eee-4e2a-b8ba-c23eaa7c89e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:00.695068 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c08f2f-7eee-4e2a-b8ba-c23eaa7c89e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:00.696417 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c08f2f-7eee-4e2a-b8ba-c23eaa7c89e7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:00.707201 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 256/514] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:00.707832 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c08f2f-7eee-4e2a-b8ba-c23eaa7c89e7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:00.770853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374fab5-3f07-47d5-bdb2-8c0a3e2618e0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:00.798420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c08f2f-7eee-4e2a-b8ba-c23eaa7c89e7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:00.802444 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f542b9-83d9-468c-8cbb-0c160a96590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:00.803100 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f542b9-83d9-468c-8cbb-0c160a96590e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:00.803383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f542b9-83d9-468c-8cbb-0c160a96590e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:00.803657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f542b9-83d9-468c-8cbb-0c160a96590e None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:00.804476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f542b9-83d9-468c-8cbb-0c160a96590e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:00.804784 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f542b9-83d9-468c-8cbb-0c160a96590e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:00.806237 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f542b9-83d9-468c-8cbb-0c160a96590e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:00.830287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d5b03-a750-4f02-b36f-a1465e84ee58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:00.830940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d5b03-a750-4f02-b36f-a1465e84ee58 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:00.831222 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d5b03-a750-4f02-b36f-a1465e84ee58 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:00.831496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d5b03-a750-4f02-b36f-a1465e84ee58 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:00.832209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d5b03-a750-4f02-b36f-a1465e84ee58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:00.832514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d5b03-a750-4f02-b36f-a1465e84ee58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:00.833906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d5b03-a750-4f02-b36f-a1465e84ee58 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:00.842813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 259/515] 10.222.0.35 () {56 vars in 1137 bytes} [Wed May 11 20:46:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:00.843650 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f542b9-83d9-468c-8cbb-0c160a96590e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:00.855067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 257/516] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:00.855067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d5b03-a750-4f02-b36f-a1465e84ee58 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:00.936460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f542b9-83d9-468c-8cbb-0c160a96590e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:00.942588 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d5b03-a750-4f02-b36f-a1465e84ee58 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:00.968572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496914f-a33b-4b8f-9c71-a7ae4455d9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:00.969236 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496914f-a33b-4b8f-9c71-a7ae4455d9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:00.969521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496914f-a33b-4b8f-9c71-a7ae4455d9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:00.969827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496914f-a33b-4b8f-9c71-a7ae4455d9c8 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:00.970649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496914f-a33b-4b8f-9c71-a7ae4455d9c8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:00.970958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496914f-a33b-4b8f-9c71-a7ae4455d9c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:00.972397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496914f-a33b-4b8f-9c71-a7ae4455d9c8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:00.974609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c8641-f802-4080-b70b-2712947c11f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:00.975403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c8641-f802-4080-b70b-2712947c11f2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:00.975690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c8641-f802-4080-b70b-2712947c11f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:00.975999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c8641-f802-4080-b70b-2712947c11f2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:00.983314 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c8641-f802-4080-b70b-2712947c11f2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:00.984738 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c8641-f802-4080-b70b-2712947c11f2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:00.990517 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 260/517] 10.222.0.35 () {56 vars in 1137 bytes} [Wed May 11 20:46:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:00.991307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496914f-a33b-4b8f-9c71-a7ae4455d9c8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a46c8641-f802-4080-b70b-2712947c11f2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:00.999051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:01.000178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:01.005572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:01.005572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:01.005572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:01.005572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:01.005572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:01.005572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:01.005572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:01.005572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:01.005572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 20:46:01.005572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:01.005572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 258/518] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:01.005572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c8641-f802-4080-b70b-2712947c11f2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:01.091381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496914f-a33b-4b8f-9c71-a7ae4455d9c8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:01.108594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c8641-f802-4080-b70b-2712947c11f2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:01.125105 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023e159-1664-4633-b6a1-66544d2db8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:01.126008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023e159-1664-4633-b6a1-66544d2db8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:01.126286 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023e159-1664-4633-b6a1-66544d2db8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:01.126555 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023e159-1664-4633-b6a1-66544d2db8c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:01.133088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023e159-1664-4633-b6a1-66544d2db8c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:01.134547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023e159-1664-4633-b6a1-66544d2db8c6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:01.142356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e95258-b7bf-4565-b864-403dc5b0addb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:01.143005 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e95258-b7bf-4565-b864-403dc5b0addb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:01.143293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e95258-b7bf-4565-b864-403dc5b0addb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:01.143636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e95258-b7bf-4565-b864-403dc5b0addb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7023e159-1664-4633-b6a1-66544d2db8c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:01.149548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:01.150599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:01.156133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:01.156133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:01.156133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:01.156133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:01.156133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:01.156133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:01.156133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:01.156133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:01.156133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 261/519] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:01.156133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023e159-1664-4633-b6a1-66544d2db8c6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:01.216127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e95258-b7bf-4565-b864-403dc5b0addb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:01.217930 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e95258-b7bf-4565-b864-403dc5b0addb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:01.259116 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023e159-1664-4633-b6a1-66544d2db8c6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:01.292637 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f9aec-ee5d-475c-9bcb-1b3bc04b2f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:01.293696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f9aec-ee5d-475c-9bcb-1b3bc04b2f4b None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:01.294056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f9aec-ee5d-475c-9bcb-1b3bc04b2f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:01.294549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f9aec-ee5d-475c-9bcb-1b3bc04b2f4b None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:01.296590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f9aec-ee5d-475c-9bcb-1b3bc04b2f4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:01.298323 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f9aec-ee5d-475c-9bcb-1b3bc04b2f4b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:01.324847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 259/520] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:46:01.325778 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e95258-b7bf-4565-b864-403dc5b0addb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:01.382778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 262/521] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:46:01 2022] POST /identity/v3/users => generated 247 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:46:01.383681 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f9aec-ee5d-475c-9bcb-1b3bc04b2f4b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:01.425757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e95258-b7bf-4565-b864-403dc5b0addb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:01.460077 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e58ff-5277-48a0-ac7d-249e6131dd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:01.460744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e58ff-5277-48a0-ac7d-249e6131dd74 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:01.461025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e58ff-5277-48a0-ac7d-249e6131dd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:01.461301 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e58ff-5277-48a0-ac7d-249e6131dd74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:01.494161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f9aec-ee5d-475c-9bcb-1b3bc04b2f4b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:01.529060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba832d22-2687-4368-b2fc-866ee353b85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:01.530477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832d22-2687-4368-b2fc-866ee353b85f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:01.530860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832d22-2687-4368-b2fc-866ee353b85f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:01.531064 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e58ff-5277-48a0-ac7d-249e6131dd74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:01.531333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba832d22-2687-4368-b2fc-866ee353b85f None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:01.532284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba832d22-2687-4368-b2fc-866ee353b85f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:01.532547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e58ff-5277-48a0-ac7d-249e6131dd74 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:01.532796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba832d22-2687-4368-b2fc-866ee353b85f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:01.534445 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba832d22-2687-4368-b2fc-866ee353b85f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:01.558018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 263/522] 10.222.0.35 () {56 vars in 1139 bytes} [Wed May 11 20:46:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:01.558018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba832d22-2687-4368-b2fc-866ee353b85f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:01.639308 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 260/523] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:46:01.639994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e58ff-5277-48a0-ac7d-249e6131dd74 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:01.657557 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba832d22-2687-4368-b2fc-866ee353b85f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:01.690766 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9c8cc-c657-4ee7-a731-21bd57f453c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:01.691417 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9c8cc-c657-4ee7-a731-21bd57f453c0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:01.691699 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9c8cc-c657-4ee7-a731-21bd57f453c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:01.691974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9c8cc-c657-4ee7-a731-21bd57f453c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:01.692748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9c8cc-c657-4ee7-a731-21bd57f453c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:01.693057 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9c8cc-c657-4ee7-a731-21bd57f453c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:01.694524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9c8cc-c657-4ee7-a731-21bd57f453c0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:01.712660 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 264/524] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:01.713494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9c8cc-c657-4ee7-a731-21bd57f453c0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:01.738783 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e58ff-5277-48a0-ac7d-249e6131dd74 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:01.772774 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a7615-19f7-4cc1-b24f-6e98d8df051e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:01.773595 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7615-19f7-4cc1-b24f-6e98d8df051e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:01.773878 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7615-19f7-4cc1-b24f-6e98d8df051e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:01.774154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a7615-19f7-4cc1-b24f-6e98d8df051e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:01.784767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a7615-19f7-4cc1-b24f-6e98d8df051e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:01.786347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a7615-19f7-4cc1-b24f-6e98d8df051e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-642a7615-19f7-4cc1-b24f-6e98d8df051e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:01.804010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:01.804924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:01.810786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:01.810786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:01.810786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:01.810786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:01.810786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 261/525] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:01.810786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a7615-19f7-4cc1-b24f-6e98d8df051e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:01.813167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9c8cc-c657-4ee7-a731-21bd57f453c0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:01.849059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a836a2-81e9-4020-ab7c-95584872505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:01.849812 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a836a2-81e9-4020-ab7c-95584872505d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:01.850024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a836a2-81e9-4020-ab7c-95584872505d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:01.850299 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a836a2-81e9-4020-ab7c-95584872505d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:01.907208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a7615-19f7-4cc1-b24f-6e98d8df051e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:01.917381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a836a2-81e9-4020-ab7c-95584872505d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:01.918885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a836a2-81e9-4020-ab7c-95584872505d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:01.940080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd0c07-3c8a-4383-90dd-c36a74c76f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:01.940873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd0c07-3c8a-4383-90dd-c36a74c76f2b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:01.941157 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd0c07-3c8a-4383-90dd-c36a74c76f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:01.941435 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd0c07-3c8a-4383-90dd-c36a74c76f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:01.951891 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd0c07-3c8a-4383-90dd-c36a74c76f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:01.953349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd0c07-3c8a-4383-90dd-c36a74c76f2b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-7dbd0c07-3c8a-4383-90dd-c36a74c76f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:01.971791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:01.972681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:01.974025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:01.974025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:01.974025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:01.974025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:01.977513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 262/526] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:01.978378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd0c07-3c8a-4383-90dd-c36a74c76f2b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:02.014622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 265/527] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:46:02.015834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a836a2-81e9-4020-ab7c-95584872505d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:02.074159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd0c07-3c8a-4383-90dd-c36a74c76f2b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:02.107789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d02d1c-b920-4fc3-a6d4-704d178be2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:02.108442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02d1c-b920-4fc3-a6d4-704d178be2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:02.108725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02d1c-b920-4fc3-a6d4-704d178be2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:02.109250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d02d1c-b920-4fc3-a6d4-704d178be2c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:02.109853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d02d1c-b920-4fc3-a6d4-704d178be2c3 None admin] RBAC: Adding query filter params (role.id=b18c84f91b764bea92cc22c80a49bcaa, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=f400b94d3fbc40bdace4860fe83a0891) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:02.110168 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d02d1c-b920-4fc3-a6d4-704d178be2c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:02.110741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a836a2-81e9-4020-ab7c-95584872505d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:02.111605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d02d1c-b920-4fc3-a6d4-704d178be2c3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:02.125850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 263/528] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:01 2022] GET /identity/v3/role_assignments?user.id=f400b94d3fbc40bdace4860fe83a0891&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=b18c84f91b764bea92cc22c80a49bcaa => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:02.125850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d02d1c-b920-4fc3-a6d4-704d178be2c3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:02.163521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bab66-8847-40e2-87da-e1ed7aa4ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:02.164396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bab66-8847-40e2-87da-e1ed7aa4ebe0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:02.164686 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bab66-8847-40e2-87da-e1ed7aa4ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:02.164966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bab66-8847-40e2-87da-e1ed7aa4ebe0 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:02.165816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bab66-8847-40e2-87da-e1ed7aa4ebe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:02.166131 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bab66-8847-40e2-87da-e1ed7aa4ebe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:02.168678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bab66-8847-40e2-87da-e1ed7aa4ebe0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:02.184775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 266/529] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:02.185756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bab66-8847-40e2-87da-e1ed7aa4ebe0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:02.244772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d02d1c-b920-4fc3-a6d4-704d178be2c3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:02.282971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8b8da-03cb-4947-986c-6474d04a4aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:02.283758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8b8da-03cb-4947-986c-6474d04a4aef None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:02.284109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8b8da-03cb-4947-986c-6474d04a4aef None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:02.284455 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8b8da-03cb-4947-986c-6474d04a4aef None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:02.285265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8b8da-03cb-4947-986c-6474d04a4aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:02.285694 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8b8da-03cb-4947-986c-6474d04a4aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:02.287206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8b8da-03cb-4947-986c-6474d04a4aef None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:02.304424 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 264/530] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:02.305234 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8b8da-03cb-4947-986c-6474d04a4aef None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:02.319541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bab66-8847-40e2-87da-e1ed7aa4ebe0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:02.359895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9d3a2-b249-4834-ae19-504f2e1b45da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:02.361070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9d3a2-b249-4834-ae19-504f2e1b45da None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:02.361639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9d3a2-b249-4834-ae19-504f2e1b45da None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:02.362117 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9d3a2-b249-4834-ae19-504f2e1b45da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:02.372836 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9d3a2-b249-4834-ae19-504f2e1b45da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:02.375161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9d3a2-b249-4834-ae19-504f2e1b45da None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f1e9d3a2-b249-4834-ae19-504f2e1b45da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:02.392339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:02.393345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:02.394818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:02.394818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:02.394818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:02.394818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:02.401186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 267/531] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:02.402313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9d3a2-b249-4834-ae19-504f2e1b45da None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:02.427590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8b8da-03cb-4947-986c-6474d04a4aef None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:02.470265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f55d3a-837d-4591-9ea8-f76e987133d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:02.472055 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f55d3a-837d-4591-9ea8-f76e987133d1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:02.472603 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f55d3a-837d-4591-9ea8-f76e987133d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:02.473237 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f55d3a-837d-4591-9ea8-f76e987133d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:02.483310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f55d3a-837d-4591-9ea8-f76e987133d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:02.485967 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f55d3a-837d-4591-9ea8-f76e987133d1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-13f55d3a-837d-4591-9ea8-f76e987133d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:02.505874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:02.506786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:02.507740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:02.507740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:02.507740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:02.507740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:02.507740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:02.507740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:02.507740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:02.507740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:02.515508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 265/532] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:02.515508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f55d3a-837d-4591-9ea8-f76e987133d1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:02.523997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9d3a2-b249-4834-ae19-504f2e1b45da None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:02.569408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4bb28-e131-41b4-988c-7c7b038c4932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:02.570625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4bb28-e131-41b4-988c-7c7b038c4932 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:02.571094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4bb28-e131-41b4-988c-7c7b038c4932 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:02.571622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4bb28-e131-41b4-988c-7c7b038c4932 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:02.579391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4bb28-e131-41b4-988c-7c7b038c4932 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:02.581177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4bb28-e131-41b4-988c-7c7b038c4932 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6fe4bb28-e131-41b4-988c-7c7b038c4932 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:02.596107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:02.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:02.597935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:02.597935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:02.597935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:02.597935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:02.597935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:02.597935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:02.597935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:02.597935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:02.604761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 268/533] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:02.605920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4bb28-e131-41b4-988c-7c7b038c4932 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:02.617540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f55d3a-837d-4591-9ea8-f76e987133d1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:02.658988 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfea83-166d-44c6-a91b-8c616fa49ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:02.659682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfea83-166d-44c6-a91b-8c616fa49ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:02.659966 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfea83-166d-44c6-a91b-8c616fa49ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:02.660239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfea83-166d-44c6-a91b-8c616fa49ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:02.660960 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfea83-166d-44c6-a91b-8c616fa49ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:02.661266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfea83-166d-44c6-a91b-8c616fa49ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:02.662673 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfea83-166d-44c6-a91b-8c616fa49ac0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:02.682376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 266/534] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:02.682376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfea83-166d-44c6-a91b-8c616fa49ac0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:02.720370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4bb28-e131-41b4-988c-7c7b038c4932 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:02.758072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2f268-1337-4f8c-b140-8509cf35a709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:02.759115 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2f268-1337-4f8c-b140-8509cf35a709 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:02.759601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2f268-1337-4f8c-b140-8509cf35a709 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:02.760077 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2f268-1337-4f8c-b140-8509cf35a709 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:02.761050 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2f268-1337-4f8c-b140-8509cf35a709 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:02.761600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2f268-1337-4f8c-b140-8509cf35a709 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:02.763252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2f268-1337-4f8c-b140-8509cf35a709 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:02.780977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 269/535] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:02.782180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2f268-1337-4f8c-b140-8509cf35a709 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:02.802292 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfea83-166d-44c6-a91b-8c616fa49ac0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:02.854473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2a1c4-53ce-48bc-bd01-b41c1c4ef99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:02.855800 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a1c4-53ce-48bc-bd01-b41c1c4ef99b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:02.856194 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a1c4-53ce-48bc-bd01-b41c1c4ef99b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:02.856577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a1c4-53ce-48bc-bd01-b41c1c4ef99b None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:02.857881 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2a1c4-53ce-48bc-bd01-b41c1c4ef99b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:02.858311 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2a1c4-53ce-48bc-bd01-b41c1c4ef99b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:02.860863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2a1c4-53ce-48bc-bd01-b41c1c4ef99b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:02.886351 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 267/536] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:02.886351 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2a1c4-53ce-48bc-bd01-b41c1c4ef99b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:02.897431 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2f268-1337-4f8c-b140-8509cf35a709 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:02.930843 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35b51d-8de5-4323-bb1f-85d3af57a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:02.931742 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b51d-8de5-4323-bb1f-85d3af57a5ff None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:02.931927 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b51d-8de5-4323-bb1f-85d3af57a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:02.932197 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b51d-8de5-4323-bb1f-85d3af57a5ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:02.939630 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35b51d-8de5-4323-bb1f-85d3af57a5ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:02.941022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35b51d-8de5-4323-bb1f-85d3af57a5ff None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8e35b51d-8de5-4323-bb1f-85d3af57a5ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:02.956625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:02.957560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:02.958438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:02.958438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:02.958438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:02.958438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:02.958438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:02.958438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:02.958438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:02.958438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:02.962492 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 270/537] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:02.963367 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35b51d-8de5-4323-bb1f-85d3af57a5ff None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:02.997082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2a1c4-53ce-48bc-bd01-b41c1c4ef99b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:03.032237 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e21473-8bec-4c5b-9278-d79796447835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:03.033289 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e21473-8bec-4c5b-9278-d79796447835 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:03.033870 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e21473-8bec-4c5b-9278-d79796447835 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:03.034353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e21473-8bec-4c5b-9278-d79796447835 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:03.035386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e21473-8bec-4c5b-9278-d79796447835 None admin] RBAC: Adding query filter params (role.id=b18c84f91b764bea92cc22c80a49bcaa, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=4ce12ee27315460793dfedd294eb3c55) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:03.035923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e21473-8bec-4c5b-9278-d79796447835 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:03.037641 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e21473-8bec-4c5b-9278-d79796447835 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:03.043567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 268/538] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:02 2022] GET /identity/v3/role_assignments?user.id=4ce12ee27315460793dfedd294eb3c55&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=b18c84f91b764bea92cc22c80a49bcaa => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:03.044598 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e21473-8bec-4c5b-9278-d79796447835 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:03.096218 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35b51d-8de5-4323-bb1f-85d3af57a5ff None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:03.173942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2695db5-6d69-45a8-b625-21935bc75c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:03.175495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2695db5-6d69-45a8-b625-21935bc75c9c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:03.176040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2695db5-6d69-45a8-b625-21935bc75c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:03.176520 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2695db5-6d69-45a8-b625-21935bc75c9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:03.177609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2695db5-6d69-45a8-b625-21935bc75c9c None admin] RBAC: Adding query filter params (role.id=b18c84f91b764bea92cc22c80a49bcaa, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=3888fb083b0149bd92054cffa88c51e9) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:03.178173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2695db5-6d69-45a8-b625-21935bc75c9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:03.181195 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2695db5-6d69-45a8-b625-21935bc75c9c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:03.196263 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 271/539] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:02 2022] GET /identity/v3/role_assignments?user.id=3888fb083b0149bd92054cffa88c51e9&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=b18c84f91b764bea92cc22c80a49bcaa => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:03.237266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e21473-8bec-4c5b-9278-d79796447835 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:03.277120 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811f412-f572-4e24-b2fd-dcc69b7794a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:03.277824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811f412-f572-4e24-b2fd-dcc69b7794a3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:03.278114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811f412-f572-4e24-b2fd-dcc69b7794a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:03.278391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811f412-f572-4e24-b2fd-dcc69b7794a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:03.279253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811f412-f572-4e24-b2fd-dcc69b7794a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:03.279569 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811f412-f572-4e24-b2fd-dcc69b7794a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:03.281077 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811f412-f572-4e24-b2fd-dcc69b7794a3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:03.305201 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 269/540] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:03.311914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2695db5-6d69-45a8-b625-21935bc75c9c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:03.457010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2695db5-6d69-45a8-b625-21935bc75c9c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:03.508092 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917296f9-a263-4a6d-ad3f-ba83e0542e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:03.508784 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917296f9-a263-4a6d-ad3f-ba83e0542e3f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:03.509075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917296f9-a263-4a6d-ad3f-ba83e0542e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:03.509358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917296f9-a263-4a6d-ad3f-ba83e0542e3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:03.510248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917296f9-a263-4a6d-ad3f-ba83e0542e3f None admin] RBAC: Adding query filter params (role.id=b18c84f91b764bea92cc22c80a49bcaa, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=8aa998f15cd543338cd0fc8b5a501066) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:03.510571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917296f9-a263-4a6d-ad3f-ba83e0542e3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:03.512061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917296f9-a263-4a6d-ad3f-ba83e0542e3f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:03.522898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 272/541] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:03 2022] GET /identity/v3/role_assignments?user.id=8aa998f15cd543338cd0fc8b5a501066&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=b18c84f91b764bea92cc22c80a49bcaa => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:03.689946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c0d3-09eb-4578-a068-f2407822f38a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:03.690312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c0d3-09eb-4578-a068-f2407822f38a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:03.690516 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c0d3-09eb-4578-a068-f2407822f38a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:03.692126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 270/542] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:03.697773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fe9aa-0a7b-40ce-bc8e-311f2ab042ac None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:03.698060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fe9aa-0a7b-40ce-bc8e-311f2ab042ac None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:03.698353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fe9aa-0a7b-40ce-bc8e-311f2ab042ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:03.723105 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7c5fe9aa-0a7b-40ce-bc8e-311f2ab042ac None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:03.724246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7c5fe9aa-0a7b-40ce-bc8e-311f2ab042ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:03.815518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 273/543] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:03.846191 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502c0d3-09eb-4578-a068-f2407822f38a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:03.977336 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502c0d3-09eb-4578-a068-f2407822f38a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:04.012365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a6a4b-a0f0-4c89-98d5-6589546cc771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:04.013172 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a6a4b-a0f0-4c89-98d5-6589546cc771 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:04.013991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a6a4b-a0f0-4c89-98d5-6589546cc771 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:04.014292 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a6a4b-a0f0-4c89-98d5-6589546cc771 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:04.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a6a4b-a0f0-4c89-98d5-6589546cc771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-369a6a4b-a0f0-4c89-98d5-6589546cc771 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:04.035485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:04.036403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:04.037215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:04.037215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:04.037215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:04.037215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:04.037215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:04.037215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:04.037215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:04.037215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:04.037215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:04.037215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:04.037215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:04.037215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:04.037215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 271/544] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:04.042563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fe9aa-0a7b-40ce-bc8e-311f2ab042ac None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:04.189017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fe9aa-0a7b-40ce-bc8e-311f2ab042ac None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:04.235230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ba3c4-caae-4839-8296-4cc799b47fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:04.235824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ba3c4-caae-4839-8296-4cc799b47fdf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:04.236105 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ba3c4-caae-4839-8296-4cc799b47fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:04.236375 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ba3c4-caae-4839-8296-4cc799b47fdf None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:04.237115 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ba3c4-caae-4839-8296-4cc799b47fdf None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:04.237418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ba3c4-caae-4839-8296-4cc799b47fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:04.238816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ba3c4-caae-4839-8296-4cc799b47fdf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:04.254427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 274/545] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:46:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:04.259526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a6a4b-a0f0-4c89-98d5-6589546cc771 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:04.432980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a6a4b-a0f0-4c89-98d5-6589546cc771 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:04.480460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bba82-f6ac-42b9-8fd3-4dc21de2dba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:04.481256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bba82-f6ac-42b9-8fd3-4dc21de2dba1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:04.481551 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bba82-f6ac-42b9-8fd3-4dc21de2dba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:04.481839 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bba82-f6ac-42b9-8fd3-4dc21de2dba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:04.495609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bba82-f6ac-42b9-8fd3-4dc21de2dba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:04.496994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bba82-f6ac-42b9-8fd3-4dc21de2dba1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-534bba82-f6ac-42b9-8fd3-4dc21de2dba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:04.518644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:04.519897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:04.520814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:04.520814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:04.520814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:04.520814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:04.520814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 272/546] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:04.530683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ba3c4-caae-4839-8296-4cc799b47fdf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:04.622777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758abb9-a190-489b-bc5f-64ca4da14ec0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:04.623645 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758abb9-a190-489b-bc5f-64ca4da14ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:04.623885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758abb9-a190-489b-bc5f-64ca4da14ec0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:04.625250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 273/547] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:46:04.630588 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ef612-1db1-4548-ae1a-8fc41bbf706a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:04.630876 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ef612-1db1-4548-ae1a-8fc41bbf706a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:04.631154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ef612-1db1-4548-ae1a-8fc41bbf706a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:04.652849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-163ef612-1db1-4548-ae1a-8fc41bbf706a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:04.654116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-163ef612-1db1-4548-ae1a-8fc41bbf706a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:04.681866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ba3c4-caae-4839-8296-4cc799b47fdf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:04.716598 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd42ec-e10d-431e-a0ce-ad5ec76a7fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:04.717275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd42ec-e10d-431e-a0ce-ad5ec76a7fca None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:04.717575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd42ec-e10d-431e-a0ce-ad5ec76a7fca None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:04.717859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd42ec-e10d-431e-a0ce-ad5ec76a7fca None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:04.718591 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd42ec-e10d-431e-a0ce-ad5ec76a7fca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:04.718894 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd42ec-e10d-431e-a0ce-ad5ec76a7fca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:04.725267 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd42ec-e10d-431e-a0ce-ad5ec76a7fca None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:04.740073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 275/548] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:04.746632 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd42ec-e10d-431e-a0ce-ad5ec76a7fca None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:04.777916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 274/549] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:46:04.803166 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ef612-1db1-4548-ae1a-8fc41bbf706a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:04.945832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd42ec-e10d-431e-a0ce-ad5ec76a7fca None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:04.967892 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ef612-1db1-4548-ae1a-8fc41bbf706a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:05.004938 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fc39a-5f9d-4d3f-9551-2d47069deae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:05.005698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fc39a-5f9d-4d3f-9551-2d47069deae4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:05.005985 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fc39a-5f9d-4d3f-9551-2d47069deae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:05.006260 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fc39a-5f9d-4d3f-9551-2d47069deae4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:05.020507 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fc39a-5f9d-4d3f-9551-2d47069deae4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:05.022871 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fc39a-5f9d-4d3f-9551-2d47069deae4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:05.027309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b3d6f-ca6a-4215-b02d-6133beaf438d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:05.028114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b3d6f-ca6a-4215-b02d-6133beaf438d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:05.028399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b3d6f-ca6a-4215-b02d-6133beaf438d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:05.028676 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b3d6f-ca6a-4215-b02d-6133beaf438d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:05.039227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b3d6f-ca6a-4215-b02d-6133beaf438d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e83fc39a-5f9d-4d3f-9551-2d47069deae4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:05.046366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:05.047266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:05.048188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:05.048188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:05.048188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:05.048188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:05.048188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:05.048188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:05.048188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:05.048188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:05.048188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 20:46:05.048188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b73b3d6f-ca6a-4215-b02d-6133beaf438d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:05.048701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:05.049548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:05.050403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:05.050403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:05.050403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:05.050403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:05.050403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:05.050403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:05.050403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:05.050403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:05.050403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:05.050403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:05.050403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:05.050403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:05.051030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 276/550] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:46:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:05.054126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 275/551] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:05.054952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fc39a-5f9d-4d3f-9551-2d47069deae4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:05.058402 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b3d6f-ca6a-4215-b02d-6133beaf438d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:05.186020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b3d6f-ca6a-4215-b02d-6133beaf438d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:05.221341 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c09215-d52c-4030-a4ee-824f7d918897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:05.222066 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c09215-d52c-4030-a4ee-824f7d918897 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:05.222355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c09215-d52c-4030-a4ee-824f7d918897 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:05.222637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c09215-d52c-4030-a4ee-824f7d918897 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:05.223389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c09215-d52c-4030-a4ee-824f7d918897 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:05.223698 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c09215-d52c-4030-a4ee-824f7d918897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:05.225076 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c09215-d52c-4030-a4ee-824f7d918897 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:05.234557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 276/552] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:46:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:05.240126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c09215-d52c-4030-a4ee-824f7d918897 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:05.319460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fc39a-5f9d-4d3f-9551-2d47069deae4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:05.359955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c09215-d52c-4030-a4ee-824f7d918897 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:05.387310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9f813-1334-4237-ae36-ca4c1a506770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:05.387980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9f813-1334-4237-ae36-ca4c1a506770 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:05.388261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9f813-1334-4237-ae36-ca4c1a506770 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:05.388576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9f813-1334-4237-ae36-ca4c1a506770 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:05.389407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9f813-1334-4237-ae36-ca4c1a506770 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:05.389738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9f813-1334-4237-ae36-ca4c1a506770 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:05.391167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9f813-1334-4237-ae36-ca4c1a506770 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:05.417547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e94320-75ae-431c-90d6-ede38b3337ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:05.418363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e94320-75ae-431c-90d6-ede38b3337ce None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:05.418641 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e94320-75ae-431c-90d6-ede38b3337ce None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:05.418908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e94320-75ae-431c-90d6-ede38b3337ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:05.423430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 277/553] 10.222.0.35 () {56 vars in 1135 bytes} [Wed May 11 20:46:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:05.429031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9f813-1334-4237-ae36-ca4c1a506770 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:05.437952 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e94320-75ae-431c-90d6-ede38b3337ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:05.439420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e94320-75ae-431c-90d6-ede38b3337ce None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-20e94320-75ae-431c-90d6-ede38b3337ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:05.474072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:05.474993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:05.475867 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:05.475867 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:05.475867 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:05.475867 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:05.478648 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 277/554] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:05.480552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e94320-75ae-431c-90d6-ede38b3337ce None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:05.549272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9f813-1334-4237-ae36-ca4c1a506770 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:05.598313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722ecd4-9f24-4eee-8d6d-5e55330f2387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:05.599325 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722ecd4-9f24-4eee-8d6d-5e55330f2387 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:05.599828 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722ecd4-9f24-4eee-8d6d-5e55330f2387 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:05.600300 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722ecd4-9f24-4eee-8d6d-5e55330f2387 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:05.635353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e94320-75ae-431c-90d6-ede38b3337ce None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:05.671601 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aa2c4-4770-46aa-906e-b923dcac07ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:05.672081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa2c4-4770-46aa-906e-b923dcac07ea None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:05.672369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa2c4-4770-46aa-906e-b923dcac07ea None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:05.672647 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa2c4-4770-46aa-906e-b923dcac07ea None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:05.673373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2aa2c4-4770-46aa-906e-b923dcac07ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:05.673710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2aa2c4-4770-46aa-906e-b923dcac07ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:05.675097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2aa2c4-4770-46aa-906e-b923dcac07ea None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:05.689369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 278/555] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:05.694627 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aa2c4-4770-46aa-906e-b923dcac07ea None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:05.754514 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722ecd4-9f24-4eee-8d6d-5e55330f2387 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:05.756017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722ecd4-9f24-4eee-8d6d-5e55330f2387 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:05.799768 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aa2c4-4770-46aa-906e-b923dcac07ea None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:05.841912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b0ea3-9fee-4c9f-b352-a72d9622fbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:05.845568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b0ea3-9fee-4c9f-b352-a72d9622fbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:05.845860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b0ea3-9fee-4c9f-b352-a72d9622fbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:05.846136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b0ea3-9fee-4c9f-b352-a72d9622fbc8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:05.854114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b0ea3-9fee-4c9f-b352-a72d9622fbc8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:05.855509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b0ea3-9fee-4c9f-b352-a72d9622fbc8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-569b0ea3-9fee-4c9f-b352-a72d9622fbc8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:05.869986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:05.870935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:05.871850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:05.871850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:05.871850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:05.871850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:05.871850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:05.871850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:05.871850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:05.871850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:05.871850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 20:46:05.871850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:05.871850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 279/556] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 11 20:46:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:05.877392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b0ea3-9fee-4c9f-b352-a72d9622fbc8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:05.935781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 278/557] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:46:05.937249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb5ad-4216-4f01-928e-601a5e7a123c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:05.937569 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb5ad-4216-4f01-928e-601a5e7a123c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:05.937855 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bb5ad-4216-4f01-928e-601a5e7a123c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:05.939296 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 279/558] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:05.942795 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb5ad-4216-4f01-928e-601a5e7a123c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:05.993845 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b0ea3-9fee-4c9f-b352-a72d9622fbc8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:06.030020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cbf7a-c5b3-4849-b9d7-0806c58f8a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:06.030699 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cbf7a-c5b3-4849-b9d7-0806c58f8a5b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.030981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cbf7a-c5b3-4849-b9d7-0806c58f8a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.031254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cbf7a-c5b3-4849-b9d7-0806c58f8a5b None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.032126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cbf7a-c5b3-4849-b9d7-0806c58f8a5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:06.032471 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cbf7a-c5b3-4849-b9d7-0806c58f8a5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:06.034903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cbf7a-c5b3-4849-b9d7-0806c58f8a5b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:06.045984 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bb5ad-4216-4f01-928e-601a5e7a123c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:06.052295 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 280/559] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 11 20:46:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:06.053938 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f793f-1f4c-453e-84c2-1dcab7d03846 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.054391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f793f-1f4c-453e-84c2-1dcab7d03846 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.057162 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f793f-1f4c-453e-84c2-1dcab7d03846 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.057162 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 281/560] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:06.057814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea59e5-0bfd-4e44-8eb3-30cfb66d7893 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.058097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea59e5-0bfd-4e44-8eb3-30cfb66d7893 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.058371 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea59e5-0bfd-4e44-8eb3-30cfb66d7893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.074672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0aea59e5-0bfd-4e44-8eb3-30cfb66d7893 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:06.075834 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0aea59e5-0bfd-4e44-8eb3-30cfb66d7893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:06.084651 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8f40e-9bf6-4df1-8a73-00bdaa49dbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:06.085447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8f40e-9bf6-4df1-8a73-00bdaa49dbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.085766 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8f40e-9bf6-4df1-8a73-00bdaa49dbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.086039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8f40e-9bf6-4df1-8a73-00bdaa49dbd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.096521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8f40e-9bf6-4df1-8a73-00bdaa49dbd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:06.098063 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8f40e-9bf6-4df1-8a73-00bdaa49dbd8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-74a8f40e-9bf6-4df1-8a73-00bdaa49dbd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:06.120207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:06.121156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:06.123526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:06.123526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:06.123526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:06.123526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:06.123526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 280/561] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:06.123526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8f40e-9bf6-4df1-8a73-00bdaa49dbd8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:06.152534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 282/562] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:06.165312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d59657-b0cb-405c-b48b-a79fd1b28710 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.165977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d59657-b0cb-405c-b48b-a79fd1b28710 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.166496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d59657-b0cb-405c-b48b-a79fd1b28710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.183378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-86d59657-b0cb-405c-b48b-a79fd1b28710 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:06.184545 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-86d59657-b0cb-405c-b48b-a79fd1b28710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:06.222626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8f40e-9bf6-4df1-8a73-00bdaa49dbd8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:06.261555 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 283/563] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:06.261555 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d59657-b0cb-405c-b48b-a79fd1b28710 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:06.266867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4329b33-002c-4370-b3e0-466df263aa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:06.268065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4329b33-002c-4370-b3e0-466df263aa82 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.268634 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4329b33-002c-4370-b3e0-466df263aa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.268947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4329b33-002c-4370-b3e0-466df263aa82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.281804 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4329b33-002c-4370-b3e0-466df263aa82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:06.283308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4329b33-002c-4370-b3e0-466df263aa82 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c4329b33-002c-4370-b3e0-466df263aa82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:06.302001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:06.303119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:06.304139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:06.304139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:06.304139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:06.304139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:06.304139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 281/564] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:06.304139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4329b33-002c-4370-b3e0-466df263aa82 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:06.349388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d59657-b0cb-405c-b48b-a79fd1b28710 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:06.382175 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745a83f-b704-46c5-aa17-48a340aa43da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:06.382781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745a83f-b704-46c5-aa17-48a340aa43da None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.383067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745a83f-b704-46c5-aa17-48a340aa43da None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.383368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745a83f-b704-46c5-aa17-48a340aa43da None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.384087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745a83f-b704-46c5-aa17-48a340aa43da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:06.384410 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745a83f-b704-46c5-aa17-48a340aa43da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:06.385843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745a83f-b704-46c5-aa17-48a340aa43da None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:06.396930 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 284/565] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:06.397440 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4329b33-002c-4370-b3e0-466df263aa82 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:06.397849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745a83f-b704-46c5-aa17-48a340aa43da None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:06.429668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a4f7d-0cb8-4bfa-b044-cc6abd9e5965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:06.430455 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a4f7d-0cb8-4bfa-b044-cc6abd9e5965 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.430739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a4f7d-0cb8-4bfa-b044-cc6abd9e5965 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.431015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a4f7d-0cb8-4bfa-b044-cc6abd9e5965 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.441155 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4a4f7d-0cb8-4bfa-b044-cc6abd9e5965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6c4a4f7d-0cb8-4bfa-b044-cc6abd9e5965 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:06.448757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:06.449874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:06.450723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:06.450723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:06.450723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:06.450723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:06.450723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:06.450723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:06.450723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:06.450723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:06.450723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:06.450723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:06.450723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:06.450723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:06.450723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 282/566] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:06.451494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695ded7-fc47-4d76-bb1f-0a1277b10279 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.451494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695ded7-fc47-4d76-bb1f-0a1277b10279 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.451692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695ded7-fc47-4d76-bb1f-0a1277b10279 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.452925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 283/567] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:06.454364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695ded7-fc47-4d76-bb1f-0a1277b10279 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:06.497050 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745a83f-b704-46c5-aa17-48a340aa43da None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:06.533062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4384c-2937-44f5-aa18-dd18b6fc21eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:06.533882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4384c-2937-44f5-aa18-dd18b6fc21eb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.534192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4384c-2937-44f5-aa18-dd18b6fc21eb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.534469 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4384c-2937-44f5-aa18-dd18b6fc21eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.544462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4384c-2937-44f5-aa18-dd18b6fc21eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:06.551890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695ded7-fc47-4d76-bb1f-0a1277b10279 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-bea4384c-2937-44f5-aa18-dd18b6fc21eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:06.552814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:06.553905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:06.559609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:06.559609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:06.559609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:06.559609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:06.559609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:06.559609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:06.559609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:06.559609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:06.559609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:06.559609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:06.559609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:06.559609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:06.559609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 285/568] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:06.559609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4384c-2937-44f5-aa18-dd18b6fc21eb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:06.585061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4c8f4-1177-4642-ad83-fbcf5eac500a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:06.585735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c8f4-1177-4642-ad83-fbcf5eac500a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.586016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c8f4-1177-4642-ad83-fbcf5eac500a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.586292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c8f4-1177-4642-ad83-fbcf5eac500a None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.587000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4c8f4-1177-4642-ad83-fbcf5eac500a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:06.587318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4c8f4-1177-4642-ad83-fbcf5eac500a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:06.588684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4c8f4-1177-4642-ad83-fbcf5eac500a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:06.600323 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 284/569] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:06.601656 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3c02f-6b7c-4bf7-8343-09b48c098bdb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.601944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3c02f-6b7c-4bf7-8343-09b48c098bdb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.602221 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3c02f-6b7c-4bf7-8343-09b48c098bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.617888 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-90a3c02f-6b7c-4bf7-8343-09b48c098bdb None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:06.619090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-90a3c02f-6b7c-4bf7-8343-09b48c098bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:06.654732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4384c-2937-44f5-aa18-dd18b6fc21eb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:06.681499 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 285/570] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:06.682372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3c02f-6b7c-4bf7-8343-09b48c098bdb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:06.686418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67821ca-6d5e-43a3-98b3-177e934cf004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:06.687319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67821ca-6d5e-43a3-98b3-177e934cf004 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.687725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67821ca-6d5e-43a3-98b3-177e934cf004 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.688101 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67821ca-6d5e-43a3-98b3-177e934cf004 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.694799 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67821ca-6d5e-43a3-98b3-177e934cf004 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:06.696366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67821ca-6d5e-43a3-98b3-177e934cf004 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d67821ca-6d5e-43a3-98b3-177e934cf004 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:06.710901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:06.711980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:06.713480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:06.713480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:06.713480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:06.713480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:06.713480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:06.713480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:06.713480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:06.713480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:06.713480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 286/571] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:06.713480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67821ca-6d5e-43a3-98b3-177e934cf004 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:06.774945 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3c02f-6b7c-4bf7-8343-09b48c098bdb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:06.806995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42bd4d-2403-4d23-b64b-751e50e1c6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:06.807647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42bd4d-2403-4d23-b64b-751e50e1c6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.807928 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42bd4d-2403-4d23-b64b-751e50e1c6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.808203 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42bd4d-2403-4d23-b64b-751e50e1c6d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.808727 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67821ca-6d5e-43a3-98b3-177e934cf004 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:06.808936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42bd4d-2403-4d23-b64b-751e50e1c6d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:06.809241 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42bd4d-2403-4d23-b64b-751e50e1c6d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:06.810662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42bd4d-2403-4d23-b64b-751e50e1c6d5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:06.818187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 286/572] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:46:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:06.818970 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42bd4d-2403-4d23-b64b-751e50e1c6d5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:06.845299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dd964-9e93-43e3-bd96-2f6837c01f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:06.846003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dd964-9e93-43e3-bd96-2f6837c01f73 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.846288 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dd964-9e93-43e3-bd96-2f6837c01f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.846568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dd964-9e93-43e3-bd96-2f6837c01f73 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.847310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dd964-9e93-43e3-bd96-2f6837c01f73 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:06.847619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dd964-9e93-43e3-bd96-2f6837c01f73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:06.848985 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dd964-9e93-43e3-bd96-2f6837c01f73 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:06.856713 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 287/573] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:46:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:06.858398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dd964-9e93-43e3-bd96-2f6837c01f73 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:06.913779 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42bd4d-2403-4d23-b64b-751e50e1c6d5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:06.945310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb85d9e-2c98-432c-8dc4-4b9cdb0f833d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:06.946115 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb85d9e-2c98-432c-8dc4-4b9cdb0f833d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.946397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb85d9e-2c98-432c-8dc4-4b9cdb0f833d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.946671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb85d9e-2c98-432c-8dc4-4b9cdb0f833d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.953276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dd964-9e93-43e3-bd96-2f6837c01f73 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:06.953590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb85d9e-2c98-432c-8dc4-4b9cdb0f833d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:06.955023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb85d9e-2c98-432c-8dc4-4b9cdb0f833d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-cbb85d9e-2c98-432c-8dc4-4b9cdb0f833d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:06.969329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:06.970475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:06.971377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:06.971377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:06.971377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:06.971377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:06.971377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:06.971377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:06.971377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:06.971377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:06.971377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 287/574] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:06.971377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb85d9e-2c98-432c-8dc4-4b9cdb0f833d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:06.985244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c519cd-2a1d-4bfc-b2aa-8cf9813e4ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:06.986068 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c519cd-2a1d-4bfc-b2aa-8cf9813e4ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:06.986350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c519cd-2a1d-4bfc-b2aa-8cf9813e4ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:06.986626 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c519cd-2a1d-4bfc-b2aa-8cf9813e4ba3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:06.996230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c519cd-2a1d-4bfc-b2aa-8cf9813e4ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b7c519cd-2a1d-4bfc-b2aa-8cf9813e4ba3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:07.003946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:07.005058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:07.006112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:07.006112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:07.006112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:07.006112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:07.006112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:07.006112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:07.006112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:07.006112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:07.006112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:07.006112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:07.006112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:07.006112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:07.006112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 288/575] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:07.006806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c519cd-2a1d-4bfc-b2aa-8cf9813e4ba3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:07.064463 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb85d9e-2c98-432c-8dc4-4b9cdb0f833d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:07.096814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696a5e7-63dd-4287-931e-2bcd9f43ff45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:07.097587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696a5e7-63dd-4287-931e-2bcd9f43ff45 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:07.097881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696a5e7-63dd-4287-931e-2bcd9f43ff45 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:07.098166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696a5e7-63dd-4287-931e-2bcd9f43ff45 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:07.098946 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696a5e7-63dd-4287-931e-2bcd9f43ff45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:07.099317 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696a5e7-63dd-4287-931e-2bcd9f43ff45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:07.100080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c519cd-2a1d-4bfc-b2aa-8cf9813e4ba3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:07.100778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696a5e7-63dd-4287-931e-2bcd9f43ff45 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:07.111785 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 288/576] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:07.112561 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696a5e7-63dd-4287-931e-2bcd9f43ff45 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:07.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a79790-2ff3-4310-9e1f-470dc323d379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:07.132450 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a79790-2ff3-4310-9e1f-470dc323d379 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:07.132739 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a79790-2ff3-4310-9e1f-470dc323d379 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:07.133014 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a79790-2ff3-4310-9e1f-470dc323d379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:07.143641 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a79790-2ff3-4310-9e1f-470dc323d379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:07.145340 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a79790-2ff3-4310-9e1f-470dc323d379 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e1a79790-2ff3-4310-9e1f-470dc323d379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:07.162343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:07.163291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:07.164231 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:07.164231 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:07.164231 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:07.164231 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:07.164231 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 289/577] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:07.165063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a79790-2ff3-4310-9e1f-470dc323d379 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:07.206844 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696a5e7-63dd-4287-931e-2bcd9f43ff45 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:07.238201 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5279932-0030-4b90-a8aa-e47163d173af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:07.238982 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279932-0030-4b90-a8aa-e47163d173af None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:07.239265 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279932-0030-4b90-a8aa-e47163d173af None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:07.239545 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279932-0030-4b90-a8aa-e47163d173af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:07.249633 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5279932-0030-4b90-a8aa-e47163d173af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:07.251094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5279932-0030-4b90-a8aa-e47163d173af None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:07.258464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a79790-2ff3-4310-9e1f-470dc323d379 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e5279932-0030-4b90-a8aa-e47163d173af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:07.268215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:07.269603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:07.270535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:07.270535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:07.270535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:07.270535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:07.270535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 289/578] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:07.270535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5279932-0030-4b90-a8aa-e47163d173af None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:07.291102 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3e122-422a-4fb3-99fa-e31169ba77fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:07.291762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3e122-422a-4fb3-99fa-e31169ba77fe None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:07.292046 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3e122-422a-4fb3-99fa-e31169ba77fe None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:07.292323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3e122-422a-4fb3-99fa-e31169ba77fe None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:07.293108 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3e122-422a-4fb3-99fa-e31169ba77fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:07.293421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3e122-422a-4fb3-99fa-e31169ba77fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:07.294910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3e122-422a-4fb3-99fa-e31169ba77fe None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:07.306468 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 290/579] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:07.307269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3e122-422a-4fb3-99fa-e31169ba77fe None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:07.371540 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5279932-0030-4b90-a8aa-e47163d173af None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:07.400527 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3e122-422a-4fb3-99fa-e31169ba77fe None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:07.404320 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187ffac-992b-493e-a731-b9d2542b04bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:07.404980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187ffac-992b-493e-a731-b9d2542b04bf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:07.405272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187ffac-992b-493e-a731-b9d2542b04bf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:07.405577 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187ffac-992b-493e-a731-b9d2542b04bf None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:07.406319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187ffac-992b-493e-a731-b9d2542b04bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:07.406629 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187ffac-992b-493e-a731-b9d2542b04bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:07.408031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187ffac-992b-493e-a731-b9d2542b04bf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:07.415816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 290/580] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:46:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:07.416539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187ffac-992b-493e-a731-b9d2542b04bf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:07.431863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2107599-fc9c-4da1-a1d0-15bdfeed5cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:07.432517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2107599-fc9c-4da1-a1d0-15bdfeed5cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:07.432795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2107599-fc9c-4da1-a1d0-15bdfeed5cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:07.433065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2107599-fc9c-4da1-a1d0-15bdfeed5cb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:07.433915 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2107599-fc9c-4da1-a1d0-15bdfeed5cb1 None admin] RBAC: Adding query filter params (role.id=b18c84f91b764bea92cc22c80a49bcaa, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=85cb784bf9984abc9977c665a6db1656) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:07.434224 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2107599-fc9c-4da1-a1d0-15bdfeed5cb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:07.436251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2107599-fc9c-4da1-a1d0-15bdfeed5cb1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:07.441366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 291/581] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:07 2022] GET /identity/v3/role_assignments?user.id=85cb784bf9984abc9977c665a6db1656&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=b18c84f91b764bea92cc22c80a49bcaa => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:07.442151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2107599-fc9c-4da1-a1d0-15bdfeed5cb1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:07.517405 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187ffac-992b-493e-a731-b9d2542b04bf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:07.551894 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1885b-cd8d-4142-921e-7af117cb5e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:07.552568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1885b-cd8d-4142-921e-7af117cb5e77 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:07.552849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1885b-cd8d-4142-921e-7af117cb5e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:07.553122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1885b-cd8d-4142-921e-7af117cb5e77 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:07.553882 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1885b-cd8d-4142-921e-7af117cb5e77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:07.554190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1885b-cd8d-4142-921e-7af117cb5e77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:07.554688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2107599-fc9c-4da1-a1d0-15bdfeed5cb1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:07.555578 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1885b-cd8d-4142-921e-7af117cb5e77 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:07.573110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 291/582] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:07.573839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1885b-cd8d-4142-921e-7af117cb5e77 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:07.589814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4761d-2dab-4949-b38f-e6fa76193faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:07.590501 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4761d-2dab-4949-b38f-e6fa76193faa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:07.590785 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4761d-2dab-4949-b38f-e6fa76193faa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:07.591062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4761d-2dab-4949-b38f-e6fa76193faa None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:07.591843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4761d-2dab-4949-b38f-e6fa76193faa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:07.592157 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4761d-2dab-4949-b38f-e6fa76193faa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:07.593585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4761d-2dab-4949-b38f-e6fa76193faa None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:07.609779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 292/583] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:07.609779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4761d-2dab-4949-b38f-e6fa76193faa None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:07.693032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1885b-cd8d-4142-921e-7af117cb5e77 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:07.711338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4761d-2dab-4949-b38f-e6fa76193faa None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:07.726494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cbe37-69c6-41bd-9f0b-e94632bda045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:07.727384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cbe37-69c6-41bd-9f0b-e94632bda045 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:07.727667 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cbe37-69c6-41bd-9f0b-e94632bda045 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:07.727948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cbe37-69c6-41bd-9f0b-e94632bda045 None admin] PATH_INFO: `/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/f400b94d3fbc40bdace4860fe83a0891/roles/b18c84f91b764bea92cc22c80a49bcaa` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:07.742611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cbe37-69c6-41bd-9f0b-e94632bda045 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c03e5fec995436aa5424d2be2e268aa, user_id=f400b94d3fbc40bdace4860fe83a0891, role_id=b18c84f91b764bea92cc22c80a49bcaa)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:07.744057 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cbe37-69c6-41bd-9f0b-e94632bda045 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:07.744885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86498fe-d9b4-4570-b988-7f45cccc5bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:07.745714 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86498fe-d9b4-4570-b988-7f45cccc5bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:07.745996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86498fe-d9b4-4570-b988-7f45cccc5bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:07.746268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86498fe-d9b4-4570-b988-7f45cccc5bc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:07.756575 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86498fe-d9b4-4570-b988-7f45cccc5bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:07.758053 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86498fe-d9b4-4570-b988-7f45cccc5bc7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b86498fe-d9b4-4570-b988-7f45cccc5bc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:07.775059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:07.776284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:07.777224 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:07.777224 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:07.777224 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:07.777224 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:07.777224 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 293/584] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:07.777224 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86498fe-d9b4-4570-b988-7f45cccc5bc7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:07.814707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 292/585] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:46:07 2022] PUT /identity/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/f400b94d3fbc40bdace4860fe83a0891/roles/b18c84f91b764bea92cc22c80a49bcaa => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:46:07.816442 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cbe37-69c6-41bd-9f0b-e94632bda045 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:07.888549 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86498fe-d9b4-4570-b988-7f45cccc5bc7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:07.925777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534abc3-540e-409f-a684-0130a2f859df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:07.926598 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534abc3-540e-409f-a684-0130a2f859df None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:07.926886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534abc3-540e-409f-a684-0130a2f859df None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:07.927166 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534abc3-540e-409f-a684-0130a2f859df None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:07.935165 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534abc3-540e-409f-a684-0130a2f859df None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:07.937223 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534abc3-540e-409f-a684-0130a2f859df None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:07.950233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cbe37-69c6-41bd-9f0b-e94632bda045 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-7534abc3-540e-409f-a684-0130a2f859df None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:07.953203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:07.954183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:07.955192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:07.955192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:07.955192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:07.955192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:07.955192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:07.955192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:07.955192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:07.955192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:07.955192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 20:46:07.955192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:07.955192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 294/586] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:46:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:07.955791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534abc3-540e-409f-a684-0130a2f859df None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:07.991403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df346189-1946-4199-9fcb-caa3dd764fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:07.992670 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df346189-1946-4199-9fcb-caa3dd764fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:07.993166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df346189-1946-4199-9fcb-caa3dd764fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:07.993784 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df346189-1946-4199-9fcb-caa3dd764fb0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:08.008718 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df346189-1946-4199-9fcb-caa3dd764fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:08.008718 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df346189-1946-4199-9fcb-caa3dd764fb0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-df346189-1946-4199-9fcb-caa3dd764fb0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:08.025583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:08.026609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:08.027575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:08.027575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:08.027575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:08.027575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:08.027575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:08.027575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:08.027575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:08.027575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:08.027575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 20:46:08.027575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:08.032448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 293/587] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:46:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:08.032448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df346189-1946-4199-9fcb-caa3dd764fb0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:08.063911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534abc3-540e-409f-a684-0130a2f859df None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:08.099556 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65356fd5-3734-4288-9654-ae457fb01ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:08.099985 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65356fd5-3734-4288-9654-ae457fb01ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:08.100267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65356fd5-3734-4288-9654-ae457fb01ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:08.100541 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65356fd5-3734-4288-9654-ae457fb01ec2 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:08.101287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65356fd5-3734-4288-9654-ae457fb01ec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:08.101584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65356fd5-3734-4288-9654-ae457fb01ec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:08.103010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65356fd5-3734-4288-9654-ae457fb01ec2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:08.115129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 295/588] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:08.115783 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65356fd5-3734-4288-9654-ae457fb01ec2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:08.143320 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df346189-1946-4199-9fcb-caa3dd764fb0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:08.179387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8b4d1-d70b-4d9d-86d0-d447bad0a9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:08.180459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8b4d1-d70b-4d9d-86d0-d447bad0a9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:08.180990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8b4d1-d70b-4d9d-86d0-d447bad0a9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:08.181516 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8b4d1-d70b-4d9d-86d0-d447bad0a9e1 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:08.182787 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8b4d1-d70b-4d9d-86d0-d447bad0a9e1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:08.183430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8b4d1-d70b-4d9d-86d0-d447bad0a9e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:08.185177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8b4d1-d70b-4d9d-86d0-d447bad0a9e1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:08.203800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 294/589] 10.222.0.35 () {56 vars in 1137 bytes} [Wed May 11 20:46:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:08.204921 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8b4d1-d70b-4d9d-86d0-d447bad0a9e1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:08.218206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65356fd5-3734-4288-9654-ae457fb01ec2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:08.251848 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8b031-59b5-4722-a629-6ef101d83892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:08.252521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8b031-59b5-4722-a629-6ef101d83892 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:08.252802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8b031-59b5-4722-a629-6ef101d83892 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:08.253076 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8b031-59b5-4722-a629-6ef101d83892 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:08.253952 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8b031-59b5-4722-a629-6ef101d83892 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:08.254260 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8b031-59b5-4722-a629-6ef101d83892 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:08.255704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8b031-59b5-4722-a629-6ef101d83892 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:08.273393 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 296/590] 10.222.0.35 () {56 vars in 1137 bytes} [Wed May 11 20:46:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:08.274258 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8b031-59b5-4722-a629-6ef101d83892 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:08.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8b4d1-d70b-4d9d-86d0-d447bad0a9e1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:08.346937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e9db3-88f9-46d4-b575-d1ed96c8d5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:08.348123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e9db3-88f9-46d4-b575-d1ed96c8d5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:08.348655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e9db3-88f9-46d4-b575-d1ed96c8d5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:08.349134 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e9db3-88f9-46d4-b575-d1ed96c8d5f2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:08.356666 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e9db3-88f9-46d4-b575-d1ed96c8d5f2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:08.358592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e9db3-88f9-46d4-b575-d1ed96c8d5f2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-289e9db3-88f9-46d4-b575-d1ed96c8d5f2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:08.374372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:08.375366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:08.376354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:08.376354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:08.376354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:08.376354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:08.376354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:08.376354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:08.376354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:08.376354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:08.376354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 20:46:08.376354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:08.377772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8b031-59b5-4722-a629-6ef101d83892 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:08.379336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 295/591] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:08.380336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e9db3-88f9-46d4-b575-d1ed96c8d5f2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:08.411724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5231e-82d6-46dd-82d2-e436ecd0b00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:08.412513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5231e-82d6-46dd-82d2-e436ecd0b00a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:08.412794 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5231e-82d6-46dd-82d2-e436ecd0b00a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:08.413066 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5231e-82d6-46dd-82d2-e436ecd0b00a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:08.423349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5231e-82d6-46dd-82d2-e436ecd0b00a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:08.424802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5231e-82d6-46dd-82d2-e436ecd0b00a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-19f5231e-82d6-46dd-82d2-e436ecd0b00a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:08.442472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:08.443454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:08.444367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:08.444367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:08.444367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:08.444367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:08.448116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 297/592] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:08.449134 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5231e-82d6-46dd-82d2-e436ecd0b00a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:08.488163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e9db3-88f9-46d4-b575-d1ed96c8d5f2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:08.523408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faa0d6-7488-4deb-96eb-96d1164da665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:08.524548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa0d6-7488-4deb-96eb-96d1164da665 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:08.525069 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa0d6-7488-4deb-96eb-96d1164da665 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:08.525567 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faa0d6-7488-4deb-96eb-96d1164da665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:08.536409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faa0d6-7488-4deb-96eb-96d1164da665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:08.538175 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faa0d6-7488-4deb-96eb-96d1164da665 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:08.546915 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5231e-82d6-46dd-82d2-e436ecd0b00a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-81faa0d6-7488-4deb-96eb-96d1164da665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:08.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:08.558700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:08.559621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:08.559621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:08.559621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:08.559621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:08.562224 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 296/593] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:08.563383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faa0d6-7488-4deb-96eb-96d1164da665 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:08.587721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204987e5-3db9-4a65-857e-21a555791b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:08.588469 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204987e5-3db9-4a65-857e-21a555791b05 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:08.588724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204987e5-3db9-4a65-857e-21a555791b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:08.588995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204987e5-3db9-4a65-857e-21a555791b05 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:08.589906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204987e5-3db9-4a65-857e-21a555791b05 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:08.590215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204987e5-3db9-4a65-857e-21a555791b05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:08.592355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204987e5-3db9-4a65-857e-21a555791b05 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:08.610147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 298/594] 10.222.0.35 () {56 vars in 1139 bytes} [Wed May 11 20:46:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:08.611099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204987e5-3db9-4a65-857e-21a555791b05 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:08.668369 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faa0d6-7488-4deb-96eb-96d1164da665 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:08.704025 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86a2eb-32bc-4cc7-ac45-233a5f0b6c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:08.705067 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86a2eb-32bc-4cc7-ac45-233a5f0b6c92 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:08.705776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86a2eb-32bc-4cc7-ac45-233a5f0b6c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:08.706292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86a2eb-32bc-4cc7-ac45-233a5f0b6c92 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:08.707215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86a2eb-32bc-4cc7-ac45-233a5f0b6c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:08.707726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86a2eb-32bc-4cc7-ac45-233a5f0b6c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:08.709296 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86a2eb-32bc-4cc7-ac45-233a5f0b6c92 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:08.710975 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204987e5-3db9-4a65-857e-21a555791b05 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:08.722057 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 297/595] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:08.723184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86a2eb-32bc-4cc7-ac45-233a5f0b6c92 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:08.750607 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033f5b2-ac1f-46e2-9a69-a5047a4bf3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:08.751115 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033f5b2-ac1f-46e2-9a69-a5047a4bf3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:08.751403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033f5b2-ac1f-46e2-9a69-a5047a4bf3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:08.751722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033f5b2-ac1f-46e2-9a69-a5047a4bf3a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:08.752456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033f5b2-ac1f-46e2-9a69-a5047a4bf3a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:08.752796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033f5b2-ac1f-46e2-9a69-a5047a4bf3a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:08.754249 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033f5b2-ac1f-46e2-9a69-a5047a4bf3a7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:08.770525 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 299/596] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:08.771409 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033f5b2-ac1f-46e2-9a69-a5047a4bf3a7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:08.832834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86a2eb-32bc-4cc7-ac45-233a5f0b6c92 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:08.871144 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e563c-d305-4229-af2e-c324b6854d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:08.871437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033f5b2-ac1f-46e2-9a69-a5047a4bf3a7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:08.872445 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e563c-d305-4229-af2e-c324b6854d85 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:08.872955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e563c-d305-4229-af2e-c324b6854d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:08.873428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e563c-d305-4229-af2e-c324b6854d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:08.884531 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e563c-d305-4229-af2e-c324b6854d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:08.886387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e563c-d305-4229-af2e-c324b6854d85 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-716e563c-d305-4229-af2e-c324b6854d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:08.904744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:08.905663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:08.906608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:08.906608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:08.906608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:08.906608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:08.907284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 298/597] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:08.907964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e563c-d305-4229-af2e-c324b6854d85 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:08.908891 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d0a12-50cd-4edf-965c-6cdc82a7c9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:08.909718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d0a12-50cd-4edf-965c-6cdc82a7c9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:08.909996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d0a12-50cd-4edf-965c-6cdc82a7c9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:08.910355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d0a12-50cd-4edf-965c-6cdc82a7c9c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:08.917521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d0a12-50cd-4edf-965c-6cdc82a7c9c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:08.919017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d0a12-50cd-4edf-965c-6cdc82a7c9c3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-066d0a12-50cd-4edf-965c-6cdc82a7c9c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:08.934470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:08.935406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:08.936360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:08.936360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:08.936360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:08.936360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:08.936360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:08.936360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:08.936360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:08.936360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:08.940302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 300/598] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:08.941138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d0a12-50cd-4edf-965c-6cdc82a7c9c3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:09.014891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e563c-d305-4229-af2e-c324b6854d85 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:09.042467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d0a12-50cd-4edf-965c-6cdc82a7c9c3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:09.050137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4706e93-b655-4a12-b49d-801e5dc03d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:09.051252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4706e93-b655-4a12-b49d-801e5dc03d3d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:09.051743 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4706e93-b655-4a12-b49d-801e5dc03d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:09.052237 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4706e93-b655-4a12-b49d-801e5dc03d3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:09.059478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4706e93-b655-4a12-b49d-801e5dc03d3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:09.061767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4706e93-b655-4a12-b49d-801e5dc03d3d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d4706e93-b655-4a12-b49d-801e5dc03d3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:09.078024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:09.079390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:09.080394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:09.080394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:09.080394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:09.080394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:09.080394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:09.080394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:09.080394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:09.080394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:09.080864 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ed0e0-dfc2-4ee4-b5f0-bb14015c197d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:09.080864 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ed0e0-dfc2-4ee4-b5f0-bb14015c197d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:09.080864 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ed0e0-dfc2-4ee4-b5f0-bb14015c197d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:09.080864 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ed0e0-dfc2-4ee4-b5f0-bb14015c197d None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:09.081183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ed0e0-dfc2-4ee4-b5f0-bb14015c197d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:09.081183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ed0e0-dfc2-4ee4-b5f0-bb14015c197d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:09.082026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ed0e0-dfc2-4ee4-b5f0-bb14015c197d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:09.083550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 299/599] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:09.084559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4706e93-b655-4a12-b49d-801e5dc03d3d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:09.099499 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 301/600] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:09.100567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ed0e0-dfc2-4ee4-b5f0-bb14015c197d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:09.192317 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4706e93-b655-4a12-b49d-801e5dc03d3d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:09.199731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ed0e0-dfc2-4ee4-b5f0-bb14015c197d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:09.227860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7b25b-5b80-4338-902f-daa4d04901fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:09.228928 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7b25b-5b80-4338-902f-daa4d04901fa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:09.229424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7b25b-5b80-4338-902f-daa4d04901fa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:09.229941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7b25b-5b80-4338-902f-daa4d04901fa None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:09.231042 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7b25b-5b80-4338-902f-daa4d04901fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:09.231655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7b25b-5b80-4338-902f-daa4d04901fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:09.234109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7b25b-5b80-4338-902f-daa4d04901fa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:09.234520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92933f43-0a5d-40c6-a005-0cc56655e09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:09.235267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933f43-0a5d-40c6-a005-0cc56655e09e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:09.235620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933f43-0a5d-40c6-a005-0cc56655e09e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:09.235963 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92933f43-0a5d-40c6-a005-0cc56655e09e None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:09.236842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92933f43-0a5d-40c6-a005-0cc56655e09e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:09.237178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92933f43-0a5d-40c6-a005-0cc56655e09e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:09.238770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92933f43-0a5d-40c6-a005-0cc56655e09e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:09.249315 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 300/601] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:09.250522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7b25b-5b80-4338-902f-daa4d04901fa None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:09.256154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 302/602] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:09.261901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92933f43-0a5d-40c6-a005-0cc56655e09e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:09.352367 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7b25b-5b80-4338-902f-daa4d04901fa None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:09.360525 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92933f43-0a5d-40c6-a005-0cc56655e09e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:09.387054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde10fdc-7c88-42ef-bd04-6497387e1e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:09.388255 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde10fdc-7c88-42ef-bd04-6497387e1e3f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:09.388886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde10fdc-7c88-42ef-bd04-6497387e1e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:09.389481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde10fdc-7c88-42ef-bd04-6497387e1e3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:09.395071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5566-1a82-4188-8353-06e8ecb25e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:09.395955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5566-1a82-4188-8353-06e8ecb25e50 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:09.396236 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5566-1a82-4188-8353-06e8ecb25e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:09.396511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5566-1a82-4188-8353-06e8ecb25e50 None admin] PATH_INFO: `/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/4ce12ee27315460793dfedd294eb3c55/roles/b18c84f91b764bea92cc22c80a49bcaa` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:09.398519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde10fdc-7c88-42ef-bd04-6497387e1e3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:09.400203 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde10fdc-7c88-42ef-bd04-6497387e1e3f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:09.412086 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5566-1a82-4188-8353-06e8ecb25e50 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c03e5fec995436aa5424d2be2e268aa, user_id=4ce12ee27315460793dfedd294eb3c55, role_id=b18c84f91b764bea92cc22c80a49bcaa)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:09.413553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5566-1a82-4188-8353-06e8ecb25e50 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-cde10fdc-7c88-42ef-bd04-6497387e1e3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:09.418775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:09.420244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:09.421166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:09.421166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:09.421166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:09.421166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:09.421166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:09.421166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:09.421166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:09.421166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:09.421166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 301/603] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:09.422315 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde10fdc-7c88-42ef-bd04-6497387e1e3f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:09.493364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 303/604] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:46:09 2022] PUT /identity/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/4ce12ee27315460793dfedd294eb3c55/roles/b18c84f91b764bea92cc22c80a49bcaa => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 20:46:09.494513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5566-1a82-4188-8353-06e8ecb25e50 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:09.584461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde10fdc-7c88-42ef-bd04-6497387e1e3f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:09.630638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b76b8-cd1d-4de6-a293-e822d5f94db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:09.631635 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b76b8-cd1d-4de6-a293-e822d5f94db1 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:09.631919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b76b8-cd1d-4de6-a293-e822d5f94db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:09.632194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b76b8-cd1d-4de6-a293-e822d5f94db1 None admin] PATH_INFO: `/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/3888fb083b0149bd92054cffa88c51e9/roles/b18c84f91b764bea92cc22c80a49bcaa` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:09.650653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b76b8-cd1d-4de6-a293-e822d5f94db1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c03e5fec995436aa5424d2be2e268aa, user_id=3888fb083b0149bd92054cffa88c51e9, role_id=b18c84f91b764bea92cc22c80a49bcaa)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:09.652297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b76b8-cd1d-4de6-a293-e822d5f94db1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:09.690641 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5566-1a82-4188-8353-06e8ecb25e50 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:09.731543 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12323e1c-0f9d-4b10-98d7-50c0812bbaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:09.732779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12323e1c-0f9d-4b10-98d7-50c0812bbaeb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:09.733395 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12323e1c-0f9d-4b10-98d7-50c0812bbaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:09.734971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12323e1c-0f9d-4b10-98d7-50c0812bbaeb None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:09.735824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12323e1c-0f9d-4b10-98d7-50c0812bbaeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:09.736145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12323e1c-0f9d-4b10-98d7-50c0812bbaeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:09.737786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12323e1c-0f9d-4b10-98d7-50c0812bbaeb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:09.743442 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 302/605] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:46:09 2022] PUT /identity/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/3888fb083b0149bd92054cffa88c51e9/roles/b18c84f91b764bea92cc22c80a49bcaa => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:46:09.745070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c5b68-40a3-4e25-a17d-3b0203c6f91a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:09.745070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c5b68-40a3-4e25-a17d-3b0203c6f91a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:09.745356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c5b68-40a3-4e25-a17d-3b0203c6f91a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:09.746966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 303/606] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:09.752689 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e91a3-dfdc-44c1-9f6c-e89ac6b3c610 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:09.753130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e91a3-dfdc-44c1-9f6c-e89ac6b3c610 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:09.753240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 304/607] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:09.753406 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e91a3-dfdc-44c1-9f6c-e89ac6b3c610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:09.758779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12323e1c-0f9d-4b10-98d7-50c0812bbaeb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:09.772536 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bb7e91a3-dfdc-44c1-9f6c-e89ac6b3c610 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:09.773859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bb7e91a3-dfdc-44c1-9f6c-e89ac6b3c610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:09.899968 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 304/608] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:46:09.950042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12323e1c-0f9d-4b10-98d7-50c0812bbaeb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:09.957572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e91a3-dfdc-44c1-9f6c-e89ac6b3c610 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:10.015496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617d13c-6334-40f9-bfd0-585e36429575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:10.016437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617d13c-6334-40f9-bfd0-585e36429575 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:10.017589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617d13c-6334-40f9-bfd0-585e36429575 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:10.017589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617d13c-6334-40f9-bfd0-585e36429575 None admin] PATH_INFO: `/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/8aa998f15cd543338cd0fc8b5a501066/roles/b18c84f91b764bea92cc22c80a49bcaa` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:10.043612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617d13c-6334-40f9-bfd0-585e36429575 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c03e5fec995436aa5424d2be2e268aa, user_id=8aa998f15cd543338cd0fc8b5a501066, role_id=b18c84f91b764bea92cc22c80a49bcaa)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:10.046548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617d13c-6334-40f9-bfd0-585e36429575 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:10.094060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e91a3-dfdc-44c1-9f6c-e89ac6b3c610 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:10.130294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 305/609] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:46:09 2022] PUT /identity/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/8aa998f15cd543338cd0fc8b5a501066/roles/b18c84f91b764bea92cc22c80a49bcaa => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 20:46:10.136665 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b48ba4-327a-47b1-adea-9d1dbfd18324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:10.137582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b48ba4-327a-47b1-adea-9d1dbfd18324 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:10.137875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b48ba4-327a-47b1-adea-9d1dbfd18324 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:10.138148 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b48ba4-327a-47b1-adea-9d1dbfd18324 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:10.162634 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b48ba4-327a-47b1-adea-9d1dbfd18324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-08b48ba4-327a-47b1-adea-9d1dbfd18324 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:10.170628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:10.171692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:10.172582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:10.172582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:10.172582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:10.172582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:10.172582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:10.172582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:10.172582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:10.172582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:10.172582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:10.172582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:10.172582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:10.172582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:10.172582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 305/610] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:10.178167 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617d13c-6334-40f9-bfd0-585e36429575 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:10.235451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19b394-8bf5-4905-a5b3-4881e126416f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:10.235792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19b394-8bf5-4905-a5b3-4881e126416f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:10.236000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19b394-8bf5-4905-a5b3-4881e126416f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:10.237432 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 306/611] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:46:10.243536 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458a5d1-8fe9-48fe-8a2c-56fd16e287cb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:10.243824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458a5d1-8fe9-48fe-8a2c-56fd16e287cb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:10.244092 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458a5d1-8fe9-48fe-8a2c-56fd16e287cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:10.268203 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5458a5d1-8fe9-48fe-8a2c-56fd16e287cb None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:10.270380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5458a5d1-8fe9-48fe-8a2c-56fd16e287cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:10.334683 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617d13c-6334-40f9-bfd0-585e36429575 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:10.391253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 307/612] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:10.393929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96deed-0b37-42fa-8f7f-ef37ec112b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:10.393929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96deed-0b37-42fa-8f7f-ef37ec112b60 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:10.394434 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96deed-0b37-42fa-8f7f-ef37ec112b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:10.394703 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96deed-0b37-42fa-8f7f-ef37ec112b60 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:10.395449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96deed-0b37-42fa-8f7f-ef37ec112b60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:10.395752 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96deed-0b37-42fa-8f7f-ef37ec112b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:10.397119 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96deed-0b37-42fa-8f7f-ef37ec112b60 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:10.407585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 306/613] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:46:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:10.412862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458a5d1-8fe9-48fe-8a2c-56fd16e287cb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:10.417020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96deed-0b37-42fa-8f7f-ef37ec112b60 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:10.529832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458a5d1-8fe9-48fe-8a2c-56fd16e287cb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:10.565879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519de85-bd15-4a0b-8da9-211898b0db6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:10.567261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519de85-bd15-4a0b-8da9-211898b0db6f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:10.567940 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519de85-bd15-4a0b-8da9-211898b0db6f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:10.568359 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519de85-bd15-4a0b-8da9-211898b0db6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:10.579752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519de85-bd15-4a0b-8da9-211898b0db6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:10.581754 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519de85-bd15-4a0b-8da9-211898b0db6f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:10.584126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96deed-0b37-42fa-8f7f-ef37ec112b60 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a519de85-bd15-4a0b-8da9-211898b0db6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:10.601955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:10.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:10.604525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:10.604525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:10.604525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:10.604525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:10.607539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 308/614] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:10.613427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519de85-bd15-4a0b-8da9-211898b0db6f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:10.671423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60330245-0de1-4581-8a0a-97012f3cc7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:10.672164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330245-0de1-4581-8a0a-97012f3cc7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:10.672505 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330245-0de1-4581-8a0a-97012f3cc7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:10.672793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330245-0de1-4581-8a0a-97012f3cc7b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:10.698451 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60330245-0de1-4581-8a0a-97012f3cc7b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-60330245-0de1-4581-8a0a-97012f3cc7b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:10.715585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:10.717413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:10.718483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:10.718483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:10.718483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:10.718483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:10.718483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:10.718483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:10.718483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:10.718483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:10.718483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:10.718483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:10.718483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:10.718483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:10.720453 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 307/615] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:10.722582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519de85-bd15-4a0b-8da9-211898b0db6f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:10.725921 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60330245-0de1-4581-8a0a-97012f3cc7b2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:10.760447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598203b-f36a-46fd-9103-d7beef5e6523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:10.761385 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598203b-f36a-46fd-9103-d7beef5e6523 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:10.762215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598203b-f36a-46fd-9103-d7beef5e6523 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:10.762634 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598203b-f36a-46fd-9103-d7beef5e6523 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:10.764159 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598203b-f36a-46fd-9103-d7beef5e6523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:10.764747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598203b-f36a-46fd-9103-d7beef5e6523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:10.766438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598203b-f36a-46fd-9103-d7beef5e6523 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:10.780478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 309/616] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:10.786678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598203b-f36a-46fd-9103-d7beef5e6523 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:10.896681 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598203b-f36a-46fd-9103-d7beef5e6523 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:10.933411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab7c6d-dac2-4d09-ad10-2690caef083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:10.934625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab7c6d-dac2-4d09-ad10-2690caef083a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:10.935208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab7c6d-dac2-4d09-ad10-2690caef083a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:10.935627 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab7c6d-dac2-4d09-ad10-2690caef083a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:10.944177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab7c6d-dac2-4d09-ad10-2690caef083a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:10.945985 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab7c6d-dac2-4d09-ad10-2690caef083a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b6ab7c6d-dac2-4d09-ad10-2690caef083a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:10.962001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:10.963169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:10.964361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:10.964361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:10.964361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:10.964361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:10.964361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:10.964361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:10.964361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:10.964361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:10.964361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 20:46:10.964361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:10.967398 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 310/617] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:46:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:10.973418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab7c6d-dac2-4d09-ad10-2690caef083a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:10.992291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60330245-0de1-4581-8a0a-97012f3cc7b2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:11.058307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c3305-8970-4566-bf64-6e66439047e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:11.059266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c3305-8970-4566-bf64-6e66439047e1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:11.059266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c3305-8970-4566-bf64-6e66439047e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:11.059531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c3305-8970-4566-bf64-6e66439047e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:11.060859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c3305-8970-4566-bf64-6e66439047e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:11.061150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c3305-8970-4566-bf64-6e66439047e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:11.062645 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c3305-8970-4566-bf64-6e66439047e1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:11.075513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 308/618] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:46:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:11.078964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab7c6d-dac2-4d09-ad10-2690caef083a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:11.082065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c3305-8970-4566-bf64-6e66439047e1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:11.112849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3af40-8faf-46ff-9864-e8fb50fdca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:11.113836 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3af40-8faf-46ff-9864-e8fb50fdca2d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:11.114261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3af40-8faf-46ff-9864-e8fb50fdca2d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:11.114677 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3af40-8faf-46ff-9864-e8fb50fdca2d None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:11.115650 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3af40-8faf-46ff-9864-e8fb50fdca2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:11.116178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3af40-8faf-46ff-9864-e8fb50fdca2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:11.117922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3af40-8faf-46ff-9864-e8fb50fdca2d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:11.137072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 311/619] 10.222.0.35 () {56 vars in 1135 bytes} [Wed May 11 20:46:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:11.143334 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3af40-8faf-46ff-9864-e8fb50fdca2d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:11.241775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3af40-8faf-46ff-9864-e8fb50fdca2d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:11.276648 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a353d1-c4aa-4b36-9b2b-15c451826ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:11.277786 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a353d1-c4aa-4b36-9b2b-15c451826ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:11.278209 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a353d1-c4aa-4b36-9b2b-15c451826ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:11.278663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a353d1-c4aa-4b36-9b2b-15c451826ce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:11.279699 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c3305-8970-4566-bf64-6e66439047e1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:11.289093 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a353d1-c4aa-4b36-9b2b-15c451826ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:11.290775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a353d1-c4aa-4b36-9b2b-15c451826ce1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-19a353d1-c4aa-4b36-9b2b-15c451826ce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:11.308471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:11.309612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:11.311111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:11.311111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:11.311111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:11.311111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:11.312932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 312/620] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:11.318441 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a353d1-c4aa-4b36-9b2b-15c451826ce1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:11.353059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addff0e-2621-4e59-84b1-76d3e5b2d427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:11.354515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addff0e-2621-4e59-84b1-76d3e5b2d427 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:11.354515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addff0e-2621-4e59-84b1-76d3e5b2d427 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:11.354723 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addff0e-2621-4e59-84b1-76d3e5b2d427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:11.378722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addff0e-2621-4e59-84b1-76d3e5b2d427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:11.380116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addff0e-2621-4e59-84b1-76d3e5b2d427 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-6addff0e-2621-4e59-84b1-76d3e5b2d427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:11.409239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:11.410203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:11.411093 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:11.411093 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:11.411093 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:11.411093 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:11.416851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 309/621] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:11.423235 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addff0e-2621-4e59-84b1-76d3e5b2d427 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:11.456201 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a353d1-c4aa-4b36-9b2b-15c451826ce1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:11.522452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee68bb-e569-4899-96f1-a0cf62ef56ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:11.523691 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee68bb-e569-4899-96f1-a0cf62ef56ed None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:11.525038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee68bb-e569-4899-96f1-a0cf62ef56ed None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:11.525551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee68bb-e569-4899-96f1-a0cf62ef56ed None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:11.526744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee68bb-e569-4899-96f1-a0cf62ef56ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:11.527918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee68bb-e569-4899-96f1-a0cf62ef56ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:11.530701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee68bb-e569-4899-96f1-a0cf62ef56ed None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:11.552764 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 313/622] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:11.559179 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee68bb-e569-4899-96f1-a0cf62ef56ed None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:11.635487 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addff0e-2621-4e59-84b1-76d3e5b2d427 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:11.673234 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee68bb-e569-4899-96f1-a0cf62ef56ed None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:11.708095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edc396-e82c-493e-8939-ca5a5c5d408a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:11.709246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc396-e82c-493e-8939-ca5a5c5d408a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:11.709770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc396-e82c-493e-8939-ca5a5c5d408a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:11.710267 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc396-e82c-493e-8939-ca5a5c5d408a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:11.717473 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edc396-e82c-493e-8939-ca5a5c5d408a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:11.719449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edc396-e82c-493e-8939-ca5a5c5d408a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:11.719659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a402b-7a49-4ba4-96a3-3ddb21c22b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:11.720312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a402b-7a49-4ba4-96a3-3ddb21c22b63 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:11.720639 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a402b-7a49-4ba4-96a3-3ddb21c22b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:11.720929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a402b-7a49-4ba4-96a3-3ddb21c22b63 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:11.721694 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a402b-7a49-4ba4-96a3-3ddb21c22b63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:11.722009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a402b-7a49-4ba4-96a3-3ddb21c22b63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:11.723376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a402b-7a49-4ba4-96a3-3ddb21c22b63 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e2edc396-e82c-493e-8939-ca5a5c5d408a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:11.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:11.737396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:11.738335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:11.738335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:11.738335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:11.738335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:11.738335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:11.738335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:11.738335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:11.738335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:11.741511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 314/623] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:11.747176 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edc396-e82c-493e-8939-ca5a5c5d408a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:11.753857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 310/624] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:11.759502 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a402b-7a49-4ba4-96a3-3ddb21c22b63 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:11.850876 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edc396-e82c-493e-8939-ca5a5c5d408a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:11.885412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afc451-0f85-432b-98ac-5daf0b72bad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:11.886523 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afc451-0f85-432b-98ac-5daf0b72bad6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:11.887014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afc451-0f85-432b-98ac-5daf0b72bad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:11.887495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afc451-0f85-432b-98ac-5daf0b72bad6 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:11.888518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afc451-0f85-432b-98ac-5daf0b72bad6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:11.889033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afc451-0f85-432b-98ac-5daf0b72bad6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:11.890733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afc451-0f85-432b-98ac-5daf0b72bad6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:11.903173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 315/625] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:11.909499 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afc451-0f85-432b-98ac-5daf0b72bad6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:12.012941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afc451-0f85-432b-98ac-5daf0b72bad6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:12.019779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a402b-7a49-4ba4-96a3-3ddb21c22b63 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:12.059958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a55868-56da-440c-ad63-ec3d755e84c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:12.061377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a55868-56da-440c-ad63-ec3d755e84c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:12.062869 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a55868-56da-440c-ad63-ec3d755e84c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:12.064068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a55868-56da-440c-ad63-ec3d755e84c3 None admin] PATH_INFO: `/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/85cb784bf9984abc9977c665a6db1656/roles/b18c84f91b764bea92cc22c80a49bcaa` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:12.081406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ad1a9-6184-4ee7-a570-f96e764a641d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:12.082553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ad1a9-6184-4ee7-a570-f96e764a641d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:12.083068 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ad1a9-6184-4ee7-a570-f96e764a641d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:12.083551 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ad1a9-6184-4ee7-a570-f96e764a641d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:12.097410 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a55868-56da-440c-ad63-ec3d755e84c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c03e5fec995436aa5424d2be2e268aa, user_id=85cb784bf9984abc9977c665a6db1656, role_id=b18c84f91b764bea92cc22c80a49bcaa)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:12.099193 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a55868-56da-440c-ad63-ec3d755e84c3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:12.103890 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ad1a9-6184-4ee7-a570-f96e764a641d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:12.105638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ad1a9-6184-4ee7-a570-f96e764a641d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-530ad1a9-6184-4ee7-a570-f96e764a641d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:12.124688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:12.125744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:12.126718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:12.126718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:12.126718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:12.126718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:12.126718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:12.126718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:12.126718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:12.126718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:12.126718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 20:46:12.126718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:12.129893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 311/626] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 11 20:46:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:12.137672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ad1a9-6184-4ee7-a570-f96e764a641d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:12.184889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 316/627] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:46:11 2022] PUT /identity/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/85cb784bf9984abc9977c665a6db1656/roles/b18c84f91b764bea92cc22c80a49bcaa => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:46:12.236376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086042f2-151c-45b1-8a0f-3866df8d17bd None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:12.236824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086042f2-151c-45b1-8a0f-3866df8d17bd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:12.237211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086042f2-151c-45b1-8a0f-3866df8d17bd None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:12.239072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 317/628] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:12.244328 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace22c9c-76af-4dd6-92c0-1e8091d07572 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:12.244743 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace22c9c-76af-4dd6-92c0-1e8091d07572 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:12.245126 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace22c9c-76af-4dd6-92c0-1e8091d07572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:12.256656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ad1a9-6184-4ee7-a570-f96e764a641d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:12.276769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ace22c9c-76af-4dd6-92c0-1e8091d07572 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:12.278203 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ace22c9c-76af-4dd6-92c0-1e8091d07572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:12.297567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a54065-02ac-4d79-92f2-d78964b2d5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:12.298578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a54065-02ac-4d79-92f2-d78964b2d5bd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:12.299037 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a54065-02ac-4d79-92f2-d78964b2d5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:12.299450 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a54065-02ac-4d79-92f2-d78964b2d5bd None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:12.300469 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a54065-02ac-4d79-92f2-d78964b2d5bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:12.300930 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a54065-02ac-4d79-92f2-d78964b2d5bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:12.302653 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a54065-02ac-4d79-92f2-d78964b2d5bd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:12.330132 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 312/629] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 11 20:46:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:12.332241 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a54065-02ac-4d79-92f2-d78964b2d5bd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:12.385603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 318/630] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:12.387022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcba4c8-a6a3-4872-82eb-7adc47f03dc6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:12.387320 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcba4c8-a6a3-4872-82eb-7adc47f03dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:12.387605 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcba4c8-a6a3-4872-82eb-7adc47f03dc6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:12.389281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 319/631] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:12.395256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924f291-768f-4a8a-8237-dd43e623d343 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:12.395546 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924f291-768f-4a8a-8237-dd43e623d343 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:12.395826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924f291-768f-4a8a-8237-dd43e623d343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:12.413551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0924f291-768f-4a8a-8237-dd43e623d343 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:12.414850 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0924f291-768f-4a8a-8237-dd43e623d343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:12.454454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a54065-02ac-4d79-92f2-d78964b2d5bd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:12.486219 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 320/632] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:46:12.487166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924f291-768f-4a8a-8237-dd43e623d343 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:12.494965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c336ad-a3f2-497d-a9b9-ff4943e8623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:12.499503 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c336ad-a3f2-497d-a9b9-ff4943e8623a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:12.499946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c336ad-a3f2-497d-a9b9-ff4943e8623a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:12.500375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c336ad-a3f2-497d-a9b9-ff4943e8623a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:12.569633 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c336ad-a3f2-497d-a9b9-ff4943e8623a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:12.571349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c336ad-a3f2-497d-a9b9-ff4943e8623a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:12.619438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924f291-768f-4a8a-8237-dd43e623d343 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:12.654341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5c32e-0c3f-46a6-b2b2-030344de134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:12.655410 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5c32e-0c3f-46a6-b2b2-030344de134f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:12.655841 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5c32e-0c3f-46a6-b2b2-030344de134f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:12.656281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5c32e-0c3f-46a6-b2b2-030344de134f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:12.666948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5c32e-0c3f-46a6-b2b2-030344de134f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2df5c32e-0c3f-46a6-b2b2-030344de134f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:12.675628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:12.677230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:12.678157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:12.678157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:12.678157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:12.678157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:12.678157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:12.678157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:12.678157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:12.678157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:12.678157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:12.678157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:12.678157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:12.678157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:12.680464 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 321/633] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:12.681583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5c32e-0c3f-46a6-b2b2-030344de134f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:12.693589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 313/634] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 20:46:12.693589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c336ad-a3f2-497d-a9b9-ff4943e8623a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:12.790717 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5c32e-0c3f-46a6-b2b2-030344de134f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:12.818595 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c336ad-a3f2-497d-a9b9-ff4943e8623a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:12.832996 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1081a-416a-46a1-9482-dad356f2b19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:12.834200 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1081a-416a-46a1-9482-dad356f2b19d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:12.834647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1081a-416a-46a1-9482-dad356f2b19d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:12.835071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1081a-416a-46a1-9482-dad356f2b19d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:12.854237 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1081a-416a-46a1-9482-dad356f2b19d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:12.858479 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8b3ad-0ee9-4623-ad7a-fb592ec63ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:12.859158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8b3ad-0ee9-4623-ad7a-fb592ec63ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:12.859450 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8b3ad-0ee9-4623-ad7a-fb592ec63ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:12.859727 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8b3ad-0ee9-4623-ad7a-fb592ec63ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:12.860475 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8b3ad-0ee9-4623-ad7a-fb592ec63ae9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:12.860782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8b3ad-0ee9-4623-ad7a-fb592ec63ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:12.862225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8b3ad-0ee9-4623-ad7a-fb592ec63ae9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-37d1081a-416a-46a1-9482-dad356f2b19d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:12.864669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:12.865657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:12.866533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:12.866533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:12.866533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:12.866533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:12.866533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:12.866533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:12.866533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:12.866533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:12.866533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:12.866533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:12.866533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:12.866533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:12.873572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 314/635] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:46:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:12.873572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8b3ad-0ee9-4623-ad7a-fb592ec63ae9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:12.874252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 322/636] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:12.876117 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1081a-416a-46a1-9482-dad356f2b19d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:12.980452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1081a-416a-46a1-9482-dad356f2b19d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:12.989641 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8b3ad-0ee9-4623-ad7a-fb592ec63ae9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:13.016341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acab33-d2c6-4504-8376-7c6e275f4a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:13.017015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acab33-d2c6-4504-8376-7c6e275f4a94 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.017303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acab33-d2c6-4504-8376-7c6e275f4a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.017619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acab33-d2c6-4504-8376-7c6e275f4a94 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.018372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acab33-d2c6-4504-8376-7c6e275f4a94 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:13.018772 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acab33-d2c6-4504-8376-7c6e275f4a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:13.020371 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acab33-d2c6-4504-8376-7c6e275f4a94 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:13.024654 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4597e0-d29d-4d85-b2dc-6eafdd9943f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:13.025711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4597e0-d29d-4d85-b2dc-6eafdd9943f5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.026164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4597e0-d29d-4d85-b2dc-6eafdd9943f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.026590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4597e0-d29d-4d85-b2dc-6eafdd9943f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.029575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 323/637] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:46:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:13.029575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acab33-d2c6-4504-8376-7c6e275f4a94 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:13.042371 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4597e0-d29d-4d85-b2dc-6eafdd9943f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:13.043837 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4597e0-d29d-4d85-b2dc-6eafdd9943f5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-4f4597e0-d29d-4d85-b2dc-6eafdd9943f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:13.061789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:13.062730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:13.068364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:13.068364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:13.068364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:13.068364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:13.068364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 315/638] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:13.068364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2da06-a33c-4146-90d1-6f78ac11c6ea None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.068364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2da06-a33c-4146-90d1-6f78ac11c6ea None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.068364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2da06-a33c-4146-90d1-6f78ac11c6ea None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.068364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 316/639] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:13.068881 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2da06-a33c-4146-90d1-6f78ac11c6ea None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:13.134259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acab33-d2c6-4504-8376-7c6e275f4a94 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:13.167074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031c0a6-2588-43e8-a897-ba07a705d8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:13.167865 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031c0a6-2588-43e8-a897-ba07a705d8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.168149 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031c0a6-2588-43e8-a897-ba07a705d8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.168253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2da06-a33c-4146-90d1-6f78ac11c6ea None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:13.168428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031c0a6-2588-43e8-a897-ba07a705d8e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.179089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031c0a6-2588-43e8-a897-ba07a705d8e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:13.180526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031c0a6-2588-43e8-a897-ba07a705d8e7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3031c0a6-2588-43e8-a897-ba07a705d8e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:13.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:13.199170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:13.200916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:13.200916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:13.200916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:13.200916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:13.200916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 324/640] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:13.200916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031c0a6-2588-43e8-a897-ba07a705d8e7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:13.206773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558581b7-0e20-42fa-b886-33613c04e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:13.207574 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558581b7-0e20-42fa-b886-33613c04e3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.207861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558581b7-0e20-42fa-b886-33613c04e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.208140 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558581b7-0e20-42fa-b886-33613c04e3b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.218523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558581b7-0e20-42fa-b886-33613c04e3b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:13.219963 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558581b7-0e20-42fa-b886-33613c04e3b8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-558581b7-0e20-42fa-b886-33613c04e3b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:13.237219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:13.238470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:13.239399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:13.239399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:13.239399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:13.239399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:13.239399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 317/641] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:13.240537 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea8b9e-0874-4d09-85bf-25a8e8f1ec93 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.240537 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea8b9e-0874-4d09-85bf-25a8e8f1ec93 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.240537 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea8b9e-0874-4d09-85bf-25a8e8f1ec93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.258160 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d4ea8b9e-0874-4d09-85bf-25a8e8f1ec93 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:13.259337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d4ea8b9e-0874-4d09-85bf-25a8e8f1ec93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:13.300762 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031c0a6-2588-43e8-a897-ba07a705d8e7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:13.324349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 318/642] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:13.333760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea8b9e-0874-4d09-85bf-25a8e8f1ec93 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:13.349816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0883d-58e0-4333-a05d-4603ff97742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:13.350641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0883d-58e0-4333-a05d-4603ff97742e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.351209 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0883d-58e0-4333-a05d-4603ff97742e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.351514 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0883d-58e0-4333-a05d-4603ff97742e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.352505 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0883d-58e0-4333-a05d-4603ff97742e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:13.352865 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0883d-58e0-4333-a05d-4603ff97742e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:13.354430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0883d-58e0-4333-a05d-4603ff97742e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:13.366243 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 325/643] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:13.367045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0883d-58e0-4333-a05d-4603ff97742e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:13.433007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea8b9e-0874-4d09-85bf-25a8e8f1ec93 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:13.466837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0883d-58e0-4333-a05d-4603ff97742e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:13.467819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b3078-346c-4373-b94f-264066e71426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:13.468489 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b3078-346c-4373-b94f-264066e71426 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.468770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b3078-346c-4373-b94f-264066e71426 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.469039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b3078-346c-4373-b94f-264066e71426 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.469796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b3078-346c-4373-b94f-264066e71426 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:13.470097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b3078-346c-4373-b94f-264066e71426 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:13.471459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b3078-346c-4373-b94f-264066e71426 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:13.486910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 319/644] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:13.486910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b3078-346c-4373-b94f-264066e71426 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:13.505341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5d8fc-ac6c-4572-82b3-7843722b489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:13.505978 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5d8fc-ac6c-4572-82b3-7843722b489b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.506245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5d8fc-ac6c-4572-82b3-7843722b489b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.506519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5d8fc-ac6c-4572-82b3-7843722b489b None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.507231 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5d8fc-ac6c-4572-82b3-7843722b489b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:13.507540 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5d8fc-ac6c-4572-82b3-7843722b489b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:13.508900 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5d8fc-ac6c-4572-82b3-7843722b489b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:13.523647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 326/645] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:13.524528 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5d8fc-ac6c-4572-82b3-7843722b489b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:13.584520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b3078-346c-4373-b94f-264066e71426 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:13.616611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2dada-a65e-4090-a64b-0f623e31f2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:13.617401 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2dada-a65e-4090-a64b-0f623e31f2dc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.617718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2dada-a65e-4090-a64b-0f623e31f2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.618006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2dada-a65e-4090-a64b-0f623e31f2dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.620024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5d8fc-ac6c-4572-82b3-7843722b489b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:13.628581 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2dada-a65e-4090-a64b-0f623e31f2dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5fa2dada-a65e-4090-a64b-0f623e31f2dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:13.636248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:13.637203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:13.639039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:13.639039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:13.639039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:13.639039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:13.639039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:13.639039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:13.639039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:13.639039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:13.639039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:13.639039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:13.639039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:13.639039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:13.639039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 320/646] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:13.639039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2dada-a65e-4090-a64b-0f623e31f2dc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:13.663217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6427e43-9604-4133-8b9b-5cda51ffcd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:13.664303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6427e43-9604-4133-8b9b-5cda51ffcd4c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.664766 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6427e43-9604-4133-8b9b-5cda51ffcd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.665221 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6427e43-9604-4133-8b9b-5cda51ffcd4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.672322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6427e43-9604-4133-8b9b-5cda51ffcd4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:13.673987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6427e43-9604-4133-8b9b-5cda51ffcd4c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b6427e43-9604-4133-8b9b-5cda51ffcd4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:13.688658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:13.690220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:13.691361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:13.691361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:13.691361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:13.691361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:13.691361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:13.691361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:13.691361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:13.691361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:13.691924 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 327/647] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:13.692573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6427e43-9604-4133-8b9b-5cda51ffcd4c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:13.746974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2dada-a65e-4090-a64b-0f623e31f2dc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:13.780534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13685-2ff4-4b31-87fb-077c767385f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:13.780742 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13685-2ff4-4b31-87fb-077c767385f3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.780981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13685-2ff4-4b31-87fb-077c767385f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.781246 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13685-2ff4-4b31-87fb-077c767385f3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.788514 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6427e43-9604-4133-8b9b-5cda51ffcd4c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:13.788668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea13685-2ff4-4b31-87fb-077c767385f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:13.790087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea13685-2ff4-4b31-87fb-077c767385f3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5ea13685-2ff4-4b31-87fb-077c767385f3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:13.804712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:13.805731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:13.806737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:13.806737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:13.806737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:13.806737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:13.806737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:13.806737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:13.806737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:13.806737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:13.806737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 11 20:46:13.806737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:13.806737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 321/648] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:46:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:13.806737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13685-2ff4-4b31-87fb-077c767385f3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:13.830039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7657a53-9928-4463-bb45-7a05c8269384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:13.830838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7657a53-9928-4463-bb45-7a05c8269384 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.831109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7657a53-9928-4463-bb45-7a05c8269384 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.831388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7657a53-9928-4463-bb45-7a05c8269384 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.838420 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7657a53-9928-4463-bb45-7a05c8269384 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:13.842256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7657a53-9928-4463-bb45-7a05c8269384 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d7657a53-9928-4463-bb45-7a05c8269384 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:13.854107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:13.855090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:13.856080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:13.856080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:13.856080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:13.856080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:13.856080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:13.856080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:13.856080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:13.856080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:13.856080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 20:46:13.856080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:13.856080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 328/649] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:46:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:13.857216 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7657a53-9928-4463-bb45-7a05c8269384 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:13.918518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13685-2ff4-4b31-87fb-077c767385f3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:13.952180 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83423f48-62e3-40d0-8d96-f130846166e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:13.952855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83423f48-62e3-40d0-8d96-f130846166e5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.953139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83423f48-62e3-40d0-8d96-f130846166e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.953412 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83423f48-62e3-40d0-8d96-f130846166e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.954189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83423f48-62e3-40d0-8d96-f130846166e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:13.954495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83423f48-62e3-40d0-8d96-f130846166e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:13.955857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83423f48-62e3-40d0-8d96-f130846166e5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:13.956156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7657a53-9928-4463-bb45-7a05c8269384 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:13.967928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 322/650] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:46:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:13.967928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83423f48-62e3-40d0-8d96-f130846166e5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:13.989214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daf2d9-1032-4ae7-be7b-b404e7a68258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:13.989900 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daf2d9-1032-4ae7-be7b-b404e7a68258 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:13.990183 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daf2d9-1032-4ae7-be7b-b404e7a68258 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:13.990456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daf2d9-1032-4ae7-be7b-b404e7a68258 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:13.991232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02daf2d9-1032-4ae7-be7b-b404e7a68258 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:13.991636 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02daf2d9-1032-4ae7-be7b-b404e7a68258 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:13.992947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02daf2d9-1032-4ae7-be7b-b404e7a68258 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:14.004841 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 329/651] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:14.005667 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daf2d9-1032-4ae7-be7b-b404e7a68258 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:14.067645 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83423f48-62e3-40d0-8d96-f130846166e5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:14.100273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80f82d-7ab2-4736-a539-2cdfc1c6e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:14.100944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80f82d-7ab2-4736-a539-2cdfc1c6e9db None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:14.101225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80f82d-7ab2-4736-a539-2cdfc1c6e9db None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:14.101492 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80f82d-7ab2-4736-a539-2cdfc1c6e9db None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:14.103956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80f82d-7ab2-4736-a539-2cdfc1c6e9db None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:14.104271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80f82d-7ab2-4736-a539-2cdfc1c6e9db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:14.105742 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80f82d-7ab2-4736-a539-2cdfc1c6e9db None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:14.105865 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daf2d9-1032-4ae7-be7b-b404e7a68258 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:14.123885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 323/652] 10.222.0.35 () {56 vars in 1137 bytes} [Wed May 11 20:46:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:14.129024 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80f82d-7ab2-4736-a539-2cdfc1c6e9db None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:14.139093 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32f576-445b-44fe-96f2-53dcea2d6b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:14.139843 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32f576-445b-44fe-96f2-53dcea2d6b44 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:14.140201 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32f576-445b-44fe-96f2-53dcea2d6b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:14.140548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32f576-445b-44fe-96f2-53dcea2d6b44 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:14.141598 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32f576-445b-44fe-96f2-53dcea2d6b44 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:14.141980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32f576-445b-44fe-96f2-53dcea2d6b44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:14.143488 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32f576-445b-44fe-96f2-53dcea2d6b44 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:14.162048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 330/653] 10.222.0.35 () {56 vars in 1137 bytes} [Wed May 11 20:46:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:14.163125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32f576-445b-44fe-96f2-53dcea2d6b44 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:14.224399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80f82d-7ab2-4736-a539-2cdfc1c6e9db None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:14.257299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83390-2bab-4570-a35a-c14320c637f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:14.258117 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83390-2bab-4570-a35a-c14320c637f3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:14.258398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83390-2bab-4570-a35a-c14320c637f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:14.258669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f83390-2bab-4570-a35a-c14320c637f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:14.260125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32f576-445b-44fe-96f2-53dcea2d6b44 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:14.268435 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f83390-2bab-4570-a35a-c14320c637f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:14.270199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f83390-2bab-4570-a35a-c14320c637f3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f9f83390-2bab-4570-a35a-c14320c637f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:14.288376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:14.289350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:14.295861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:14.295861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:14.295861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:14.295861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:14.295861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 324/654] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:14.295861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83390-2bab-4570-a35a-c14320c637f3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:14.299074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45a696-d5a5-43de-b381-864ee723368f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:14.299743 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45a696-d5a5-43de-b381-864ee723368f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:14.300013 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45a696-d5a5-43de-b381-864ee723368f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:14.300286 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45a696-d5a5-43de-b381-864ee723368f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:14.301107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45a696-d5a5-43de-b381-864ee723368f None admin] RBAC: Adding query filter params (role.id=b18c84f91b764bea92cc22c80a49bcaa, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=f400b94d3fbc40bdace4860fe83a0891) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:14.301417 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45a696-d5a5-43de-b381-864ee723368f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:14.302889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45a696-d5a5-43de-b381-864ee723368f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:14.309071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 331/655] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:14 2022] GET /identity/v3/role_assignments?user.id=f400b94d3fbc40bdace4860fe83a0891&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=b18c84f91b764bea92cc22c80a49bcaa => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:14.310382 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45a696-d5a5-43de-b381-864ee723368f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:14.398898 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f83390-2bab-4570-a35a-c14320c637f3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:14.425123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45a696-d5a5-43de-b381-864ee723368f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:14.437774 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c8024-3141-40c1-90e0-e3b0a0db5f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:14.438830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c8024-3141-40c1-90e0-e3b0a0db5f0a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:14.439333 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c8024-3141-40c1-90e0-e3b0a0db5f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:14.439836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c8024-3141-40c1-90e0-e3b0a0db5f0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:14.465617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc64de-baa5-4b72-95c7-81526182f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:14.467322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc64de-baa5-4b72-95c7-81526182f57c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:14.467867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc64de-baa5-4b72-95c7-81526182f57c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:14.468352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc64de-baa5-4b72-95c7-81526182f57c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:14.515695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c8024-3141-40c1-90e0-e3b0a0db5f0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:14.517179 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c8024-3141-40c1-90e0-e3b0a0db5f0a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:14.547191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc64de-baa5-4b72-95c7-81526182f57c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:14.548866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc64de-baa5-4b72-95c7-81526182f57c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:14.626153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 325/656] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:46:14.630693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c8024-3141-40c1-90e0-e3b0a0db5f0a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:14.661684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 332/657] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:46:14.663424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5605a-6be3-4eb0-8800-ca298f1cfa47 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:14.663715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5605a-6be3-4eb0-8800-ca298f1cfa47 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:14.663994 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5605a-6be3-4eb0-8800-ca298f1cfa47 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:14.665452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 333/658] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:14.666001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5605a-6be3-4eb0-8800-ca298f1cfa47 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:14.726455 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c8024-3141-40c1-90e0-e3b0a0db5f0a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:14.763333 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6150e93-44bb-4771-a507-5c8dc50052ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:14.763992 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150e93-44bb-4771-a507-5c8dc50052ad None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:14.764274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150e93-44bb-4771-a507-5c8dc50052ad None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:14.764548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6150e93-44bb-4771-a507-5c8dc50052ad None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:14.765280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6150e93-44bb-4771-a507-5c8dc50052ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:14.765584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6150e93-44bb-4771-a507-5c8dc50052ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:14.766596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5605a-6be3-4eb0-8800-ca298f1cfa47 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:14.767030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6150e93-44bb-4771-a507-5c8dc50052ad None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:14.782420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 326/659] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:14.782420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6150e93-44bb-4771-a507-5c8dc50052ad None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:14.806763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393e5d0-0d07-4bbc-a6a2-adea51c9c686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:14.807595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393e5d0-0d07-4bbc-a6a2-adea51c9c686 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:14.807879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393e5d0-0d07-4bbc-a6a2-adea51c9c686 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:14.808154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393e5d0-0d07-4bbc-a6a2-adea51c9c686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:14.818963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393e5d0-0d07-4bbc-a6a2-adea51c9c686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:14.820509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393e5d0-0d07-4bbc-a6a2-adea51c9c686 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4393e5d0-0d07-4bbc-a6a2-adea51c9c686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:14.838122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:14.839326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:14.845403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:14.845403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:14.845403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:14.845403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:14.845403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 334/660] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:14.845403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab4ebd-e132-4b52-b959-605e8e233349 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:14.845403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab4ebd-e132-4b52-b959-605e8e233349 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:14.845403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab4ebd-e132-4b52-b959-605e8e233349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:14.860862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-33ab4ebd-e132-4b52-b959-605e8e233349 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:14.862185 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-33ab4ebd-e132-4b52-b959-605e8e233349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:14.895291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6150e93-44bb-4771-a507-5c8dc50052ad None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:14.930659 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 335/661] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:14.931418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab4ebd-e132-4b52-b959-605e8e233349 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:14.943153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d884ad-c9a9-44bb-b300-98d8566e2ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:14.944699 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d884ad-c9a9-44bb-b300-98d8566e2ada None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:14.945241 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d884ad-c9a9-44bb-b300-98d8566e2ada None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:14.945699 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d884ad-c9a9-44bb-b300-98d8566e2ada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:14.958579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d884ad-c9a9-44bb-b300-98d8566e2ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:14.960060 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d884ad-c9a9-44bb-b300-98d8566e2ada None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f5d884ad-c9a9-44bb-b300-98d8566e2ada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:14.978509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:14.979456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:14.980348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:14.980348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:14.980348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:14.980348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:14.980348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 327/662] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:14.981054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d884ad-c9a9-44bb-b300-98d8566e2ada None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:15.032563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab4ebd-e132-4b52-b959-605e8e233349 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:15.065801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949e9db-9a4e-40a3-938f-9dc09fbe8222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:15.066595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949e9db-9a4e-40a3-938f-9dc09fbe8222 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:15.066875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949e9db-9a4e-40a3-938f-9dc09fbe8222 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:15.067146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949e9db-9a4e-40a3-938f-9dc09fbe8222 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:15.074145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949e9db-9a4e-40a3-938f-9dc09fbe8222 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:15.075632 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949e9db-9a4e-40a3-938f-9dc09fbe8222 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:15.082826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d884ad-c9a9-44bb-b300-98d8566e2ada None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e949e9db-9a4e-40a3-938f-9dc09fbe8222 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:15.089837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:15.091527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:15.092819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:15.092819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:15.092819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:15.092819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:15.092819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:15.092819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:15.092819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:15.092819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:15.092819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 11 20:46:15.092819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:15.096107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 336/663] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:15.096743 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949e9db-9a4e-40a3-938f-9dc09fbe8222 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:15.119206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055bb03-5905-4679-b1d2-40a9e08ca550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:15.119871 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055bb03-5905-4679-b1d2-40a9e08ca550 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:15.120158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055bb03-5905-4679-b1d2-40a9e08ca550 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:15.120433 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055bb03-5905-4679-b1d2-40a9e08ca550 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:15.121330 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055bb03-5905-4679-b1d2-40a9e08ca550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:15.121448 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055bb03-5905-4679-b1d2-40a9e08ca550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:15.122881 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055bb03-5905-4679-b1d2-40a9e08ca550 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:15.139255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 328/664] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:15.139255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055bb03-5905-4679-b1d2-40a9e08ca550 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:15.193992 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949e9db-9a4e-40a3-938f-9dc09fbe8222 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:15.227464 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0163-21c8-4b99-a1cb-aea3a7e5c773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:15.228249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0163-21c8-4b99-a1cb-aea3a7e5c773 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:15.228531 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0163-21c8-4b99-a1cb-aea3a7e5c773 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:15.228804 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0163-21c8-4b99-a1cb-aea3a7e5c773 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:15.231953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055bb03-5905-4679-b1d2-40a9e08ca550 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:15.238794 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb0163-21c8-4b99-a1cb-aea3a7e5c773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e2eb0163-21c8-4b99-a1cb-aea3a7e5c773 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:15.246456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:15.247554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:15.253657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:15.253657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:15.253657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:15.253657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:15.253657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:15.253657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:15.253657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:15.253657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:15.253657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:15.253657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:15.253657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:15.253657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:15.253657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 337/665] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:15.253657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0163-21c8-4b99-a1cb-aea3a7e5c773 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:15.265537 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0382fe7-207b-4b0c-a410-321b317a665d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:15.266195 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0382fe7-207b-4b0c-a410-321b317a665d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:15.266481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0382fe7-207b-4b0c-a410-321b317a665d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:15.266764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0382fe7-207b-4b0c-a410-321b317a665d None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:15.267479 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0382fe7-207b-4b0c-a410-321b317a665d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:15.267795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0382fe7-207b-4b0c-a410-321b317a665d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:15.269418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0382fe7-207b-4b0c-a410-321b317a665d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:15.280984 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 329/666] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:15.282489 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0382fe7-207b-4b0c-a410-321b317a665d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:15.348719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0163-21c8-4b99-a1cb-aea3a7e5c773 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:15.380531 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db3c61-e024-4d7c-89b0-674e69f4f978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:15.381216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0382fe7-207b-4b0c-a410-321b317a665d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:15.381783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db3c61-e024-4d7c-89b0-674e69f4f978 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:15.382294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db3c61-e024-4d7c-89b0-674e69f4f978 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:15.382777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db3c61-e024-4d7c-89b0-674e69f4f978 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:15.383823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db3c61-e024-4d7c-89b0-674e69f4f978 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:15.384343 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db3c61-e024-4d7c-89b0-674e69f4f978 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:15.386031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db3c61-e024-4d7c-89b0-674e69f4f978 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:15.404380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 338/667] 10.222.0.35 () {56 vars in 1139 bytes} [Wed May 11 20:46:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:15.405452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db3c61-e024-4d7c-89b0-674e69f4f978 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:15.414857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010fcdf-33e8-413e-8dd5-4d1a770cde4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:15.415655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010fcdf-33e8-413e-8dd5-4d1a770cde4e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:15.415940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010fcdf-33e8-413e-8dd5-4d1a770cde4e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:15.416219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010fcdf-33e8-413e-8dd5-4d1a770cde4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:15.423077 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010fcdf-33e8-413e-8dd5-4d1a770cde4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:15.424536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010fcdf-33e8-413e-8dd5-4d1a770cde4e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5010fcdf-33e8-413e-8dd5-4d1a770cde4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:15.438542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:15.439466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:15.440478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:15.440478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:15.440478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:15.440478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:15.440478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:15.440478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:15.440478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:15.440478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:15.440478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 330/668] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:15.440478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010fcdf-33e8-413e-8dd5-4d1a770cde4e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:15.513807 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db3c61-e024-4d7c-89b0-674e69f4f978 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:15.541454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010fcdf-33e8-413e-8dd5-4d1a770cde4e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:15.549443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423ae34-227c-451f-8e36-9e6b3df03fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:15.550149 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423ae34-227c-451f-8e36-9e6b3df03fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:15.550431 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423ae34-227c-451f-8e36-9e6b3df03fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:15.550712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423ae34-227c-451f-8e36-9e6b3df03fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:15.551446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423ae34-227c-451f-8e36-9e6b3df03fb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:15.551751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423ae34-227c-451f-8e36-9e6b3df03fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:15.553106 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423ae34-227c-451f-8e36-9e6b3df03fb8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:15.561437 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 339/669] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:46:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:15.562238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423ae34-227c-451f-8e36-9e6b3df03fb8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:15.580503 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07bc22-48e7-4675-a076-ed570449a93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:15.581299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07bc22-48e7-4675-a076-ed570449a93c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:15.581611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07bc22-48e7-4675-a076-ed570449a93c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:15.581891 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07bc22-48e7-4675-a076-ed570449a93c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:15.588775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07bc22-48e7-4675-a076-ed570449a93c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:15.590271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07bc22-48e7-4675-a076-ed570449a93c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-dd07bc22-48e7-4675-a076-ed570449a93c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:15.604437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:15.605389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:15.606522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:15.606522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:15.606522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:15.606522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:15.606522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:15.606522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:15.606522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:15.606522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:15.606522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 331/670] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:15.607135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07bc22-48e7-4675-a076-ed570449a93c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:15.663315 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423ae34-227c-451f-8e36-9e6b3df03fb8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:15.696650 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd9421-7825-4481-9d6b-e5cce39eb145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:15.697553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9421-7825-4481-9d6b-e5cce39eb145 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:15.697989 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9421-7825-4481-9d6b-e5cce39eb145 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:15.698274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9421-7825-4481-9d6b-e5cce39eb145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:15.706951 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07bc22-48e7-4675-a076-ed570449a93c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:15.739106 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e515be-80aa-48ac-aa89-47a291021723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:15.739769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e515be-80aa-48ac-aa89-47a291021723 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:15.740050 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e515be-80aa-48ac-aa89-47a291021723 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:15.740321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e515be-80aa-48ac-aa89-47a291021723 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:15.741099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e515be-80aa-48ac-aa89-47a291021723 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:15.741410 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e515be-80aa-48ac-aa89-47a291021723 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:15.742876 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e515be-80aa-48ac-aa89-47a291021723 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:15.759734 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 332/671] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:15.759734 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e515be-80aa-48ac-aa89-47a291021723 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:15.773060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd9421-7825-4481-9d6b-e5cce39eb145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:15.774480 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd9421-7825-4481-9d6b-e5cce39eb145 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:15.851396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e515be-80aa-48ac-aa89-47a291021723 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:15.886450 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 340/672] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:46:15.886450 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd9421-7825-4481-9d6b-e5cce39eb145 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:15.889356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7b050-55ce-4021-98ce-b8d3413c9cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:15.890240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7b050-55ce-4021-98ce-b8d3413c9cce None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:15.890519 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7b050-55ce-4021-98ce-b8d3413c9cce None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:15.890787 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7b050-55ce-4021-98ce-b8d3413c9cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:15.900810 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7b050-55ce-4021-98ce-b8d3413c9cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:15.902292 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7b050-55ce-4021-98ce-b8d3413c9cce None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-41b7b050-55ce-4021-98ce-b8d3413c9cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:15.918903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:15.920049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:15.925743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:15.925743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:15.925743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:15.925743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:15.925743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 333/673] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:15.925743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7b050-55ce-4021-98ce-b8d3413c9cce None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:15.986951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd9421-7825-4481-9d6b-e5cce39eb145 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:16.019814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d9592-323a-4efc-a155-f6249991648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:16.020560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d9592-323a-4efc-a155-f6249991648a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:16.020846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d9592-323a-4efc-a155-f6249991648a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:16.021025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7b050-55ce-4021-98ce-b8d3413c9cce None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:16.021126 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d9592-323a-4efc-a155-f6249991648a None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:16.021911 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d9592-323a-4efc-a155-f6249991648a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:16.022221 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d9592-323a-4efc-a155-f6249991648a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:16.023709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d9592-323a-4efc-a155-f6249991648a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:16.035055 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 341/674] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:16.035971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d9592-323a-4efc-a155-f6249991648a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:16.061224 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58fbc9-1178-4857-b651-8d240c428849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:16.062576 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58fbc9-1178-4857-b651-8d240c428849 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:16.063085 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58fbc9-1178-4857-b651-8d240c428849 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:16.063688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58fbc9-1178-4857-b651-8d240c428849 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:16.065309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58fbc9-1178-4857-b651-8d240c428849 None admin] RBAC: Adding query filter params (role.id=b18c84f91b764bea92cc22c80a49bcaa, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=4ce12ee27315460793dfedd294eb3c55) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:16.065843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58fbc9-1178-4857-b651-8d240c428849 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:16.068180 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58fbc9-1178-4857-b651-8d240c428849 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:16.074656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 334/675] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:15 2022] GET /identity/v3/role_assignments?user.id=4ce12ee27315460793dfedd294eb3c55&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=b18c84f91b764bea92cc22c80a49bcaa => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:16.075697 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58fbc9-1178-4857-b651-8d240c428849 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:16.144647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d9592-323a-4efc-a155-f6249991648a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:16.181422 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b65e2-11d0-4208-bf66-ffd71ab7ed32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:16.182397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b65e2-11d0-4208-bf66-ffd71ab7ed32 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:16.182771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b65e2-11d0-4208-bf66-ffd71ab7ed32 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:16.183085 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b65e2-11d0-4208-bf66-ffd71ab7ed32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:16.195621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b65e2-11d0-4208-bf66-ffd71ab7ed32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:16.197206 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b65e2-11d0-4208-bf66-ffd71ab7ed32 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:16.200983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58fbc9-1178-4857-b651-8d240c428849 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-192b65e2-11d0-4208-bf66-ffd71ab7ed32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:16.215724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:16.216793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:16.217796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:16.217796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:16.217796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:16.217796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:16.221977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 342/676] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:16.223024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b65e2-11d0-4208-bf66-ffd71ab7ed32 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:16.243026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b05e5c-4648-47a2-b90b-95f9ed2d0966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:16.244046 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b05e5c-4648-47a2-b90b-95f9ed2d0966 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:16.244518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b05e5c-4648-47a2-b90b-95f9ed2d0966 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:16.244974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b05e5c-4648-47a2-b90b-95f9ed2d0966 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:16.245964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b05e5c-4648-47a2-b90b-95f9ed2d0966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:16.246465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b05e5c-4648-47a2-b90b-95f9ed2d0966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:16.248823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b05e5c-4648-47a2-b90b-95f9ed2d0966 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:16.267289 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 335/677] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:16.268571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b05e5c-4648-47a2-b90b-95f9ed2d0966 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:16.335378 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b65e2-11d0-4208-bf66-ffd71ab7ed32 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:16.381897 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978126c-5ba8-4081-94f4-a780dd246658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:16.382892 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978126c-5ba8-4081-94f4-a780dd246658 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:16.383355 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978126c-5ba8-4081-94f4-a780dd246658 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:16.383832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978126c-5ba8-4081-94f4-a780dd246658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:16.384959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978126c-5ba8-4081-94f4-a780dd246658 None admin] RBAC: Adding query filter params (role.id=b18c84f91b764bea92cc22c80a49bcaa, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=3888fb083b0149bd92054cffa88c51e9) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:16.385576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978126c-5ba8-4081-94f4-a780dd246658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:16.387207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978126c-5ba8-4081-94f4-a780dd246658 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:16.389341 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b05e5c-4648-47a2-b90b-95f9ed2d0966 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:16.395798 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 343/678] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:16 2022] GET /identity/v3/role_assignments?user.id=3888fb083b0149bd92054cffa88c51e9&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=b18c84f91b764bea92cc22c80a49bcaa => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:16.396634 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978126c-5ba8-4081-94f4-a780dd246658 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:16.463403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21cedc-936b-426d-b6fa-c5bc4e75227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:16.464113 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21cedc-936b-426d-b6fa-c5bc4e75227a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:16.464394 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21cedc-936b-426d-b6fa-c5bc4e75227a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:16.464675 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21cedc-936b-426d-b6fa-c5bc4e75227a None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:16.465452 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21cedc-936b-426d-b6fa-c5bc4e75227a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:16.465807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21cedc-936b-426d-b6fa-c5bc4e75227a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:16.467874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21cedc-936b-426d-b6fa-c5bc4e75227a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:16.482249 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 336/679] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:16.488131 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21cedc-936b-426d-b6fa-c5bc4e75227a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:16.595971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978126c-5ba8-4081-94f4-a780dd246658 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:16.643041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c7cce-9095-4c7f-adf5-0030c71d4a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:16.643842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c7cce-9095-4c7f-adf5-0030c71d4a2a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:16.644382 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c7cce-9095-4c7f-adf5-0030c71d4a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:16.644663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c7cce-9095-4c7f-adf5-0030c71d4a2a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:16.652548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c7cce-9095-4c7f-adf5-0030c71d4a2a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:16.654199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21cedc-936b-426d-b6fa-c5bc4e75227a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:16.654638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c7cce-9095-4c7f-adf5-0030c71d4a2a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8c5c7cce-9095-4c7f-adf5-0030c71d4a2a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:16.672862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:16.673947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:16.674902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:16.674902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:16.674902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:16.674902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:16.674902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:16.674902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:16.674902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:16.674902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:16.674902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 20:46:16.674902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:16.677913 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 344/680] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:46:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:16.679217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec428700-5458-4686-976b-be81a001dcd9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:16.679500 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec428700-5458-4686-976b-be81a001dcd9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:16.679777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec428700-5458-4686-976b-be81a001dcd9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:16.681210 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 345/681] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:16.682581 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec428700-5458-4686-976b-be81a001dcd9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:16.699475 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f7c1f-1dd8-4ec8-8af9-cbd7e0294d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:16.700277 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f7c1f-1dd8-4ec8-8af9-cbd7e0294d76 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:16.701660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f7c1f-1dd8-4ec8-8af9-cbd7e0294d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:16.701660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f7c1f-1dd8-4ec8-8af9-cbd7e0294d76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:16.711387 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f7c1f-1dd8-4ec8-8af9-cbd7e0294d76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:16.713599 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f7c1f-1dd8-4ec8-8af9-cbd7e0294d76 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-022f7c1f-1dd8-4ec8-8af9-cbd7e0294d76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:16.729819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:16.730769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:16.731732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:16.731732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:16.731732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:16.731732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:16.731732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:16.731732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:16.731732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:16.731732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:16.731732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 337/682] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:16.733027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289e71-a6ac-42f5-aa21-9815b6393da1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:16.733027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289e71-a6ac-42f5-aa21-9815b6393da1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:16.733027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18289e71-a6ac-42f5-aa21-9815b6393da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:16.751352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-18289e71-a6ac-42f5-aa21-9815b6393da1 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:16.752531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-18289e71-a6ac-42f5-aa21-9815b6393da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:16.810154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec428700-5458-4686-976b-be81a001dcd9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:16.833629 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 338/683] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:16.834521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289e71-a6ac-42f5-aa21-9815b6393da1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:16.866055 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899134d-f49c-4ef0-8885-ceb8e489b7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:16.866725 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899134d-f49c-4ef0-8885-ceb8e489b7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:16.867018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899134d-f49c-4ef0-8885-ceb8e489b7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:16.867284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899134d-f49c-4ef0-8885-ceb8e489b7a1 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:16.868161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899134d-f49c-4ef0-8885-ceb8e489b7a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:16.868474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899134d-f49c-4ef0-8885-ceb8e489b7a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:16.870041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899134d-f49c-4ef0-8885-ceb8e489b7a1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:16.887542 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 346/684] 10.222.0.35 () {56 vars in 1135 bytes} [Wed May 11 20:46:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:16.888896 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899134d-f49c-4ef0-8885-ceb8e489b7a1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:16.954631 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18289e71-a6ac-42f5-aa21-9815b6393da1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:16.988602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1c15d-2094-4346-8f02-bd5f22ac6a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:16.989290 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1c15d-2094-4346-8f02-bd5f22ac6a85 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:16.989595 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1c15d-2094-4346-8f02-bd5f22ac6a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:16.989873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1c15d-2094-4346-8f02-bd5f22ac6a85 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:16.990655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1c15d-2094-4346-8f02-bd5f22ac6a85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:16.990962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1c15d-2094-4346-8f02-bd5f22ac6a85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:16.992388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1c15d-2094-4346-8f02-bd5f22ac6a85 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:17.009600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 339/685] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:17.010517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1c15d-2094-4346-8f02-bd5f22ac6a85 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:17.012664 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899134d-f49c-4ef0-8885-ceb8e489b7a1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:17.047619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ef90f-c2c0-4ee9-8d12-a5c94a8a2d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:17.048408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ef90f-c2c0-4ee9-8d12-a5c94a8a2d89 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:17.048688 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ef90f-c2c0-4ee9-8d12-a5c94a8a2d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:17.048969 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ef90f-c2c0-4ee9-8d12-a5c94a8a2d89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:17.061002 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ef90f-c2c0-4ee9-8d12-a5c94a8a2d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-323ef90f-c2c0-4ee9-8d12-a5c94a8a2d89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:17.068741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:17.069723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:17.070587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:17.070587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:17.070587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:17.070587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:17.070587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:17.070587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:17.070587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:17.070587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:17.070587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:17.070587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:17.070587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:46:17.070587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:17.073620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 347/686] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:46:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:17.074475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ef90f-c2c0-4ee9-8d12-a5c94a8a2d89 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:17.111921 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1c15d-2094-4346-8f02-bd5f22ac6a85 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:17.147213 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6749a0-fa1d-4e2a-968e-fd46ebff32bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:17.147784 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6749a0-fa1d-4e2a-968e-fd46ebff32bd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:17.148064 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6749a0-fa1d-4e2a-968e-fd46ebff32bd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:17.148334 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6749a0-fa1d-4e2a-968e-fd46ebff32bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:17.175631 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ef90f-c2c0-4ee9-8d12-a5c94a8a2d89 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:17.209027 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74dac4-0315-48ef-ad38-d30690c9513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:17.209721 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74dac4-0315-48ef-ad38-d30690c9513f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:17.210005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74dac4-0315-48ef-ad38-d30690c9513f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:17.210280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74dac4-0315-48ef-ad38-d30690c9513f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:17.211096 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74dac4-0315-48ef-ad38-d30690c9513f None admin] RBAC: Adding query filter params (role.id=b18c84f91b764bea92cc22c80a49bcaa, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=8aa998f15cd543338cd0fc8b5a501066) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:17.211407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74dac4-0315-48ef-ad38-d30690c9513f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:17.212833 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74dac4-0315-48ef-ad38-d30690c9513f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:17.217284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6749a0-fa1d-4e2a-968e-fd46ebff32bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:17.218815 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6749a0-fa1d-4e2a-968e-fd46ebff32bd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:17.219020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 348/687] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:17 2022] GET /identity/v3/role_assignments?user.id=8aa998f15cd543338cd0fc8b5a501066&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=b18c84f91b764bea92cc22c80a49bcaa => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:17.219743 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74dac4-0315-48ef-ad38-d30690c9513f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:17.323229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74dac4-0315-48ef-ad38-d30690c9513f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:17.360024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcf8ba-0e56-4d4e-a572-9fa40cdb5242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:17.360709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcf8ba-0e56-4d4e-a572-9fa40cdb5242 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:17.360992 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcf8ba-0e56-4d4e-a572-9fa40cdb5242 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:17.361247 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcf8ba-0e56-4d4e-a572-9fa40cdb5242 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:17.362125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bcf8ba-0e56-4d4e-a572-9fa40cdb5242 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:17.362430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bcf8ba-0e56-4d4e-a572-9fa40cdb5242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:17.363832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bcf8ba-0e56-4d4e-a572-9fa40cdb5242 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:17.377677 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 349/688] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:46:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:17.378929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 340/689] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:46:17.379489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcf8ba-0e56-4d4e-a572-9fa40cdb5242 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:17.384554 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6749a0-fa1d-4e2a-968e-fd46ebff32bd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:17.486242 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcf8ba-0e56-4d4e-a572-9fa40cdb5242 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:17.500288 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6749a0-fa1d-4e2a-968e-fd46ebff32bd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:17.521718 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2c6a9-a0b2-4a58-a5d7-52ff7c0c908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:17.522511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2c6a9-a0b2-4a58-a5d7-52ff7c0c908d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:17.522788 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2c6a9-a0b2-4a58-a5d7-52ff7c0c908d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:17.523061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2c6a9-a0b2-4a58-a5d7-52ff7c0c908d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:17.533575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2c6a9-a0b2-4a58-a5d7-52ff7c0c908d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:17.534852 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7ff7e-68f6-4a25-837c-a4b8d69f6d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:17.534987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2c6a9-a0b2-4a58-a5d7-52ff7c0c908d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:17.535896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ff7e-68f6-4a25-837c-a4b8d69f6d23 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:17.536341 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ff7e-68f6-4a25-837c-a4b8d69f6d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:17.536764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ff7e-68f6-4a25-837c-a4b8d69f6d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:17.547884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7ff7e-68f6-4a25-837c-a4b8d69f6d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:17.550323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7ff7e-68f6-4a25-837c-a4b8d69f6d23 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e2d2c6a9-a0b2-4a58-a5d7-52ff7c0c908d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:17.552451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:17.553568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:17.554694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:17.554694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:17.554694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:17.554694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:17.557638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 350/690] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:17.559325 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2c6a9-a0b2-4a58-a5d7-52ff7c0c908d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0ec7ff7e-68f6-4a25-837c-a4b8d69f6d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:17.572007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:17.573136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:17.574222 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:17.574222 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:17.574222 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:17.574222 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:17.576557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 341/691] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:17.582441 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7ff7e-68f6-4a25-837c-a4b8d69f6d23 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:17.662832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2c6a9-a0b2-4a58-a5d7-52ff7c0c908d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:17.683355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7ff7e-68f6-4a25-837c-a4b8d69f6d23 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:17.698678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363e305-84ea-4402-8549-b1604745f3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:17.699340 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363e305-84ea-4402-8549-b1604745f3ac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:17.699672 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363e305-84ea-4402-8549-b1604745f3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:17.699977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363e305-84ea-4402-8549-b1604745f3ac None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:17.700697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363e305-84ea-4402-8549-b1604745f3ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:17.701001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363e305-84ea-4402-8549-b1604745f3ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:17.702383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363e305-84ea-4402-8549-b1604745f3ac None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:17.718750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 351/692] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:17.719407 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d22fe-f9ba-49b8-9326-bc2901a090c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:17.720052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363e305-84ea-4402-8549-b1604745f3ac None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:17.720619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d22fe-f9ba-49b8-9326-bc2901a090c5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:17.721129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d22fe-f9ba-49b8-9326-bc2901a090c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:17.721668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d22fe-f9ba-49b8-9326-bc2901a090c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:17.722592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d22fe-f9ba-49b8-9326-bc2901a090c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:17.723096 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d22fe-f9ba-49b8-9326-bc2901a090c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:17.724682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d22fe-f9ba-49b8-9326-bc2901a090c5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:17.737267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 342/693] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:17.742807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d22fe-f9ba-49b8-9326-bc2901a090c5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:17.822688 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363e305-84ea-4402-8549-b1604745f3ac None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:17.845732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d22fe-f9ba-49b8-9326-bc2901a090c5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:17.858038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0e1f5-aef1-40bd-a9ab-5bef3cdf2af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:17.858830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0e1f5-aef1-40bd-a9ab-5bef3cdf2af8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:17.859111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0e1f5-aef1-40bd-a9ab-5bef3cdf2af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:17.859439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0e1f5-aef1-40bd-a9ab-5bef3cdf2af8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:17.866654 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0e1f5-aef1-40bd-a9ab-5bef3cdf2af8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:17.868298 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0e1f5-aef1-40bd-a9ab-5bef3cdf2af8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:17.883317 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d3f75-7764-4f64-b37b-181e7872ab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:17.884436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3f75-7764-4f64-b37b-181e7872ab43 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:17.884927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3f75-7764-4f64-b37b-181e7872ab43 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:17.885432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d3f75-7764-4f64-b37b-181e7872ab43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4eb0e1f5-aef1-40bd-a9ab-5bef3cdf2af8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:17.886111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:17.887023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:17.888018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:17.888018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:17.888018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:17.888018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:17.888018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:17.888018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:17.888018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:17.888018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:17.888018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 20:46:17.888018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:17.894020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 352/694] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 11 20:46:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:17.894020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0e1f5-aef1-40bd-a9ab-5bef3cdf2af8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:17.911412 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d3f75-7764-4f64-b37b-181e7872ab43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:17.912877 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d3f75-7764-4f64-b37b-181e7872ab43 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-f71d3f75-7764-4f64-b37b-181e7872ab43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:17.934855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:17.935824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:17.936726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:17.936726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:17.936726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:17.936726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:17.936726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:17.936726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:17.936726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:17.936726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:17.944316 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 343/695] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:17.951354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d3f75-7764-4f64-b37b-181e7872ab43 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:18.066393 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0e1f5-aef1-40bd-a9ab-5bef3cdf2af8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:18.091640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d3f75-7764-4f64-b37b-181e7872ab43 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:18.114774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5941e9-5ef4-44ab-a266-07e0638091e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:18.115454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5941e9-5ef4-44ab-a266-07e0638091e9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:18.115741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5941e9-5ef4-44ab-a266-07e0638091e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:18.116018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5941e9-5ef4-44ab-a266-07e0638091e9 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:18.116854 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5941e9-5ef4-44ab-a266-07e0638091e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:18.117164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5941e9-5ef4-44ab-a266-07e0638091e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:18.118640 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5941e9-5ef4-44ab-a266-07e0638091e9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:18.126759 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e6dfc-14c8-45a9-8bc4-8fa26c8d5b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:18.127423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e6dfc-14c8-45a9-8bc4-8fa26c8d5b50 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:18.127707 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e6dfc-14c8-45a9-8bc4-8fa26c8d5b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:18.127981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e6dfc-14c8-45a9-8bc4-8fa26c8d5b50 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:18.128763 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e6dfc-14c8-45a9-8bc4-8fa26c8d5b50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:18.129072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e6dfc-14c8-45a9-8bc4-8fa26c8d5b50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:18.130585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e6dfc-14c8-45a9-8bc4-8fa26c8d5b50 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:18.138255 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 353/696] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 11 20:46:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:18.146896 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5941e9-5ef4-44ab-a266-07e0638091e9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:18.148459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 344/697] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:18.158401 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e6dfc-14c8-45a9-8bc4-8fa26c8d5b50 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:18.261965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e6dfc-14c8-45a9-8bc4-8fa26c8d5b50 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:18.295445 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39cc3f-6df5-44d7-a99b-741ea41e6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:18.296107 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39cc3f-6df5-44d7-a99b-741ea41e6085 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:18.296387 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39cc3f-6df5-44d7-a99b-741ea41e6085 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:18.296661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39cc3f-6df5-44d7-a99b-741ea41e6085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:18.297491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39cc3f-6df5-44d7-a99b-741ea41e6085 None admin] RBAC: Adding query filter params (role.id=b18c84f91b764bea92cc22c80a49bcaa, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=85cb784bf9984abc9977c665a6db1656) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:18.297837 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39cc3f-6df5-44d7-a99b-741ea41e6085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:18.299279 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39cc3f-6df5-44d7-a99b-741ea41e6085 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:18.305624 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 345/698] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:18 2022] GET /identity/v3/role_assignments?user.id=85cb784bf9984abc9977c665a6db1656&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=b18c84f91b764bea92cc22c80a49bcaa => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:18.329399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5941e9-5ef4-44ab-a266-07e0638091e9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:18.365999 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2225c79-06b1-4b3b-a541-8a2ca862bfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:18.366649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2225c79-06b1-4b3b-a541-8a2ca862bfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:18.366931 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2225c79-06b1-4b3b-a541-8a2ca862bfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:18.367204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2225c79-06b1-4b3b-a541-8a2ca862bfa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:18.438855 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2225c79-06b1-4b3b-a541-8a2ca862bfa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:18.440336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2225c79-06b1-4b3b-a541-8a2ca862bfa6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:18.552091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 354/699] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 11 20:46:18.553474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39cc3f-6df5-44d7-a99b-741ea41e6085 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:18.686792 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39cc3f-6df5-44d7-a99b-741ea41e6085 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:18.723525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996dfa9-be80-4c80-afb7-c89ca0e74a1c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:18.723907 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996dfa9-be80-4c80-afb7-c89ca0e74a1c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:18.724112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996dfa9-be80-4c80-afb7-c89ca0e74a1c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:18.725048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aff31c-4153-44eb-a4c3-c08976b3d475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:18.725562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 355/700] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:46:18.725880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aff31c-4153-44eb-a4c3-c08976b3d475 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:18.726163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aff31c-4153-44eb-a4c3-c08976b3d475 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:18.726437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aff31c-4153-44eb-a4c3-c08976b3d475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:18.732139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82df9b-9a5b-4987-8b7c-1fa3942d2337 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:18.732676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82df9b-9a5b-4987-8b7c-1fa3942d2337 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:18.733152 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82df9b-9a5b-4987-8b7c-1fa3942d2337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:18.738081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aff31c-4153-44eb-a4c3-c08976b3d475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:18.739539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aff31c-4153-44eb-a4c3-c08976b3d475 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:18.750963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ae82df9b-9a5b-4987-8b7c-1fa3942d2337 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:18.752400 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ae82df9b-9a5b-4987-8b7c-1fa3942d2337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-87aff31c-4153-44eb-a4c3-c08976b3d475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:18.756375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:18.757268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:18.758275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:18.758275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:18.758275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:18.758275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:18.758275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 346/701] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:18.762899 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aff31c-4153-44eb-a4c3-c08976b3d475 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:18.840204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 356/702] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:46:18.868869 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82df9b-9a5b-4987-8b7c-1fa3942d2337 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:18.879360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aff31c-4153-44eb-a4c3-c08976b3d475 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:18.924582 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c09ef4-30cb-4c9a-9407-28116f24acfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:18.925283 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c09ef4-30cb-4c9a-9407-28116f24acfd None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:18.925607 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c09ef4-30cb-4c9a-9407-28116f24acfd None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:18.925888 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c09ef4-30cb-4c9a-9407-28116f24acfd None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:18.926638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c09ef4-30cb-4c9a-9407-28116f24acfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:18.926949 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c09ef4-30cb-4c9a-9407-28116f24acfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:18.928379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c09ef4-30cb-4c9a-9407-28116f24acfd None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:18.944954 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 347/703] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:18.950082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c09ef4-30cb-4c9a-9407-28116f24acfd None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:18.987080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82df9b-9a5b-4987-8b7c-1fa3942d2337 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:19.033434 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86effd4a-9ed6-400d-ab71-3e3623d9903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:19.035148 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86effd4a-9ed6-400d-ab71-3e3623d9903e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:19.035596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86effd4a-9ed6-400d-ab71-3e3623d9903e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:19.036041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86effd4a-9ed6-400d-ab71-3e3623d9903e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:19.050823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86effd4a-9ed6-400d-ab71-3e3623d9903e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:19.053328 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86effd4a-9ed6-400d-ab71-3e3623d9903e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:19.061601 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c09ef4-30cb-4c9a-9407-28116f24acfd None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-86effd4a-9ed6-400d-ab71-3e3623d9903e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:19.077694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:19.078857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:19.079921 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:19.079921 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:19.079921 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:19.079921 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:19.082286 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 357/704] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:19.089309 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86effd4a-9ed6-400d-ab71-3e3623d9903e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:19.104353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d572d02-ac7f-4471-a265-e13ab352f770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:19.105147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d572d02-ac7f-4471-a265-e13ab352f770 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:19.105430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d572d02-ac7f-4471-a265-e13ab352f770 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:19.105733 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d572d02-ac7f-4471-a265-e13ab352f770 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:19.114757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d572d02-ac7f-4471-a265-e13ab352f770 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:19.116259 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d572d02-ac7f-4471-a265-e13ab352f770 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-1d572d02-ac7f-4471-a265-e13ab352f770 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:19.130667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:19.131660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:19.132564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:19.132564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:19.132564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:19.132564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:19.132564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:19.132564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:19.132564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:19.132564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:19.136293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 348/705] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:19.138348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d572d02-ac7f-4471-a265-e13ab352f770 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:19.213142 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86effd4a-9ed6-400d-ab71-3e3623d9903e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:19.251239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4530d-11d6-495c-a143-49798dc57970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:19.252287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4530d-11d6-495c-a143-49798dc57970 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:19.253086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4530d-11d6-495c-a143-49798dc57970 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:19.253586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4530d-11d6-495c-a143-49798dc57970 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:19.254509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4530d-11d6-495c-a143-49798dc57970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:19.255484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4530d-11d6-495c-a143-49798dc57970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:19.257064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4530d-11d6-495c-a143-49798dc57970 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:19.271255 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 358/706] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:19.277183 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4530d-11d6-495c-a143-49798dc57970 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:19.301059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d572d02-ac7f-4471-a265-e13ab352f770 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:19.346006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac9299-359b-45e5-93b4-9cb346a09c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:19.346696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac9299-359b-45e5-93b4-9cb346a09c2d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:19.347141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac9299-359b-45e5-93b4-9cb346a09c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:19.347248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac9299-359b-45e5-93b4-9cb346a09c2d None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:19.348021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac9299-359b-45e5-93b4-9cb346a09c2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:19.348356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac9299-359b-45e5-93b4-9cb346a09c2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:19.349812 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac9299-359b-45e5-93b4-9cb346a09c2d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:19.367425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 349/707] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:19.368804 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2115-cad5-42d3-96fb-6a12f41b9e34 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:19.369099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2115-cad5-42d3-96fb-6a12f41b9e34 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:19.369382 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2115-cad5-42d3-96fb-6a12f41b9e34 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:19.375271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 350/708] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:19.375271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2115-cad5-42d3-96fb-6a12f41b9e34 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:19.411319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4530d-11d6-495c-a143-49798dc57970 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:19.445276 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dd481-a7bc-420f-8cd1-1db8f5abef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:19.446339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dd481-a7bc-420f-8cd1-1db8f5abef86 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:19.446918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dd481-a7bc-420f-8cd1-1db8f5abef86 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:19.447392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dd481-a7bc-420f-8cd1-1db8f5abef86 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:19.448281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dd481-a7bc-420f-8cd1-1db8f5abef86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:19.449959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dd481-a7bc-420f-8cd1-1db8f5abef86 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:19.478042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2115-cad5-42d3-96fb-6a12f41b9e34 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:19.511859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21bde9-6388-4bcf-bf48-523fa4b257c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:19.513749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21bde9-6388-4bcf-bf48-523fa4b257c0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:19.513749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21bde9-6388-4bcf-bf48-523fa4b257c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:19.513907 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21bde9-6388-4bcf-bf48-523fa4b257c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:19.514662 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21bde9-6388-4bcf-bf48-523fa4b257c0 None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=f400b94d3fbc40bdace4860fe83a0891) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:19.514981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21bde9-6388-4bcf-bf48-523fa4b257c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:19.516518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21bde9-6388-4bcf-bf48-523fa4b257c0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:19.525608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 351/709] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:19 2022] GET /identity/v3/role_assignments?user.id=f400b94d3fbc40bdace4860fe83a0891&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:19.527386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ad1d5-4767-4411-9689-409a9b98fdf1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:19.527905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ad1d5-4767-4411-9689-409a9b98fdf1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:19.528403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ad1d5-4767-4411-9689-409a9b98fdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:19.541421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 359/710] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:46:19 2022] POST /identity/v3/users => generated 254 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 20:46:19.557072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d17ad1d5-4767-4411-9689-409a9b98fdf1 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:19.558701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d17ad1d5-4767-4411-9689-409a9b98fdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:19.638758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 352/711] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:19.663907 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dd481-a7bc-420f-8cd1-1db8f5abef86 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:19.784546 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dd481-a7bc-420f-8cd1-1db8f5abef86 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:19.823700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc1896-6983-4972-af5f-8de53344d426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:19.824925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc1896-6983-4972-af5f-8de53344d426 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:19.825447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc1896-6983-4972-af5f-8de53344d426 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:19.825995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc1896-6983-4972-af5f-8de53344d426 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:19.826862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc1896-6983-4972-af5f-8de53344d426 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:19.828467 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc1896-6983-4972-af5f-8de53344d426 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d9cc1896-6983-4972-af5f-8de53344d426 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:19.844351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:19.851972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:19.852842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 360/712] 10.222.0.35 () {56 vars in 1129 bytes} [Wed May 11 20:46:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:19.854237 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ad1d5-4767-4411-9689-409a9b98fdf1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:19.970686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ad1d5-4767-4411-9689-409a9b98fdf1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:20.007708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31606c-5f38-4589-8c4e-9bfaec615cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:20.008386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31606c-5f38-4589-8c4e-9bfaec615cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:20.008665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31606c-5f38-4589-8c4e-9bfaec615cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:20.008940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31606c-5f38-4589-8c4e-9bfaec615cf6 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:20.009672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31606c-5f38-4589-8c4e-9bfaec615cf6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:20.009977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31606c-5f38-4589-8c4e-9bfaec615cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:20.011347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31606c-5f38-4589-8c4e-9bfaec615cf6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:20.016853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 353/713] 10.222.0.35 () {56 vars in 1124 bytes} [Wed May 11 20:46:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:20.022339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc1896-6983-4972-af5f-8de53344d426 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:20.126165 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc1896-6983-4972-af5f-8de53344d426 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:20.163405 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219a438-9036-42bb-b879-e411ce573e60 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:20.163757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219a438-9036-42bb-b879-e411ce573e60 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:20.163968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219a438-9036-42bb-b879-e411ce573e60 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:20.165505 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 354/714] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:20.166765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a126d-d2b6-490c-8c0a-6316ee82c028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:20.167412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a126d-d2b6-490c-8c0a-6316ee82c028 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:20.167696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a126d-d2b6-490c-8c0a-6316ee82c028 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:20.167968 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a126d-d2b6-490c-8c0a-6316ee82c028 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:20.168675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a126d-d2b6-490c-8c0a-6316ee82c028 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:20.169592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a126d-d2b6-490c-8c0a-6316ee82c028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:20.170978 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a126d-d2b6-490c-8c0a-6316ee82c028 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:20.177644 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 361/715] 10.222.0.35 () {56 vars in 1124 bytes} [Wed May 11 20:46:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:20.178890 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028975ea-103d-46c5-a127-8e4d169c9acc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:20.179180 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028975ea-103d-46c5-a127-8e4d169c9acc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:20.179456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028975ea-103d-46c5-a127-8e4d169c9acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:20.197308 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-028975ea-103d-46c5-a127-8e4d169c9acc None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:20.198569 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-028975ea-103d-46c5-a127-8e4d169c9acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:20.284770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 355/716] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:20.313948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a126d-d2b6-490c-8c0a-6316ee82c028 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:20.443926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a126d-d2b6-490c-8c0a-6316ee82c028 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:20.478915 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3d1be-cc27-496a-adde-8e7441be9dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:20.480123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3d1be-cc27-496a-adde-8e7441be9dee None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:20.480631 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3d1be-cc27-496a-adde-8e7441be9dee None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:20.481125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3d1be-cc27-496a-adde-8e7441be9dee None admin] PATH_INFO: `/v3/services/network` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:20.482549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3d1be-cc27-496a-adde-8e7441be9dee None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:20.484175 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3d1be-cc27-496a-adde-8e7441be9dee None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-eab3d1be-cc27-496a-adde-8e7441be9dee None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:20.496534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:20.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:20.499073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:20.499073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:20.499073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:20.499073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:20.499073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:20.499073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:20.499073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:20.499073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:20.499073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:20.499073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:20.499073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:20.499073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:20.499073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 20:46:20.499073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:20.508403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 362/717] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:20 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:20.510012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028975ea-103d-46c5-a127-8e4d169c9acc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:20.618354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028975ea-103d-46c5-a127-8e4d169c9acc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:20.652765 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20179189-f0ef-48e8-9b92-728036d8b589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:20.653467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20179189-f0ef-48e8-9b92-728036d8b589 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:20.653775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20179189-f0ef-48e8-9b92-728036d8b589 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:20.654054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20179189-f0ef-48e8-9b92-728036d8b589 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:20.654760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20179189-f0ef-48e8-9b92-728036d8b589 None admin] RBAC: Adding query filter params (name=network) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:20.655068 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20179189-f0ef-48e8-9b92-728036d8b589 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:20.656440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20179189-f0ef-48e8-9b92-728036d8b589 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:20.661171 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 356/718] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 11 20:46:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:20.666840 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3d1be-cc27-496a-adde-8e7441be9dee None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:20.808122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3d1be-cc27-496a-adde-8e7441be9dee None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:20.851166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de49c7b-1fc0-48b3-9504-9b20081b1487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:20.851844 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de49c7b-1fc0-48b3-9504-9b20081b1487 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:20.852131 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de49c7b-1fc0-48b3-9504-9b20081b1487 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:20.852409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de49c7b-1fc0-48b3-9504-9b20081b1487 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:20.853121 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de49c7b-1fc0-48b3-9504-9b20081b1487 None admin] RBAC: Adding query filter params (type=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:20.853432 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de49c7b-1fc0-48b3-9504-9b20081b1487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:20.854885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de49c7b-1fc0-48b3-9504-9b20081b1487 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:20.865546 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 363/719] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 11 20:46:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:21.347696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae2d8b-3f62-4f83-9aed-21fea04dede2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:21.348240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae2d8b-3f62-4f83-9aed-21fea04dede2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:21.348240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae2d8b-3f62-4f83-9aed-21fea04dede2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:21.349930 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 357/720] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:21.355071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0f63c-4cda-4f53-b544-856d628bd20d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:21.355400 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0f63c-4cda-4f53-b544-856d628bd20d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:21.355686 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0f63c-4cda-4f53-b544-856d628bd20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:21.378544 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5ed0f63c-4cda-4f53-b544-856d628bd20d None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:21.379831 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5ed0f63c-4cda-4f53-b544-856d628bd20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:21.467624 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 364/721] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 11 20:46:21.501583 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae2d8b-3f62-4f83-9aed-21fea04dede2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:21.613360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae2d8b-3f62-4f83-9aed-21fea04dede2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:21.658392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ba9cb-eda7-4672-8b7d-e6ce8420cc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:21.659197 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ba9cb-eda7-4672-8b7d-e6ce8420cc1c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:21.659484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ba9cb-eda7-4672-8b7d-e6ce8420cc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:21.659762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ba9cb-eda7-4672-8b7d-e6ce8420cc1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:21.675920 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ba9cb-eda7-4672-8b7d-e6ce8420cc1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-614ba9cb-eda7-4672-8b7d-e6ce8420cc1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:21.683782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:21.685353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:21.686229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:21.686229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:21.686229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:21.686229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:21.686229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:21.686229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:21.686229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:21.686229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:21.686229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:21.686229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:21.686229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:46:21.686229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:21.686229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 358/722] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:46:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:21.693180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0f63c-4cda-4f53-b544-856d628bd20d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:21.791280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0f63c-4cda-4f53-b544-856d628bd20d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:21.838239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d0ede-6683-4041-a442-8b6c35633816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:21.838920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0ede-6683-4041-a442-8b6c35633816 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:21.839209 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0ede-6683-4041-a442-8b6c35633816 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:21.839490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0ede-6683-4041-a442-8b6c35633816 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:21.840251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d0ede-6683-4041-a442-8b6c35633816 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:21.840563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d0ede-6683-4041-a442-8b6c35633816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:21.842622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d0ede-6683-4041-a442-8b6c35633816 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:21.854879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 365/723] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:46:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:21.861315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ba9cb-eda7-4672-8b7d-e6ce8420cc1c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:21.987603 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ba9cb-eda7-4672-8b7d-e6ce8420cc1c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:22.026683 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e2cb4-1825-4d98-af4d-d5cb96af2d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:22.027507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2cb4-1825-4d98-af4d-d5cb96af2d4c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:22.027795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2cb4-1825-4d98-af4d-d5cb96af2d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:22.028076 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2cb4-1825-4d98-af4d-d5cb96af2d4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:22.040823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e2cb4-1825-4d98-af4d-d5cb96af2d4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:22.042434 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e2cb4-1825-4d98-af4d-d5cb96af2d4c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-183e2cb4-1825-4d98-af4d-d5cb96af2d4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:22.061049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:22.062035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:22.062940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:22.062940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:22.062940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:22.062940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:22.062940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 359/724] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:22.074174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d0ede-6683-4041-a442-8b6c35633816 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:22.266106 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546759c8-bdc1-4c6f-bfcd-7782e620df2f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:22.266473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546759c8-bdc1-4c6f-bfcd-7782e620df2f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:22.266577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546759c8-bdc1-4c6f-bfcd-7782e620df2f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:22.267993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 360/725] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:46:22.284829 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7b4e0-e9d1-412c-b32a-1f3a812d0efe None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:22.285135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7b4e0-e9d1-412c-b32a-1f3a812d0efe None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:22.285391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7b4e0-e9d1-412c-b32a-1f3a812d0efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:22.306981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ede7b4e0-e9d1-412c-b32a-1f3a812d0efe None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:22.308176 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ede7b4e0-e9d1-412c-b32a-1f3a812d0efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:22.377216 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d0ede-6683-4041-a442-8b6c35633816 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:22.431229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c6c9c-316b-4e42-b00e-3f21bcbc76d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:22.431925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c6c9c-316b-4e42-b00e-3f21bcbc76d6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:22.432261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c6c9c-316b-4e42-b00e-3f21bcbc76d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:22.432545 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c6c9c-316b-4e42-b00e-3f21bcbc76d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:22.433265 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c6c9c-316b-4e42-b00e-3f21bcbc76d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:22.433592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c6c9c-316b-4e42-b00e-3f21bcbc76d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:22.436075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c6c9c-316b-4e42-b00e-3f21bcbc76d6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:22.445649 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 361/726] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:22.459227 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 366/727] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:22.464515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7b4e0-e9d1-412c-b32a-1f3a812d0efe None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:22.483251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c6c9c-316b-4e42-b00e-3f21bcbc76d6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:22.644415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7b4e0-e9d1-412c-b32a-1f3a812d0efe None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:22.661459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c6c9c-316b-4e42-b00e-3f21bcbc76d6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:22.707933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759a13d-6b30-4bdb-b891-702dfd693630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:22.708744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a13d-6b30-4bdb-b891-702dfd693630 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:22.709029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a13d-6b30-4bdb-b891-702dfd693630 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:22.709306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a13d-6b30-4bdb-b891-702dfd693630 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:22.719973 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759a13d-6b30-4bdb-b891-702dfd693630 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:22.721433 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759a13d-6b30-4bdb-b891-702dfd693630 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:22.722977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d250bc-5566-4485-88c7-c191abc17359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:22.723777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d250bc-5566-4485-88c7-c191abc17359 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:22.724061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d250bc-5566-4485-88c7-c191abc17359 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:22.724338 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d250bc-5566-4485-88c7-c191abc17359 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d759a13d-6b30-4bdb-b891-702dfd693630 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:22.744511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:22.745567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:22.746621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:22.746621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:22.746621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:22.746621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:22.746621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:22.746621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:22.746621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:22.746621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:22.746621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 20:46:22.746621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:22.747233 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 362/728] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:46:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:22.750930 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132517f-c6b0-4e30-a2cc-ef67a75f1f44 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:22.751328 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132517f-c6b0-4e30-a2cc-ef67a75f1f44 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:22.751718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132517f-c6b0-4e30-a2cc-ef67a75f1f44 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:22.753373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 363/729] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:22.754594 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d250bc-5566-4485-88c7-c191abc17359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:22.758310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132517f-c6b0-4e30-a2cc-ef67a75f1f44 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-36d250bc-5566-4485-88c7-c191abc17359 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:22.765551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:22.766680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:22.767830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:22.767830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:22.767830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:22.767830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:22.767830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:22.767830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:22.767830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:22.767830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:22.767830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:22.767830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:22.767830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:46:22.767830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:22.769037 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 367/730] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:46:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:22.771238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61699580-ef82-4fe5-83df-1dd23411ab28 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:22.771531 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61699580-ef82-4fe5-83df-1dd23411ab28 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:22.771820 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61699580-ef82-4fe5-83df-1dd23411ab28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:22.790321 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-61699580-ef82-4fe5-83df-1dd23411ab28 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:22.791458 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-61699580-ef82-4fe5-83df-1dd23411ab28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:22.869646 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 368/731] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:22.873563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61699580-ef82-4fe5-83df-1dd23411ab28 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:22.895712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132517f-c6b0-4e30-a2cc-ef67a75f1f44 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:22.931971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c8176-d0c5-4685-b2d4-1bcd5f325b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:22.932715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c8176-d0c5-4685-b2d4-1bcd5f325b63 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:22.933005 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c8176-d0c5-4685-b2d4-1bcd5f325b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:22.933283 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c8176-d0c5-4685-b2d4-1bcd5f325b63 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:22.934182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c8176-d0c5-4685-b2d4-1bcd5f325b63 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:22.935057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c8176-d0c5-4685-b2d4-1bcd5f325b63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:22.936585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c8176-d0c5-4685-b2d4-1bcd5f325b63 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:22.959133 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 364/732] 10.222.0.35 () {56 vars in 1135 bytes} [Wed May 11 20:46:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:22.960059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c8176-d0c5-4685-b2d4-1bcd5f325b63 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:23.001484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61699580-ef82-4fe5-83df-1dd23411ab28 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:23.044673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bac749-dff8-4632-811e-465f0719c04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:23.045346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bac749-dff8-4632-811e-465f0719c04f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:23.045818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bac749-dff8-4632-811e-465f0719c04f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:23.046103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bac749-dff8-4632-811e-465f0719c04f None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:23.047200 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bac749-dff8-4632-811e-465f0719c04f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:23.047514 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bac749-dff8-4632-811e-465f0719c04f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:23.048889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bac749-dff8-4632-811e-465f0719c04f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:23.060967 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 369/733] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:23.061793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bac749-dff8-4632-811e-465f0719c04f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:23.066155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c8176-d0c5-4685-b2d4-1bcd5f325b63 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:23.104784 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d55d06-30b4-4174-929e-d6f232d3ac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:23.106073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d55d06-30b4-4174-929e-d6f232d3ac39 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:23.106987 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d55d06-30b4-4174-929e-d6f232d3ac39 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:23.107334 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d55d06-30b4-4174-929e-d6f232d3ac39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:23.117975 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d55d06-30b4-4174-929e-d6f232d3ac39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-00d55d06-30b4-4174-929e-d6f232d3ac39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:23.126391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:23.128251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:23.130319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:23.130319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:23.130319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:23.130319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:23.130319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:23.130319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:23.130319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:23.130319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:23.130319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:23.130319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:23.130319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:23.130319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:23.137615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 365/734] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:23.137615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d55d06-30b4-4174-929e-d6f232d3ac39 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:23.177166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bac749-dff8-4632-811e-465f0719c04f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:23.225647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79012b4d-678b-4e05-a256-536e844ea7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:23.226517 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012b4d-678b-4e05-a256-536e844ea7dc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:23.227109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012b4d-678b-4e05-a256-536e844ea7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:23.227391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79012b4d-678b-4e05-a256-536e844ea7dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:23.241943 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d55d06-30b4-4174-929e-d6f232d3ac39 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:23.283372 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e407d-012d-433d-9685-1d6c04b4979d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:23.284184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e407d-012d-433d-9685-1d6c04b4979d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:23.284469 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e407d-012d-433d-9685-1d6c04b4979d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:23.284754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e407d-012d-433d-9685-1d6c04b4979d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:23.296520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e407d-012d-433d-9685-1d6c04b4979d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:23.298030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e407d-012d-433d-9685-1d6c04b4979d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:23.315479 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79012b4d-678b-4e05-a256-536e844ea7dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-fd5e407d-012d-433d-9685-1d6c04b4979d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:23.315770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:23.317844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:23.320063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:23.320063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:23.320063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:23.320063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:23.320592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79012b4d-678b-4e05-a256-536e844ea7dc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:23.329550 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 366/735] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:23.329550 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e407d-012d-433d-9685-1d6c04b4979d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:23.423684 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e407d-012d-433d-9685-1d6c04b4979d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:23.431200 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 370/736] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 11 20:46:23.431200 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79012b4d-678b-4e05-a256-536e844ea7dc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:23.457931 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f885273-1802-43b3-ab3a-5b0e1f9cd21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:23.458607 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f885273-1802-43b3-ab3a-5b0e1f9cd21a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:23.458896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f885273-1802-43b3-ab3a-5b0e1f9cd21a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:23.459178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f885273-1802-43b3-ab3a-5b0e1f9cd21a None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:23.459932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f885273-1802-43b3-ab3a-5b0e1f9cd21a None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:23.460244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f885273-1802-43b3-ab3a-5b0e1f9cd21a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:23.461645 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f885273-1802-43b3-ab3a-5b0e1f9cd21a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:23.469964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 367/737] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:46:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:23.471263 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cad8c-84a5-45f3-8c3e-f2f112b41afa None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:23.471558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cad8c-84a5-45f3-8c3e-f2f112b41afa None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:23.471842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cad8c-84a5-45f3-8c3e-f2f112b41afa None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:23.473352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 368/738] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:23.474269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cad8c-84a5-45f3-8c3e-f2f112b41afa None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:23.525857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79012b4d-678b-4e05-a256-536e844ea7dc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:23.557541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29373ad6-44f4-4c39-8320-0257c61adff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:23.558218 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29373ad6-44f4-4c39-8320-0257c61adff8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:23.558496 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29373ad6-44f4-4c39-8320-0257c61adff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:23.558774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29373ad6-44f4-4c39-8320-0257c61adff8 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:23.559477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29373ad6-44f4-4c39-8320-0257c61adff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:23.559828 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29373ad6-44f4-4c39-8320-0257c61adff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:23.561182 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29373ad6-44f4-4c39-8320-0257c61adff8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:23.569238 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cad8c-84a5-45f3-8c3e-f2f112b41afa None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:23.572012 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 371/739] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:23.573197 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377d6f9-ef49-44f8-a7e3-8fa220b0ef3d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:23.573481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377d6f9-ef49-44f8-a7e3-8fa220b0ef3d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:23.573785 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377d6f9-ef49-44f8-a7e3-8fa220b0ef3d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:23.575609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 372/740] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:23.580085 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377d6f9-ef49-44f8-a7e3-8fa220b0ef3d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:23.601706 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cf6aa-369f-42ed-b24f-99b0e9853481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:23.602487 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cf6aa-369f-42ed-b24f-99b0e9853481 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:23.602768 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cf6aa-369f-42ed-b24f-99b0e9853481 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:23.603043 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cf6aa-369f-42ed-b24f-99b0e9853481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:23.613165 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cf6aa-369f-42ed-b24f-99b0e9853481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:23.614627 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cf6aa-369f-42ed-b24f-99b0e9853481 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a25cf6aa-369f-42ed-b24f-99b0e9853481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:23.631463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:23.632420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:23.638720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:23.638720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:23.638720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:23.638720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:23.638720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 369/741] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:23.638720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde1f7-fcc4-4a7f-b51a-7eeffd86505b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:23.638720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde1f7-fcc4-4a7f-b51a-7eeffd86505b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:23.638720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde1f7-fcc4-4a7f-b51a-7eeffd86505b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:23.652486 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2fcde1f7-fcc4-4a7f-b51a-7eeffd86505b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:23.654239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2fcde1f7-fcc4-4a7f-b51a-7eeffd86505b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:23.675873 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377d6f9-ef49-44f8-a7e3-8fa220b0ef3d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:23.707449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3fbce-7f86-416f-8725-7c6e4d639e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:23.708163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3fbce-7f86-416f-8725-7c6e4d639e4d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:23.708448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3fbce-7f86-416f-8725-7c6e4d639e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:23.708724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3fbce-7f86-416f-8725-7c6e4d639e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:23.716262 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 370/742] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:23.717250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcde1f7-fcc4-4a7f-b51a-7eeffd86505b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:23.719539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3fbce-7f86-416f-8725-7c6e4d639e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:23.720977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3fbce-7f86-416f-8725-7c6e4d639e4d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-44e3fbce-7f86-416f-8725-7c6e4d639e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:23.743956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:23.744952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:23.746313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:23.746313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:23.746313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:23.746313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:23.746313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 373/743] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:23.746602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf4465-dcab-48e7-9c1d-492c87b21286 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:23.746836 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf4465-dcab-48e7-9c1d-492c87b21286 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:23.747054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf4465-dcab-48e7-9c1d-492c87b21286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:23.763188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-babf4465-dcab-48e7-9c1d-492c87b21286 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:23.764385 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-babf4465-dcab-48e7-9c1d-492c87b21286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:23.814062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcde1f7-fcc4-4a7f-b51a-7eeffd86505b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:23.828547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 374/744] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 11 20:46:23.829403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf4465-dcab-48e7-9c1d-492c87b21286 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:23.854378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f22f7-881a-4d20-829e-cd2163206a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:23.855171 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f22f7-881a-4d20-829e-cd2163206a2f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:23.855454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f22f7-881a-4d20-829e-cd2163206a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:23.855727 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f22f7-881a-4d20-829e-cd2163206a2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:23.862733 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f22f7-881a-4d20-829e-cd2163206a2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:23.864162 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f22f7-881a-4d20-829e-cd2163206a2f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-fc3f22f7-881a-4d20-829e-cd2163206a2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:23.878518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:23.879504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:23.880507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:23.880507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:23.880507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:23.880507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:23.880507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:23.880507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:23.880507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:23.880507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:23.880507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 20:46:23.880507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:23.880507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 371/745] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 11 20:46:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:23.880507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f22f7-881a-4d20-829e-cd2163206a2f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:23.927090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf4465-dcab-48e7-9c1d-492c87b21286 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:23.959434 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313112b-d599-44c9-94eb-237abb16a18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:23.960018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313112b-d599-44c9-94eb-237abb16a18e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:23.960299 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313112b-d599-44c9-94eb-237abb16a18e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:23.960570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313112b-d599-44c9-94eb-237abb16a18e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:23.961282 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313112b-d599-44c9-94eb-237abb16a18e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:23.961619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313112b-d599-44c9-94eb-237abb16a18e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:23.962984 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313112b-d599-44c9-94eb-237abb16a18e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:23.973829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 375/746] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:23.974436 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313112b-d599-44c9-94eb-237abb16a18e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:23.980123 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f22f7-881a-4d20-829e-cd2163206a2f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:24.012345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8e7dc-ff77-4f42-b56e-12ea5b0811f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:24.013569 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8e7dc-ff77-4f42-b56e-12ea5b0811f3 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:24.013860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8e7dc-ff77-4f42-b56e-12ea5b0811f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:24.014136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8e7dc-ff77-4f42-b56e-12ea5b0811f3 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:24.014849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8e7dc-ff77-4f42-b56e-12ea5b0811f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:24.016207 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8e7dc-ff77-4f42-b56e-12ea5b0811f3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:24.066347 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313112b-d599-44c9-94eb-237abb16a18e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:24.097530 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c306693-b814-4743-bf99-9d655581535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:24.098191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306693-b814-4743-bf99-9d655581535b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:24.098480 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306693-b814-4743-bf99-9d655581535b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:24.098753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306693-b814-4743-bf99-9d655581535b None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:24.099457 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c306693-b814-4743-bf99-9d655581535b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:24.099763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c306693-b814-4743-bf99-9d655581535b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:24.101112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c306693-b814-4743-bf99-9d655581535b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:24.112214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 376/747] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:24.112960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c306693-b814-4743-bf99-9d655581535b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:24.134028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 372/748] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 11 20:46:23 2022] POST /identity/v3/services => generated 240 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:46:24.134842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8e7dc-ff77-4f42-b56e-12ea5b0811f3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:24.219803 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c306693-b814-4743-bf99-9d655581535b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:24.250622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8e7dc-ff77-4f42-b56e-12ea5b0811f3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:24.255848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe5151-63ce-4cb7-b4c3-7bfaa78e0687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:24.256529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe5151-63ce-4cb7-b4c3-7bfaa78e0687 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:24.256813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe5151-63ce-4cb7-b4c3-7bfaa78e0687 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:24.257092 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe5151-63ce-4cb7-b4c3-7bfaa78e0687 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:24.257861 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe5151-63ce-4cb7-b4c3-7bfaa78e0687 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:24.259248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe5151-63ce-4cb7-b4c3-7bfaa78e0687 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:24.285116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c5335-c2eb-4981-b340-d82e46e4af4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:24.285844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c5335-c2eb-4981-b340-d82e46e4af4f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:24.286130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c5335-c2eb-4981-b340-d82e46e4af4f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:24.286406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c5335-c2eb-4981-b340-d82e46e4af4f None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:24.287305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c5335-c2eb-4981-b340-d82e46e4af4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:24.287571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c5335-c2eb-4981-b340-d82e46e4af4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:24.289031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c5335-c2eb-4981-b340-d82e46e4af4f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:24.308140 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 373/749] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 11 20:46:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:24.308817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c5335-c2eb-4981-b340-d82e46e4af4f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:24.334731 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 377/750] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 11 20:46:24 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:46:24.335949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe5151-63ce-4cb7-b4c3-7bfaa78e0687 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:24.421147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c5335-c2eb-4981-b340-d82e46e4af4f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:24.464643 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dc6aa-4a9e-4055-b75a-0e7179ac579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:24.465460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dc6aa-4a9e-4055-b75a-0e7179ac579d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:24.465931 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dc6aa-4a9e-4055-b75a-0e7179ac579d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:24.466218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dc6aa-4a9e-4055-b75a-0e7179ac579d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:24.466551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe5151-63ce-4cb7-b4c3-7bfaa78e0687 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:24.474134 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6dc6aa-4a9e-4055-b75a-0e7179ac579d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:24.475557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6dc6aa-4a9e-4055-b75a-0e7179ac579d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-8e6dc6aa-4a9e-4055-b75a-0e7179ac579d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:24.490977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:24.492141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:24.494189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:24.494189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:24.494189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:24.494189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:24.494189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:24.494189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:24.494189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:24.494189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:24.501592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 374/751] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:24.501592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dc6aa-4a9e-4055-b75a-0e7179ac579d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:24.506080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c781e-bd2a-477b-91a7-4a8e8a735d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:24.507133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c781e-bd2a-477b-91a7-4a8e8a735d01 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:24.507563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c781e-bd2a-477b-91a7-4a8e8a735d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:24.508262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c781e-bd2a-477b-91a7-4a8e8a735d01 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:24.518292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c781e-bd2a-477b-91a7-4a8e8a735d01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:24.520278 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c781e-bd2a-477b-91a7-4a8e8a735d01 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-044c781e-bd2a-477b-91a7-4a8e8a735d01 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:24.535898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:24.536934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:24.538173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:24.538173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:24.538173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:24.538173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:24.538173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:24.538173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:24.538173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:24.538173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:24.538173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 20:46:24.538173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:24.538173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 378/752] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 11 20:46:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:24.542454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c781e-bd2a-477b-91a7-4a8e8a735d01 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:24.602959 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dc6aa-4a9e-4055-b75a-0e7179ac579d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:24.636517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857b548-e8a4-4c59-aa06-8c3719241675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:24.637543 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857b548-e8a4-4c59-aa06-8c3719241675 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:24.637659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857b548-e8a4-4c59-aa06-8c3719241675 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:24.637927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857b548-e8a4-4c59-aa06-8c3719241675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:24.646756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c781e-bd2a-477b-91a7-4a8e8a735d01 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:24.648865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857b548-e8a4-4c59-aa06-8c3719241675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:24.650361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857b548-e8a4-4c59-aa06-8c3719241675 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b857b548-e8a4-4c59-aa06-8c3719241675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:24.668128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:24.669695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:24.671220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:24.671220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:24.671220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:24.671220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:24.671220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 375/753] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:24.671220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857b548-e8a4-4c59-aa06-8c3719241675 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:24.686167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4f7eb-df05-4d0c-81bf-eff883e3710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:24.687176 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4f7eb-df05-4d0c-81bf-eff883e3710f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:24.687667 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4f7eb-df05-4d0c-81bf-eff883e3710f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:24.688168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4f7eb-df05-4d0c-81bf-eff883e3710f None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:24.689178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4f7eb-df05-4d0c-81bf-eff883e3710f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:24.689730 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4f7eb-df05-4d0c-81bf-eff883e3710f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:24.691323 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4f7eb-df05-4d0c-81bf-eff883e3710f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:24.708553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 379/754] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:24.709449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4f7eb-df05-4d0c-81bf-eff883e3710f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:24.771895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857b548-e8a4-4c59-aa06-8c3719241675 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:24.806935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064db4d-d2e3-427a-bb96-e76d81c48acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:24.807968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064db4d-d2e3-427a-bb96-e76d81c48acc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:24.808455 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064db4d-d2e3-427a-bb96-e76d81c48acc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:24.808933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064db4d-d2e3-427a-bb96-e76d81c48acc None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:24.810069 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064db4d-d2e3-427a-bb96-e76d81c48acc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:24.810177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4f7eb-df05-4d0c-81bf-eff883e3710f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:24.813174 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064db4d-d2e3-427a-bb96-e76d81c48acc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:24.814962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064db4d-d2e3-427a-bb96-e76d81c48acc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:24.871488 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 376/755] 10.222.0.35 () {56 vars in 1149 bytes} [Wed May 11 20:46:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:24.871488 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064db4d-d2e3-427a-bb96-e76d81c48acc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:24.894561 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ae8ea-809a-4c70-b284-9413d9e88cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:24.894908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ae8ea-809a-4c70-b284-9413d9e88cac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:24.895126 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ae8ea-809a-4c70-b284-9413d9e88cac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:24.895404 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ae8ea-809a-4c70-b284-9413d9e88cac None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:24.896124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ae8ea-809a-4c70-b284-9413d9e88cac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:24.896431 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ae8ea-809a-4c70-b284-9413d9e88cac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:24.897816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ae8ea-809a-4c70-b284-9413d9e88cac None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:24.910256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 380/756] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:24.911099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ae8ea-809a-4c70-b284-9413d9e88cac None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:24.975702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064db4d-d2e3-427a-bb96-e76d81c48acc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:25.010078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b24e8-106f-40aa-ba1c-96a36f539e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:25.010410 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ae8ea-809a-4c70-b284-9413d9e88cac None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:25.011609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b24e8-106f-40aa-ba1c-96a36f539e11 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:25.012113 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b24e8-106f-40aa-ba1c-96a36f539e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:25.013124 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b24e8-106f-40aa-ba1c-96a36f539e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:25.014191 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b24e8-106f-40aa-ba1c-96a36f539e11 None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=85cb784bf9984abc9977c665a6db1656) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:25.014704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b24e8-106f-40aa-ba1c-96a36f539e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:25.016320 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b24e8-106f-40aa-ba1c-96a36f539e11 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:25.029799 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 377/757] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:24 2022] GET /identity/v3/role_assignments?user.id=85cb784bf9984abc9977c665a6db1656&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:25.031163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b24e8-106f-40aa-ba1c-96a36f539e11 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:25.046394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615fdc4-e2e5-4af9-8cbf-2928421d51db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:25.047051 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615fdc4-e2e5-4af9-8cbf-2928421d51db None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:25.047333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615fdc4-e2e5-4af9-8cbf-2928421d51db None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:25.047610 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615fdc4-e2e5-4af9-8cbf-2928421d51db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:25.119778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615fdc4-e2e5-4af9-8cbf-2928421d51db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:25.121397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615fdc4-e2e5-4af9-8cbf-2928421d51db None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:25.175382 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b24e8-106f-40aa-ba1c-96a36f539e11 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:25.223136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f06be4-df8d-4551-b58d-624d0d009ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:25.223964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f06be4-df8d-4551-b58d-624d0d009ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:25.224251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f06be4-df8d-4551-b58d-624d0d009ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:25.224527 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f06be4-df8d-4551-b58d-624d0d009ba8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:25.226405 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 381/758] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:46:25.233107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615fdc4-e2e5-4af9-8cbf-2928421d51db None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:25.242803 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f06be4-df8d-4551-b58d-624d0d009ba8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:25.244614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f06be4-df8d-4551-b58d-624d0d009ba8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a5f06be4-df8d-4551-b58d-624d0d009ba8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:25.272526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:25.273508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:25.274749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:25.274749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:25.274749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:25.274749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:25.274749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:25.274749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:25.274749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:25.274749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:25.281245 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 378/759] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:25.282491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f06be4-df8d-4551-b58d-624d0d009ba8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:25.338155 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615fdc4-e2e5-4af9-8cbf-2928421d51db None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:25.374475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c16f-4503-4828-968e-f6b5d1d13f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:25.375308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c16f-4503-4828-968e-f6b5d1d13f90 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:25.375595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c16f-4503-4828-968e-f6b5d1d13f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:25.376003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5c16f-4503-4828-968e-f6b5d1d13f90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:25.387234 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5c16f-4503-4828-968e-f6b5d1d13f90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:25.388754 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5c16f-4503-4828-968e-f6b5d1d13f90 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1eb5c16f-4503-4828-968e-f6b5d1d13f90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:25.407477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:25.408426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:25.409822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:25.409822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:25.409822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:25.409822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:25.409822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 382/760] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:25.412875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f06be4-df8d-4551-b58d-624d0d009ba8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:25.414296 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c16f-4503-4828-968e-f6b5d1d13f90 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:25.456716 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7c4b3-32f4-4b3a-afd8-5325acaf5cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:25.457791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7c4b3-32f4-4b3a-afd8-5325acaf5cec None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:25.458276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7c4b3-32f4-4b3a-afd8-5325acaf5cec None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:25.458776 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7c4b3-32f4-4b3a-afd8-5325acaf5cec None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:25.459779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7c4b3-32f4-4b3a-afd8-5325acaf5cec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:25.460296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7c4b3-32f4-4b3a-afd8-5325acaf5cec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:25.461959 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7c4b3-32f4-4b3a-afd8-5325acaf5cec None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:25.492157 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 379/761] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:25.497841 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7c4b3-32f4-4b3a-afd8-5325acaf5cec None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:25.515294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5c16f-4503-4828-968e-f6b5d1d13f90 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:25.550183 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88893a3-0377-4588-8dbb-400f8c90c62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:25.550771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88893a3-0377-4588-8dbb-400f8c90c62d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:25.551053 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88893a3-0377-4588-8dbb-400f8c90c62d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:25.551329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88893a3-0377-4588-8dbb-400f8c90c62d None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:25.552048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88893a3-0377-4588-8dbb-400f8c90c62d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:25.552355 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88893a3-0377-4588-8dbb-400f8c90c62d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:25.553801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88893a3-0377-4588-8dbb-400f8c90c62d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:25.566053 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 383/762] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:25.571244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88893a3-0377-4588-8dbb-400f8c90c62d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:25.640356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7c4b3-32f4-4b3a-afd8-5325acaf5cec None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:25.675469 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ace40-c36e-4d57-871a-9bbbefc24d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:25.676343 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88893a3-0377-4588-8dbb-400f8c90c62d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:25.676479 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ace40-c36e-4d57-871a-9bbbefc24d3d None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:25.676646 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ace40-c36e-4d57-871a-9bbbefc24d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:25.676907 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ace40-c36e-4d57-871a-9bbbefc24d3d None admin] PATH_INFO: `/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/f400b94d3fbc40bdace4860fe83a0891/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:25.680023 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ace40-c36e-4d57-871a-9bbbefc24d3d None admin] RBAC: Authorizing `identity:create_grant(project_id=7c03e5fec995436aa5424d2be2e268aa, user_id=f400b94d3fbc40bdace4860fe83a0891, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:25.681477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ace40-c36e-4d57-871a-9bbbefc24d3d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:25.716668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a512ae-7e30-4d94-aa0d-51139fd1ac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:25.717587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a512ae-7e30-4d94-aa0d-51139fd1ac54 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:25.717917 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a512ae-7e30-4d94-aa0d-51139fd1ac54 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:25.718197 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a512ae-7e30-4d94-aa0d-51139fd1ac54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:25.726412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a512ae-7e30-4d94-aa0d-51139fd1ac54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:25.731415 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a512ae-7e30-4d94-aa0d-51139fd1ac54 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a5a512ae-7e30-4d94-aa0d-51139fd1ac54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:25.744365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:25.745303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:25.747254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:25.747254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:25.747254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:25.747254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:25.747254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:25.747254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:25.747254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:25.747254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:25.747254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 384/763] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:25.751922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a512ae-7e30-4d94-aa0d-51139fd1ac54 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:25.765685 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 380/764] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:46:25 2022] PUT /identity/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/f400b94d3fbc40bdace4860fe83a0891/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 20:46:25.866206 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a512ae-7e30-4d94-aa0d-51139fd1ac54 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:25.902638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610fb45-5fed-4185-adc6-79e3a0516103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:25.903890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610fb45-5fed-4185-adc6-79e3a0516103 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:25.904179 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610fb45-5fed-4185-adc6-79e3a0516103 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:25.904457 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610fb45-5fed-4185-adc6-79e3a0516103 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:25.905251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610fb45-5fed-4185-adc6-79e3a0516103 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:25.905585 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610fb45-5fed-4185-adc6-79e3a0516103 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:25.907109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610fb45-5fed-4185-adc6-79e3a0516103 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:25.919954 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 385/765] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:25.925983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ace40-c36e-4d57-871a-9bbbefc24d3d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:26.034667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ace40-c36e-4d57-871a-9bbbefc24d3d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:26.069678 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4a2a2-dcbc-44a4-9b8b-c6ee84bf776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:26.070370 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4a2a2-dcbc-44a4-9b8b-c6ee84bf776b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:26.070660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4a2a2-dcbc-44a4-9b8b-c6ee84bf776b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:26.070941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4a2a2-dcbc-44a4-9b8b-c6ee84bf776b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:26.071835 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4a2a2-dcbc-44a4-9b8b-c6ee84bf776b None admin] RBAC: Adding query filter params (role.id=b18c84f91b764bea92cc22c80a49bcaa, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=0c5f278013574823afa0ad70db22f866) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:26.072164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4a2a2-dcbc-44a4-9b8b-c6ee84bf776b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:26.073680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4a2a2-dcbc-44a4-9b8b-c6ee84bf776b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:26.080429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 381/766] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:25 2022] GET /identity/v3/role_assignments?user.id=0c5f278013574823afa0ad70db22f866&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=b18c84f91b764bea92cc22c80a49bcaa => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:26.736093 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab2616-84a1-449d-bb9f-9c09a14cac9d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:26.736641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab2616-84a1-449d-bb9f-9c09a14cac9d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:26.736641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab2616-84a1-449d-bb9f-9c09a14cac9d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:26.738298 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 386/767] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:26.743539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c60c9-4ba3-49e7-9ba4-635fb4651b80 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:26.744003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c60c9-4ba3-49e7-9ba4-635fb4651b80 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:26.744172 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c60c9-4ba3-49e7-9ba4-635fb4651b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:26.770498 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-036c60c9-4ba3-49e7-9ba4-635fb4651b80 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:26.771680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-036c60c9-4ba3-49e7-9ba4-635fb4651b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:26.861644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 382/768] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:26.896160 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab2616-84a1-449d-bb9f-9c09a14cac9d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:27.026696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab2616-84a1-449d-bb9f-9c09a14cac9d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:27.037384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587a947-98ee-4a3e-8b6c-15e080424b6c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:27.038133 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587a947-98ee-4a3e-8b6c-15e080424b6c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:27.038649 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587a947-98ee-4a3e-8b6c-15e080424b6c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:27.041692 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 383/769] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:27.046660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bde82-9219-4b3e-b833-c72647441124 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:27.046948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bde82-9219-4b3e-b833-c72647441124 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:27.047235 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bde82-9219-4b3e-b833-c72647441124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:27.070083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4092fde-a764-4f8d-a27d-a938946da025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:27.071158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4092fde-a764-4f8d-a27d-a938946da025 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:27.071626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4092fde-a764-4f8d-a27d-a938946da025 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:27.072049 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4092fde-a764-4f8d-a27d-a938946da025 None admin] PATH_INFO: `/v3/services/network` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:27.072909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4092fde-a764-4f8d-a27d-a938946da025 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:27.074485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4092fde-a764-4f8d-a27d-a938946da025 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:27.081553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-616bde82-9219-4b3e-b833-c72647441124 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:27.081553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-616bde82-9219-4b3e-b833-c72647441124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d4092fde-a764-4f8d-a27d-a938946da025 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:27.095853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:27.096880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:27.097759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:27.097759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:27.097759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:27.097759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:27.097759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:27.097759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:27.097759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:27.097759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:27.097759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:27.097759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:27.097759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:27.097759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:27.097759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 20:46:27.097759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:27.099523 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 387/770] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:26 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:27.103806 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4092fde-a764-4f8d-a27d-a938946da025 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:27.190149 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 384/771] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:27.229357 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bde82-9219-4b3e-b833-c72647441124 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:27.273339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4092fde-a764-4f8d-a27d-a938946da025 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:27.315408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681045fe-40e7-4b07-bac0-38339eeadf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:27.316079 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681045fe-40e7-4b07-bac0-38339eeadf0e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:27.316364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681045fe-40e7-4b07-bac0-38339eeadf0e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:27.316642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681045fe-40e7-4b07-bac0-38339eeadf0e None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:27.317350 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681045fe-40e7-4b07-bac0-38339eeadf0e None admin] RBAC: Adding query filter params (name=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:27.317687 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681045fe-40e7-4b07-bac0-38339eeadf0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:27.319100 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681045fe-40e7-4b07-bac0-38339eeadf0e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:27.329270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 388/772] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 11 20:46:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:27.338454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681045fe-40e7-4b07-bac0-38339eeadf0e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:27.411246 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bde82-9219-4b3e-b833-c72647441124 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:27.475959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681045fe-40e7-4b07-bac0-38339eeadf0e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:27.490250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcfe07-1a60-4b06-abfc-c6451f1dc366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:27.491920 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcfe07-1a60-4b06-abfc-c6451f1dc366 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:27.492724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcfe07-1a60-4b06-abfc-c6451f1dc366 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:27.493579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcfe07-1a60-4b06-abfc-c6451f1dc366 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:27.495152 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcfe07-1a60-4b06-abfc-c6451f1dc366 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:27.498385 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcfe07-1a60-4b06-abfc-c6451f1dc366 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:27.519936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7c48b-b80e-48a9-8cce-e3fdd80604e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:27.520608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7c48b-b80e-48a9-8cce-e3fdd80604e3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:27.520894 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7c48b-b80e-48a9-8cce-e3fdd80604e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:27.521173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7c48b-b80e-48a9-8cce-e3fdd80604e3 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:27.521909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7c48b-b80e-48a9-8cce-e3fdd80604e3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:27.522217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7c48b-b80e-48a9-8cce-e3fdd80604e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:27.523587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7c48b-b80e-48a9-8cce-e3fdd80604e3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d9fcfe07-1a60-4b06-abfc-c6451f1dc366 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:27.523874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:27.524788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 20:46:27.525704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:27.528596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 385/773] 10.222.0.35 () {56 vars in 1129 bytes} [Wed May 11 20:46:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:27.534481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcfe07-1a60-4b06-abfc-c6451f1dc366 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:27.540006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 389/774] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 11 20:46:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:27.545969 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7c48b-b80e-48a9-8cce-e3fdd80604e3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:27.649355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcfe07-1a60-4b06-abfc-c6451f1dc366 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:27.720352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7c48b-b80e-48a9-8cce-e3fdd80604e3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:27.746240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb7fc1-4dfc-4f8f-ad23-da601253e651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:27.746963 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb7fc1-4dfc-4f8f-ad23-da601253e651 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:27.749562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb7fc1-4dfc-4f8f-ad23-da601253e651 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:27.749562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb7fc1-4dfc-4f8f-ad23-da601253e651 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:27.749562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb7fc1-4dfc-4f8f-ad23-da601253e651 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:27.749562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb7fc1-4dfc-4f8f-ad23-da601253e651 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:27.749939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb7fc1-4dfc-4f8f-ad23-da601253e651 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:27.754089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13adc6b-d392-45b5-8861-a3afac5f752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:27.754743 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13adc6b-d392-45b5-8861-a3afac5f752b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:27.755022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13adc6b-d392-45b5-8861-a3afac5f752b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:27.755293 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13adc6b-d392-45b5-8861-a3afac5f752b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:27.756065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13adc6b-d392-45b5-8861-a3afac5f752b None admin] RBAC: Adding query filter params (interface=public, service_id=a678889bbb724b4ca674e09eee6fd35b, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:27.756373 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13adc6b-d392-45b5-8861-a3afac5f752b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:27.757739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13adc6b-d392-45b5-8861-a3afac5f752b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:27.767246 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 386/776] 10.222.0.35 () {56 vars in 1124 bytes} [Wed May 11 20:46:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:27.768457 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 390/776] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 11 20:46:27 2022] GET /identity/v3/endpoints?service_id=a678889bbb724b4ca674e09eee6fd35b&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:27.771170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb7fc1-4dfc-4f8f-ad23-da601253e651 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:27.774776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13adc6b-d392-45b5-8861-a3afac5f752b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:27.943740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb7fc1-4dfc-4f8f-ad23-da601253e651 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:27.944678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13adc6b-d392-45b5-8861-a3afac5f752b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:27.983399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98376e-8206-400d-bfef-a9933be22a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:27.984254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98376e-8206-400d-bfef-a9933be22a97 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:27.984547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98376e-8206-400d-bfef-a9933be22a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:27.984925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98376e-8206-400d-bfef-a9933be22a97 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:27.985366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b8333-7967-42fa-a4cf-b2edc3a2dd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:27.985624 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98376e-8206-400d-bfef-a9933be22a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:27.986061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8333-7967-42fa-a4cf-b2edc3a2dd55 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:27.986350 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8333-7967-42fa-a4cf-b2edc3a2dd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:27.986636 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8333-7967-42fa-a4cf-b2edc3a2dd55 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:27.987012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98376e-8206-400d-bfef-a9933be22a97 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:27.987347 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b8333-7967-42fa-a4cf-b2edc3a2dd55 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:27.987659 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b8333-7967-42fa-a4cf-b2edc3a2dd55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:27.989506 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b8333-7967-42fa-a4cf-b2edc3a2dd55 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:27.993611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 387/777] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 11 20:46:27 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:27.994929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a0979-dd8d-407d-b0e7-daec467c3a1e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:27.995224 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a0979-dd8d-407d-b0e7-daec467c3a1e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:27.995508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a0979-dd8d-407d-b0e7-daec467c3a1e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:28.003647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 391/779] 10.222.0.35 () {56 vars in 1124 bytes} [Wed May 11 20:46:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:28.004890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca47850-33f1-4eb1-9893-317507bf245b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:28.005142 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca47850-33f1-4eb1-9893-317507bf245b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:28.005426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca47850-33f1-4eb1-9893-317507bf245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:28.006851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 388/779] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:28.010963 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a0979-dd8d-407d-b0e7-daec467c3a1e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:28.040336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8ca47850-33f1-4eb1-9893-317507bf245b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:28.044490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8ca47850-33f1-4eb1-9893-317507bf245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:28.195194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 392/780] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:28.232137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca47850-33f1-4eb1-9893-317507bf245b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:28.344616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca47850-33f1-4eb1-9893-317507bf245b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:28.359187 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a0979-dd8d-407d-b0e7-daec467c3a1e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:28.379304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c53be-d9ad-4f24-a3cf-bcc98f267427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:28.380097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c53be-d9ad-4f24-a3cf-bcc98f267427 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:28.380381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c53be-d9ad-4f24-a3cf-bcc98f267427 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:28.380655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c53be-d9ad-4f24-a3cf-bcc98f267427 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:28.392103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c53be-d9ad-4f24-a3cf-bcc98f267427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-196c53be-d9ad-4f24-a3cf-bcc98f267427 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:28.400863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:28.401864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:28.403741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:28.403741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:28.403741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:28.403741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:28.403741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:28.403741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:28.403741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:28.403741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:28.403741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:28.403741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:28.403741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:46:28.403741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:28.403741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 393/781] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:46:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:28.410416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c53be-d9ad-4f24-a3cf-bcc98f267427 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:28.436081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc695f6-cdc5-4491-aae8-f063f229af78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:28.436833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc695f6-cdc5-4491-aae8-f063f229af78 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:28.437117 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc695f6-cdc5-4491-aae8-f063f229af78 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:28.437394 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc695f6-cdc5-4491-aae8-f063f229af78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:28.438242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc695f6-cdc5-4491-aae8-f063f229af78 None admin] RBAC: Adding query filter params (interface=public, service_id=6a27a4f846cf485b849647229c53490b, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:28.439637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc695f6-cdc5-4491-aae8-f063f229af78 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:28.441161 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc695f6-cdc5-4491-aae8-f063f229af78 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:28.454074 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 389/782] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 11 20:46:28 2022] GET /identity/v3/endpoints?service_id=6a27a4f846cf485b849647229c53490b&interface=public®ion_id=RegionOne => generated 194 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:28.460002 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc695f6-cdc5-4491-aae8-f063f229af78 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:28.577064 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc695f6-cdc5-4491-aae8-f063f229af78 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:28.616947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860504d5-7d3f-4332-b7ff-d4c8ddad6d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:28.622244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860504d5-7d3f-4332-b7ff-d4c8ddad6d34 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:28.622244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860504d5-7d3f-4332-b7ff-d4c8ddad6d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:28.622244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860504d5-7d3f-4332-b7ff-d4c8ddad6d34 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:28.622244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860504d5-7d3f-4332-b7ff-d4c8ddad6d34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:28.622244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860504d5-7d3f-4332-b7ff-d4c8ddad6d34 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:28.631570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 390/783] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 11 20:46:28 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:28.634628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c53be-d9ad-4f24-a3cf-bcc98f267427 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:28.687210 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15dfd33-38ae-44e6-b952-b8103100f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:28.688132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15dfd33-38ae-44e6-b952-b8103100f432 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:28.688563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15dfd33-38ae-44e6-b952-b8103100f432 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:28.689004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15dfd33-38ae-44e6-b952-b8103100f432 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:28.689990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15dfd33-38ae-44e6-b952-b8103100f432 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:28.691686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdb92-def9-4a65-9698-357e9d3478b1 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:28.692148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdb92-def9-4a65-9698-357e9d3478b1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:28.692562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdb92-def9-4a65-9698-357e9d3478b1 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:28.694150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 391/784] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:46:28.694767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15dfd33-38ae-44e6-b952-b8103100f432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:28.696453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15dfd33-38ae-44e6-b952-b8103100f432 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:28.699609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2648b-76b0-4f61-a5d8-209fae4d2a10 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:28.700774 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2648b-76b0-4f61-a5d8-209fae4d2a10 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:28.701198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2648b-76b0-4f61-a5d8-209fae4d2a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:28.725209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f6f2648b-76b0-4f61-a5d8-209fae4d2a10 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:28.727397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 394/785] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:46:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:28.728987 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f6f2648b-76b0-4f61-a5d8-209fae4d2a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:28.734406 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15dfd33-38ae-44e6-b952-b8103100f432 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:28.833669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 392/786] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:46:28.835313 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dbb70-2295-4a87-9515-d98426af5aea None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:28.835603 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dbb70-2295-4a87-9515-d98426af5aea None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:28.835883 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376dbb70-2295-4a87-9515-d98426af5aea None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:28.837643 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 393/787] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:28.846021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6875089-4b29-47c8-840c-da85a131059c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:28.846489 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6875089-4b29-47c8-840c-da85a131059c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:28.846906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6875089-4b29-47c8-840c-da85a131059c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:28.867105 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15dfd33-38ae-44e6-b952-b8103100f432 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:28.868148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e6875089-4b29-47c8-840c-da85a131059c None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:28.869520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e6875089-4b29-47c8-840c-da85a131059c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:28.903980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75552f3d-52e0-45c2-aa89-54b07c567f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:28.904787 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75552f3d-52e0-45c2-aa89-54b07c567f22 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:28.905075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75552f3d-52e0-45c2-aa89-54b07c567f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:28.905352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75552f3d-52e0-45c2-aa89-54b07c567f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:28.916847 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75552f3d-52e0-45c2-aa89-54b07c567f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:28.918381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75552f3d-52e0-45c2-aa89-54b07c567f22 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-75552f3d-52e0-45c2-aa89-54b07c567f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:28.936839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:28.937824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:28.943916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:28.943916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:28.943916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:28.943916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:28.943916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 395/788] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:28.943916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75552f3d-52e0-45c2-aa89-54b07c567f22 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:28.951291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 394/789] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:28.952386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6875089-4b29-47c8-840c-da85a131059c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:29.063386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6875089-4b29-47c8-840c-da85a131059c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:29.068763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75552f3d-52e0-45c2-aa89-54b07c567f22 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:29.097718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c933f-49e0-456a-ab6d-22e449b5b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:29.098717 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c933f-49e0-456a-ab6d-22e449b5b700 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:29.099215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c933f-49e0-456a-ab6d-22e449b5b700 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:29.099773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c933f-49e0-456a-ab6d-22e449b5b700 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:29.100882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c933f-49e0-456a-ab6d-22e449b5b700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:29.101463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c933f-49e0-456a-ab6d-22e449b5b700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:29.103065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c933f-49e0-456a-ab6d-22e449b5b700 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:29.107938 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929a5fe-4050-4bf1-8bf1-969127ee0fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:29.108736 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929a5fe-4050-4bf1-8bf1-969127ee0fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:29.109019 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929a5fe-4050-4bf1-8bf1-969127ee0fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:29.109292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929a5fe-4050-4bf1-8bf1-969127ee0fb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:29.121770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 395/790] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:29.121916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929a5fe-4050-4bf1-8bf1-969127ee0fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:29.123053 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c933f-49e0-456a-ab6d-22e449b5b700 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8929a5fe-4050-4bf1-8bf1-969127ee0fb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:29.130235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:29.131190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:29.132625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:29.132625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:29.132625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:29.132625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:29.132625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:29.132625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:29.132625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:29.132625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:29.132625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:29.132625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:29.132625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:46:29.132625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:29.132625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 396/791] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:46:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:29.133367 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929a5fe-4050-4bf1-8bf1-969127ee0fb1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:29.226814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c933f-49e0-456a-ab6d-22e449b5b700 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:29.235952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929a5fe-4050-4bf1-8bf1-969127ee0fb1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:29.260508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3e0aa-5930-48d9-9a9f-bbc48bbe8b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:29.261310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3e0aa-5930-48d9-9a9f-bbc48bbe8b3c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:29.261620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3e0aa-5930-48d9-9a9f-bbc48bbe8b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:29.261900 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3e0aa-5930-48d9-9a9f-bbc48bbe8b3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:29.271096 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101ee0c-0147-4744-80f7-e139e0c90175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:29.271893 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ee0c-0147-4744-80f7-e139e0c90175 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:29.272184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ee0c-0147-4744-80f7-e139e0c90175 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:29.272465 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ee0c-0147-4744-80f7-e139e0c90175 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:29.272740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3e0aa-5930-48d9-9a9f-bbc48bbe8b3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:29.281092 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101ee0c-0147-4744-80f7-e139e0c90175 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-85c3e0aa-5930-48d9-9a9f-bbc48bbe8b3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:29.281229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:29.282138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:29.283506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:29.283506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:29.283506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:29.283506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:29.283506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:29.283506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:29.283506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:29.283506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:29.283506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:29.283506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:29.283506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:29.283506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:29.284498 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101ee0c-0147-4744-80f7-e139e0c90175 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:29.284580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 396/792] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:29.284580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3e0aa-5930-48d9-9a9f-bbc48bbe8b3c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9101ee0c-0147-4744-80f7-e139e0c90175 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:29.302705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:29.305022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:29.307474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:29.307474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:29.307474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:29.307474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:29.307474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:29.307474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:29.307474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:29.307474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:29.307474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 20:46:29.307474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:29.307474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 397/793] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:46:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:29.307474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101ee0c-0147-4744-80f7-e139e0c90175 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:29.390670 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3e0aa-5930-48d9-9a9f-bbc48bbe8b3c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:29.413252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101ee0c-0147-4744-80f7-e139e0c90175 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:29.433010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc99f0-7427-463f-a5a0-2678912f0f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:29.433870 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc99f0-7427-463f-a5a0-2678912f0f29 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:29.434473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc99f0-7427-463f-a5a0-2678912f0f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:29.434758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc99f0-7427-463f-a5a0-2678912f0f29 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:29.435516 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc99f0-7427-463f-a5a0-2678912f0f29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:29.435826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc99f0-7427-463f-a5a0-2678912f0f29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:29.437643 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc99f0-7427-463f-a5a0-2678912f0f29 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:29.448669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 397/794] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:46:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:29.449521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc99f0-7427-463f-a5a0-2678912f0f29 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:29.452736 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2984c8-032e-45ea-8a4d-738fb62870cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:29.454436 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2984c8-032e-45ea-8a4d-738fb62870cc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:29.454800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2984c8-032e-45ea-8a4d-738fb62870cc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:29.455150 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2984c8-032e-45ea-8a4d-738fb62870cc None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:29.456009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2984c8-032e-45ea-8a4d-738fb62870cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:29.456385 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2984c8-032e-45ea-8a4d-738fb62870cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:29.457861 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2984c8-032e-45ea-8a4d-738fb62870cc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:29.473676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 398/795] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:46:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:29.475307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2984c8-032e-45ea-8a4d-738fb62870cc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:29.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc99f0-7427-463f-a5a0-2678912f0f29 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:29.604132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2984c8-032e-45ea-8a4d-738fb62870cc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:29.621393 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27014e-e611-4e2f-a8fb-8541849cd148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:29.622407 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27014e-e611-4e2f-a8fb-8541849cd148 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:29.622698 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27014e-e611-4e2f-a8fb-8541849cd148 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:29.622977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27014e-e611-4e2f-a8fb-8541849cd148 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:29.623811 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27014e-e611-4e2f-a8fb-8541849cd148 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:29.624121 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27014e-e611-4e2f-a8fb-8541849cd148 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:29.626041 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27014e-e611-4e2f-a8fb-8541849cd148 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:29.645011 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d74740-5aa0-41ca-a759-00ff388b1bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:29.646160 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d74740-5aa0-41ca-a759-00ff388b1bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:29.646654 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d74740-5aa0-41ca-a759-00ff388b1bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:29.646904 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 398/796] 10.222.0.35 () {56 vars in 1135 bytes} [Wed May 11 20:46:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:29.647469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d74740-5aa0-41ca-a759-00ff388b1bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:29.647779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27014e-e611-4e2f-a8fb-8541849cd148 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:29.661667 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d74740-5aa0-41ca-a759-00ff388b1bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:29.663817 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d74740-5aa0-41ca-a759-00ff388b1bb1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-56d74740-5aa0-41ca-a759-00ff388b1bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:29.686620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:29.687533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:29.688442 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:29.688442 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:29.688442 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:29.688442 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:29.696818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 399/797] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:29.696818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d74740-5aa0-41ca-a759-00ff388b1bb1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:29.761269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27014e-e611-4e2f-a8fb-8541849cd148 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:29.795943 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec4e0c-ad4e-432d-a2d7-cef9bc48d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:29.796743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec4e0c-ad4e-432d-a2d7-cef9bc48d8eb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:29.797079 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec4e0c-ad4e-432d-a2d7-cef9bc48d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:29.797360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec4e0c-ad4e-432d-a2d7-cef9bc48d8eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:29.807444 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec4e0c-ad4e-432d-a2d7-cef9bc48d8eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:29.808896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec4e0c-ad4e-432d-a2d7-cef9bc48d8eb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:29.820999 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d74740-5aa0-41ca-a759-00ff388b1bb1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a5ec4e0c-ad4e-432d-a2d7-cef9bc48d8eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:29.827210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:29.828214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:29.829145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:29.829145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:29.829145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:29.829145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:29.833543 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 399/798] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:29.834201 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec4e0c-ad4e-432d-a2d7-cef9bc48d8eb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:29.866568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f03d3-8235-4af0-b020-167206364a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:29.867972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f03d3-8235-4af0-b020-167206364a1a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:29.869239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f03d3-8235-4af0-b020-167206364a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:29.869984 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f03d3-8235-4af0-b020-167206364a1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:29.883838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f03d3-8235-4af0-b020-167206364a1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:29.885767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f03d3-8235-4af0-b020-167206364a1a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-031f03d3-8235-4af0-b020-167206364a1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:29.909937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:29.911072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:29.912271 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:29.912271 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:29.912271 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:29.912271 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:29.914190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 400/799] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:29.915190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f03d3-8235-4af0-b020-167206364a1a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:29.942425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec4e0c-ad4e-432d-a2d7-cef9bc48d8eb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:29.977867 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79954884-c92c-4dcb-90b6-2f727ab8fcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:29.978797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79954884-c92c-4dcb-90b6-2f727ab8fcde None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:29.979186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79954884-c92c-4dcb-90b6-2f727ab8fcde None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:29.979565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79954884-c92c-4dcb-90b6-2f727ab8fcde None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:29.980389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79954884-c92c-4dcb-90b6-2f727ab8fcde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:29.980800 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79954884-c92c-4dcb-90b6-2f727ab8fcde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:29.982856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79954884-c92c-4dcb-90b6-2f727ab8fcde None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:29.999290 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 400/800] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:29.999290 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79954884-c92c-4dcb-90b6-2f727ab8fcde None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:30.049878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f03d3-8235-4af0-b020-167206364a1a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:30.095830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92310ade-d2a4-4ffd-90f9-d73e731d7e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:30.096782 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92310ade-d2a4-4ffd-90f9-d73e731d7e55 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:30.097375 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92310ade-d2a4-4ffd-90f9-d73e731d7e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:30.098146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92310ade-d2a4-4ffd-90f9-d73e731d7e55 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:30.099330 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92310ade-d2a4-4ffd-90f9-d73e731d7e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:30.099932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92310ade-d2a4-4ffd-90f9-d73e731d7e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:30.101068 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79954884-c92c-4dcb-90b6-2f727ab8fcde None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:30.101737 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92310ade-d2a4-4ffd-90f9-d73e731d7e55 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:30.117791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 401/801] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:30.118796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92310ade-d2a4-4ffd-90f9-d73e731d7e55 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:30.140913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e5621-6f9c-49c9-b94e-710e9a9be848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:30.141756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5621-6f9c-49c9-b94e-710e9a9be848 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:30.142138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5621-6f9c-49c9-b94e-710e9a9be848 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:30.142512 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5621-6f9c-49c9-b94e-710e9a9be848 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:30.143390 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e5621-6f9c-49c9-b94e-710e9a9be848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:30.143798 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e5621-6f9c-49c9-b94e-710e9a9be848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:30.145621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e5621-6f9c-49c9-b94e-710e9a9be848 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:30.157925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 401/802] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:30.158996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e5621-6f9c-49c9-b94e-710e9a9be848 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:30.239024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92310ade-d2a4-4ffd-90f9-d73e731d7e55 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:30.260312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e5621-6f9c-49c9-b94e-710e9a9be848 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:30.277418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cdcfa-d8c5-43a2-97e5-ab39d60d4510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:30.278653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cdcfa-d8c5-43a2-97e5-ab39d60d4510 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:30.279090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cdcfa-d8c5-43a2-97e5-ab39d60d4510 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:30.279515 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cdcfa-d8c5-43a2-97e5-ab39d60d4510 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:30.287586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cdcfa-d8c5-43a2-97e5-ab39d60d4510 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:30.289365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cdcfa-d8c5-43a2-97e5-ab39d60d4510 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:30.298123 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94206e4-18a1-4505-9a66-02ebf19aeab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:30.298939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94206e4-18a1-4505-9a66-02ebf19aeab0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:30.299224 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94206e4-18a1-4505-9a66-02ebf19aeab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:30.299500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94206e4-18a1-4505-9a66-02ebf19aeab0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c13cdcfa-d8c5-43a2-97e5-ab39d60d4510 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:30.306705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:30.307705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:30.308669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:30.308669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:30.308669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:30.308669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:30.308669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:30.308669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:30.308669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:30.308669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:30.308669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 20:46:30.308669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:30.309299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94206e4-18a1-4505-9a66-02ebf19aeab0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:30.309299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94206e4-18a1-4505-9a66-02ebf19aeab0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:30.315403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 402/803] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 11 20:46:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:30.316431 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cdcfa-d8c5-43a2-97e5-ab39d60d4510 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c94206e4-18a1-4505-9a66-02ebf19aeab0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:30.325859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:30.326895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:30.327893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:30.327893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:30.327893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:30.327893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:30.327893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:30.327893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:30.327893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:30.327893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:30.327893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 20:46:30.327893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:30.332337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 402/804] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 11 20:46:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:30.333278 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94206e4-18a1-4505-9a66-02ebf19aeab0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:30.420779 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cdcfa-d8c5-43a2-97e5-ab39d60d4510 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:30.434392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94206e4-18a1-4505-9a66-02ebf19aeab0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:30.455833 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147acf37-c780-45c0-90d9-095535eb5417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:30.456629 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147acf37-c780-45c0-90d9-095535eb5417 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:30.456916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147acf37-c780-45c0-90d9-095535eb5417 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:30.457196 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147acf37-c780-45c0-90d9-095535eb5417 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:30.463854 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147acf37-c780-45c0-90d9-095535eb5417 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:30.465401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147acf37-c780-45c0-90d9-095535eb5417 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:30.468812 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516b61e-7d99-42ac-8e94-107577f79cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:30.469486 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516b61e-7d99-42ac-8e94-107577f79cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:30.469804 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516b61e-7d99-42ac-8e94-107577f79cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:30.470082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516b61e-7d99-42ac-8e94-107577f79cc6 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:30.470935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516b61e-7d99-42ac-8e94-107577f79cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:30.471252 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516b61e-7d99-42ac-8e94-107577f79cc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:30.472670 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516b61e-7d99-42ac-8e94-107577f79cc6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-147acf37-c780-45c0-90d9-095535eb5417 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:30.479028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:30.479909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:30.481453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:30.481453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:30.481453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:30.481453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:30.481453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:30.481453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:30.481453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:30.481453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:30.481453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 403/805] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:30.482485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147acf37-c780-45c0-90d9-095535eb5417 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:30.501396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 403/806] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 11 20:46:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:30.501396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1908-0850-4a9e-b148-2601a2012aa7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:30.501396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1908-0850-4a9e-b148-2601a2012aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:30.501396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1908-0850-4a9e-b148-2601a2012aa7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:30.501396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 404/807] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:30.501396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc1908-0850-4a9e-b148-2601a2012aa7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:30.585036 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147acf37-c780-45c0-90d9-095535eb5417 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:30.604028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc1908-0850-4a9e-b148-2601a2012aa7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:30.619187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f628ade-24a2-406b-bf73-3e3d42dd30ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:30.619858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f628ade-24a2-406b-bf73-3e3d42dd30ec None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:30.620139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f628ade-24a2-406b-bf73-3e3d42dd30ec None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:30.620448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f628ade-24a2-406b-bf73-3e3d42dd30ec None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:30.621277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f628ade-24a2-406b-bf73-3e3d42dd30ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:30.621648 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f628ade-24a2-406b-bf73-3e3d42dd30ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:30.623078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f628ade-24a2-406b-bf73-3e3d42dd30ec None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:30.638048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504092b-2ad3-48fd-8b4f-0916750ad837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:30.638797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504092b-2ad3-48fd-8b4f-0916750ad837 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:30.639156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504092b-2ad3-48fd-8b4f-0916750ad837 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:30.639503 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504092b-2ad3-48fd-8b4f-0916750ad837 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:30.644542 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 404/808] 10.222.0.35 () {56 vars in 1149 bytes} [Wed May 11 20:46:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:30.644689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504092b-2ad3-48fd-8b4f-0916750ad837 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:30.644689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504092b-2ad3-48fd-8b4f-0916750ad837 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:30.644847 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f628ade-24a2-406b-bf73-3e3d42dd30ec None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:30.644943 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504092b-2ad3-48fd-8b4f-0916750ad837 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:30.660682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 405/809] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:30.660682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399621ce-fe0c-4594-87e9-69b890d42ab6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:30.660682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399621ce-fe0c-4594-87e9-69b890d42ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:30.660682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399621ce-fe0c-4594-87e9-69b890d42ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:30.676374 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-399621ce-fe0c-4594-87e9-69b890d42ab6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:30.677578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-399621ce-fe0c-4594-87e9-69b890d42ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:30.741828 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 406/810] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:30.742745 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399621ce-fe0c-4594-87e9-69b890d42ab6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:30.758663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f628ade-24a2-406b-bf73-3e3d42dd30ec None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:30.794659 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eb3d4-53ef-4ef9-92f3-5ed21bdb49b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:30.795488 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eb3d4-53ef-4ef9-92f3-5ed21bdb49b7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:30.795774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eb3d4-53ef-4ef9-92f3-5ed21bdb49b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:30.796052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5eb3d4-53ef-4ef9-92f3-5ed21bdb49b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:30.847781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399621ce-fe0c-4594-87e9-69b890d42ab6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:30.872464 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5eb3d4-53ef-4ef9-92f3-5ed21bdb49b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:30.873942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5eb3d4-53ef-4ef9-92f3-5ed21bdb49b7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:30.881425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3188d-6f12-48f1-a409-a6da9c5a05c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:30.882254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3188d-6f12-48f1-a409-a6da9c5a05c3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:30.882539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3188d-6f12-48f1-a409-a6da9c5a05c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:30.882813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3188d-6f12-48f1-a409-a6da9c5a05c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:30.893379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3188d-6f12-48f1-a409-a6da9c5a05c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:30.895112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3188d-6f12-48f1-a409-a6da9c5a05c3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d4d3188d-6f12-48f1-a409-a6da9c5a05c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:30.912078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:30.912999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:30.913952 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:30.913952 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:30.913952 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:30.913952 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:30.913952 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 407/811] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:30.914837 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3188d-6f12-48f1-a409-a6da9c5a05c3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:30.972505 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 405/812] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:46:30.973765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eb3d4-53ef-4ef9-92f3-5ed21bdb49b7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:31.016798 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3188d-6f12-48f1-a409-a6da9c5a05c3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:31.052502 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7bc22-69f7-4f56-a42f-8dd75ddc035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:31.053391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7bc22-69f7-4f56-a42f-8dd75ddc035e None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:31.053706 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7bc22-69f7-4f56-a42f-8dd75ddc035e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:31.053990 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7bc22-69f7-4f56-a42f-8dd75ddc035e None admin] PATH_INFO: `/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/85cb784bf9984abc9977c665a6db1656/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:31.056003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7bc22-69f7-4f56-a42f-8dd75ddc035e None admin] RBAC: Authorizing `identity:create_grant(project_id=7c03e5fec995436aa5424d2be2e268aa, user_id=85cb784bf9984abc9977c665a6db1656, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:31.057436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7bc22-69f7-4f56-a42f-8dd75ddc035e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:31.066753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5eb3d4-53ef-4ef9-92f3-5ed21bdb49b7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:31.098832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949146-6197-4089-bfc9-306c2459ca21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:31.099601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949146-6197-4089-bfc9-306c2459ca21 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:31.099877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949146-6197-4089-bfc9-306c2459ca21 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:31.100149 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949146-6197-4089-bfc9-306c2459ca21 None admin] PATH_INFO: `/v3/services/network` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:31.100786 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be949146-6197-4089-bfc9-306c2459ca21 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:31.102152 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be949146-6197-4089-bfc9-306c2459ca21 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-be949146-6197-4089-bfc9-306c2459ca21 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:31.113230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:31.114459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:31.115358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 406/813] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:30 2022] GET /identity/v3/services/network => generated 88 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:31.116224 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949146-6197-4089-bfc9-306c2459ca21 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:31.130333 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 408/814] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:46:30 2022] PUT /identity/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/85cb784bf9984abc9977c665a6db1656/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:46:31.131149 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7bc22-69f7-4f56-a42f-8dd75ddc035e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:31.223270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949146-6197-4089-bfc9-306c2459ca21 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:31.234813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7bc22-69f7-4f56-a42f-8dd75ddc035e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:31.258962 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3951595-3894-4b4d-a6c9-caf65a9e13a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:31.259778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951595-3894-4b4d-a6c9-caf65a9e13a3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:31.260071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951595-3894-4b4d-a6c9-caf65a9e13a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:31.260351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3951595-3894-4b4d-a6c9-caf65a9e13a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:31.261087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3951595-3894-4b4d-a6c9-caf65a9e13a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:31.261402 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3951595-3894-4b4d-a6c9-caf65a9e13a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:31.262900 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3951595-3894-4b4d-a6c9-caf65a9e13a3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:31.271615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f4ae2-e326-4efe-8a67-85edb0dc6506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:31.272396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f4ae2-e326-4efe-8a67-85edb0dc6506 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:31.272683 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f4ae2-e326-4efe-8a67-85edb0dc6506 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:31.272955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f4ae2-e326-4efe-8a67-85edb0dc6506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:31.282024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 407/815] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:31.282024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcedc6-f697-448c-9805-c60d350a455b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:31.282024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcedc6-f697-448c-9805-c60d350a455b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:31.282024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcedc6-f697-448c-9805-c60d350a455b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:31.282024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 408/816] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:31.282024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcedc6-f697-448c-9805-c60d350a455b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:31.289516 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f4ae2-e326-4efe-8a67-85edb0dc6506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:31.291053 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f4ae2-e326-4efe-8a67-85edb0dc6506 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c88f4ae2-e326-4efe-8a67-85edb0dc6506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:31.311563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:31.312540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:31.313500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:31.313500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:31.313500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:31.313500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:31.313500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 409/817] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:31.317875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f4ae2-e326-4efe-8a67-85edb0dc6506 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:31.386297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcedc6-f697-448c-9805-c60d350a455b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:31.416480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f4ae2-e326-4efe-8a67-85edb0dc6506 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:31.421554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c0a24-52bb-4eb0-baaa-c43c80be9bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:31.422234 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c0a24-52bb-4eb0-baaa-c43c80be9bde None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:31.422513 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c0a24-52bb-4eb0-baaa-c43c80be9bde None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:31.422783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c0a24-52bb-4eb0-baaa-c43c80be9bde None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:31.423482 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c0a24-52bb-4eb0-baaa-c43c80be9bde None admin] RBAC: Adding query filter params (name=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:31.423842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c0a24-52bb-4eb0-baaa-c43c80be9bde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:31.425681 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c0a24-52bb-4eb0-baaa-c43c80be9bde None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:31.432426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 409/818] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 11 20:46:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:31.433838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec29682-a4e4-464f-ab4f-b8117cf12a35 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:31.434242 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec29682-a4e4-464f-ab4f-b8117cf12a35 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:31.434590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec29682-a4e4-464f-ab4f-b8117cf12a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:31.450483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9ec29682-a4e4-464f-ab4f-b8117cf12a35 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:31.451642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9ec29682-a4e4-464f-ab4f-b8117cf12a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:31.454656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e0a56-9d8b-4b8c-a93d-261a69e3f317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:31.455437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e0a56-9d8b-4b8c-a93d-261a69e3f317 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:31.455719 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e0a56-9d8b-4b8c-a93d-261a69e3f317 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:31.455993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e0a56-9d8b-4b8c-a93d-261a69e3f317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:31.462642 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e0a56-9d8b-4b8c-a93d-261a69e3f317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:31.464077 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e0a56-9d8b-4b8c-a93d-261a69e3f317 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-030e0a56-9d8b-4b8c-a93d-261a69e3f317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:31.478339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:31.479255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:31.480151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:31.480151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:31.480151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:31.480151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:31.480151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:31.480151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:31.480151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:31.480151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:31.480151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 410/819] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:31.480636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e0a56-9d8b-4b8c-a93d-261a69e3f317 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:31.529645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 410/820] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:31.529645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec29682-a4e4-464f-ab4f-b8117cf12a35 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:31.587035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e0a56-9d8b-4b8c-a93d-261a69e3f317 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:31.619721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bed63-0679-4fe6-bd8b-bc01d739f402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:31.620463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bed63-0679-4fe6-bd8b-bc01d739f402 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:31.620759 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bed63-0679-4fe6-bd8b-bc01d739f402 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:31.621032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bed63-0679-4fe6-bd8b-bc01d739f402 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:31.622309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bed63-0679-4fe6-bd8b-bc01d739f402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:31.622619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bed63-0679-4fe6-bd8b-bc01d739f402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:31.623989 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bed63-0679-4fe6-bd8b-bc01d739f402 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:31.628355 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec29682-a4e4-464f-ab4f-b8117cf12a35 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:31.638988 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 411/821] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:31.640125 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bed63-0679-4fe6-bd8b-bc01d739f402 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:31.663662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536b98d-f6bb-4f9b-be10-55634a35e840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:31.664334 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536b98d-f6bb-4f9b-be10-55634a35e840 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:31.664626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536b98d-f6bb-4f9b-be10-55634a35e840 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:31.664905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536b98d-f6bb-4f9b-be10-55634a35e840 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:31.665649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536b98d-f6bb-4f9b-be10-55634a35e840 None admin] RBAC: Adding query filter params (type=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:31.665966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536b98d-f6bb-4f9b-be10-55634a35e840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:31.667404 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536b98d-f6bb-4f9b-be10-55634a35e840 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:31.676800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 411/822] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 11 20:46:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:31.676800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536b98d-f6bb-4f9b-be10-55634a35e840 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:31.740936 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bed63-0679-4fe6-bd8b-bc01d739f402 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:31.770480 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536b98d-f6bb-4f9b-be10-55634a35e840 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:31.773662 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6c129-7222-432b-98da-7807b5eed145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:31.774324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6c129-7222-432b-98da-7807b5eed145 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:31.774607 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6c129-7222-432b-98da-7807b5eed145 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:31.774881 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6c129-7222-432b-98da-7807b5eed145 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:31.775661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6c129-7222-432b-98da-7807b5eed145 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:31.775968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6c129-7222-432b-98da-7807b5eed145 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:31.777398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6c129-7222-432b-98da-7807b5eed145 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:31.788918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 412/823] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:31.789999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6c129-7222-432b-98da-7807b5eed145 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:31.804309 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfaf84-2ad0-4fb4-a907-738b1fa0680d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:31.805123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfaf84-2ad0-4fb4-a907-738b1fa0680d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:31.805414 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfaf84-2ad0-4fb4-a907-738b1fa0680d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:31.805725 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfaf84-2ad0-4fb4-a907-738b1fa0680d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:31.806381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfaf84-2ad0-4fb4-a907-738b1fa0680d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:31.807754 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfaf84-2ad0-4fb4-a907-738b1fa0680d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-44cfaf84-2ad0-4fb4-a907-738b1fa0680d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:31.820543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:31.821801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:31.823454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 412/824] 10.222.0.35 () {56 vars in 1129 bytes} [Wed May 11 20:46:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:31.824345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfaf84-2ad0-4fb4-a907-738b1fa0680d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:31.901353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6c129-7222-432b-98da-7807b5eed145 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:31.921576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfaf84-2ad0-4fb4-a907-738b1fa0680d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:31.935063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284da02e-8a31-409f-a23c-73605257d013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:31.935860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284da02e-8a31-409f-a23c-73605257d013 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:31.936142 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284da02e-8a31-409f-a23c-73605257d013 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:31.936415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284da02e-8a31-409f-a23c-73605257d013 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:31.942965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284da02e-8a31-409f-a23c-73605257d013 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:31.944472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284da02e-8a31-409f-a23c-73605257d013 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:31.954375 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1def60a-0552-4df7-aed5-1e194ffc8ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:31.955032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def60a-0552-4df7-aed5-1e194ffc8ac5 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:31.955317 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def60a-0552-4df7-aed5-1e194ffc8ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:31.955594 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1def60a-0552-4df7-aed5-1e194ffc8ac5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:31.956323 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1def60a-0552-4df7-aed5-1e194ffc8ac5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:31.957703 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1def60a-0552-4df7-aed5-1e194ffc8ac5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-284da02e-8a31-409f-a23c-73605257d013 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:31.959230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:31.960098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:31.965944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:31.965944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:31.965944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:31.965944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:31.965944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:31.965944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:31.965944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:31.965944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:31.965944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 413/825] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:31.965944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284da02e-8a31-409f-a23c-73605257d013 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:32.039154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 413/826] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 11 20:46:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:46:32.040179 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1def60a-0552-4df7-aed5-1e194ffc8ac5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:32.076976 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284da02e-8a31-409f-a23c-73605257d013 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:32.131054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bd7f2-3c32-4cc7-bf33-4845a409359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:32.132260 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bd7f2-3c32-4cc7-bf33-4845a409359d None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:32.132554 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bd7f2-3c32-4cc7-bf33-4845a409359d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:32.132837 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bd7f2-3c32-4cc7-bf33-4845a409359d None admin] PATH_INFO: `/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/0c5f278013574823afa0ad70db22f866/roles/b18c84f91b764bea92cc22c80a49bcaa` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:32.150663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1def60a-0552-4df7-aed5-1e194ffc8ac5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:32.152085 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bd7f2-3c32-4cc7-bf33-4845a409359d None admin] RBAC: Authorizing `identity:create_grant(project_id=7c03e5fec995436aa5424d2be2e268aa, user_id=0c5f278013574823afa0ad70db22f866, role_id=b18c84f91b764bea92cc22c80a49bcaa)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:32.155259 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bd7f2-3c32-4cc7-bf33-4845a409359d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:32.188967 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbca21-82f8-45d9-9b75-602aba698270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:32.190226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbca21-82f8-45d9-9b75-602aba698270 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:32.190718 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbca21-82f8-45d9-9b75-602aba698270 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:32.191144 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbca21-82f8-45d9-9b75-602aba698270 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:32.192098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbca21-82f8-45d9-9b75-602aba698270 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:32.192606 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbca21-82f8-45d9-9b75-602aba698270 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:32.194373 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbca21-82f8-45d9-9b75-602aba698270 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:32.200575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 414/827] 10.222.0.35 () {56 vars in 1124 bytes} [Wed May 11 20:46:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:32.201763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbca21-82f8-45d9-9b75-602aba698270 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:32.226749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 414/828] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:46:31 2022] PUT /identity/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/0c5f278013574823afa0ad70db22f866/roles/b18c84f91b764bea92cc22c80a49bcaa => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:46:32.228436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bd7f2-3c32-4cc7-bf33-4845a409359d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:32.339354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbca21-82f8-45d9-9b75-602aba698270 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:32.354738 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bd7f2-3c32-4cc7-bf33-4845a409359d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:32.383809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2427f0-0829-4e01-9f05-2a8e2d79c4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:32.384775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2427f0-0829-4e01-9f05-2a8e2d79c4fe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:32.385061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2427f0-0829-4e01-9f05-2a8e2d79c4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:32.385339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2427f0-0829-4e01-9f05-2a8e2d79c4fe None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:32.386669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2427f0-0829-4e01-9f05-2a8e2d79c4fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:32.387028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2427f0-0829-4e01-9f05-2a8e2d79c4fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:32.389316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2427f0-0829-4e01-9f05-2a8e2d79c4fe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:32.393046 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fbcff-bf32-4082-8b67-9043cb8d7e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:32.393760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fbcff-bf32-4082-8b67-9043cb8d7e34 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:32.394294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fbcff-bf32-4082-8b67-9043cb8d7e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:32.394859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fbcff-bf32-4082-8b67-9043cb8d7e34 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:32.395587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fbcff-bf32-4082-8b67-9043cb8d7e34 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:32.395944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fbcff-bf32-4082-8b67-9043cb8d7e34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:32.398612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fbcff-bf32-4082-8b67-9043cb8d7e34 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:32.405326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 415/829] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:32.411987 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 415/830] 10.222.0.35 () {56 vars in 1124 bytes} [Wed May 11 20:46:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:32.413122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2427f0-0829-4e01-9f05-2a8e2d79c4fe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:32.417806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fbcff-bf32-4082-8b67-9043cb8d7e34 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:32.523791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fbcff-bf32-4082-8b67-9043cb8d7e34 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:32.541988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2427f0-0829-4e01-9f05-2a8e2d79c4fe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:32.556416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46fde6-9a06-4dfc-823b-5f036df71c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:32.557210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46fde6-9a06-4dfc-823b-5f036df71c0a None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:32.557587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46fde6-9a06-4dfc-823b-5f036df71c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:32.557975 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46fde6-9a06-4dfc-823b-5f036df71c0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:32.558779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46fde6-9a06-4dfc-823b-5f036df71c0a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:32.560240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46fde6-9a06-4dfc-823b-5f036df71c0a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:32.581482 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086b339-4de5-4111-bd6c-474ea8eaf995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:32.585074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086b339-4de5-4111-bd6c-474ea8eaf995 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:32.585074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086b339-4de5-4111-bd6c-474ea8eaf995 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:32.585074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086b339-4de5-4111-bd6c-474ea8eaf995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:32.585074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086b339-4de5-4111-bd6c-474ea8eaf995 None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=f400b94d3fbc40bdace4860fe83a0891) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:32.585074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086b339-4de5-4111-bd6c-474ea8eaf995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:32.585953 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086b339-4de5-4111-bd6c-474ea8eaf995 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:32.597622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 416/831] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:32 2022] GET /identity/v3/role_assignments?user.id=f400b94d3fbc40bdace4860fe83a0891&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:32.634514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 416/832] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 11 20:46:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 20:46:33.405753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c99c-4e12-4df0-8836-7563b77b9fd3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:33.406280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c99c-4e12-4df0-8836-7563b77b9fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:33.406357 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8c99c-4e12-4df0-8836-7563b77b9fd3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:33.407900 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 417/833] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:33.413400 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf7599-bd0f-40e3-bf03-5d7e3949b7de None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:33.413875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf7599-bd0f-40e3-bf03-5d7e3949b7de None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:33.414070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf7599-bd0f-40e3-bf03-5d7e3949b7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:33.432693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-20bf7599-bd0f-40e3-bf03-5d7e3949b7de None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:33.434524 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-20bf7599-bd0f-40e3-bf03-5d7e3949b7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:33.508030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 417/834] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:33.531370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8c99c-4e12-4df0-8836-7563b77b9fd3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:33.631990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8c99c-4e12-4df0-8836-7563b77b9fd3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:33.665859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e30d3-1fe9-4512-bf04-b941af1ebec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:33.666581 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e30d3-1fe9-4512-bf04-b941af1ebec8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:33.666866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e30d3-1fe9-4512-bf04-b941af1ebec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:33.667138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e30d3-1fe9-4512-bf04-b941af1ebec8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:33.677751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e30d3-1fe9-4512-bf04-b941af1ebec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f08e30d3-1fe9-4512-bf04-b941af1ebec8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:33.685780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:33.686739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:33.687582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:33.687582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:33.687582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:33.687582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:33.687582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:33.687582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:33.687582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:33.687582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:33.687582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:33.687582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:33.687582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:46:33.687582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:33.688677 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 418/835] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:46:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:33.695024 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf7599-bd0f-40e3-bf03-5d7e3949b7de None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:33.791862 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf7599-bd0f-40e3-bf03-5d7e3949b7de None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:33.835354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f71b7-f640-4ea8-86ce-4e10515543d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:33.836035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f71b7-f640-4ea8-86ce-4e10515543d9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:33.836319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f71b7-f640-4ea8-86ce-4e10515543d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:33.836592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f71b7-f640-4ea8-86ce-4e10515543d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:33.837334 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f71b7-f640-4ea8-86ce-4e10515543d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:33.840826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f71b7-f640-4ea8-86ce-4e10515543d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:33.840826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f71b7-f640-4ea8-86ce-4e10515543d9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:33.848873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 418/836] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:46:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:33.854753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e30d3-1fe9-4512-bf04-b941af1ebec8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:33.958533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e30d3-1fe9-4512-bf04-b941af1ebec8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:33.993505 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472e639-c6c8-4b7a-9794-d47d6ae07821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:33.994322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e639-c6c8-4b7a-9794-d47d6ae07821 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:33.994610 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e639-c6c8-4b7a-9794-d47d6ae07821 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:33.994885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e639-c6c8-4b7a-9794-d47d6ae07821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:34.005733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472e639-c6c8-4b7a-9794-d47d6ae07821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:34.007184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472e639-c6c8-4b7a-9794-d47d6ae07821 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7472e639-c6c8-4b7a-9794-d47d6ae07821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:34.025033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:34.026017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:34.026918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:34.026918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:34.026918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:34.026918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:34.026918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 419/837] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:34.032695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f71b7-f640-4ea8-86ce-4e10515543d9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:34.132036 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f71b7-f640-4ea8-86ce-4e10515543d9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:34.165017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205f307-f04c-4acd-bc10-06ac0667453a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:34.165708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f307-f04c-4acd-bc10-06ac0667453a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:34.165996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f307-f04c-4acd-bc10-06ac0667453a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:34.166275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f307-f04c-4acd-bc10-06ac0667453a None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:34.166989 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205f307-f04c-4acd-bc10-06ac0667453a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:34.167291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205f307-f04c-4acd-bc10-06ac0667453a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:34.168685 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205f307-f04c-4acd-bc10-06ac0667453a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:34.180357 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 419/838] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:34.185867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472e639-c6c8-4b7a-9794-d47d6ae07821 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:34.287941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472e639-c6c8-4b7a-9794-d47d6ae07821 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:34.321942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f201b-e4b5-445d-aac4-8ccdb036f3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:34.322736 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f201b-e4b5-445d-aac4-8ccdb036f3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:34.323017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f201b-e4b5-445d-aac4-8ccdb036f3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:34.323293 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f201b-e4b5-445d-aac4-8ccdb036f3f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:34.330939 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f201b-e4b5-445d-aac4-8ccdb036f3f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:34.332400 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f201b-e4b5-445d-aac4-8ccdb036f3f4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-eb6f201b-e4b5-445d-aac4-8ccdb036f3f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:34.347226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:34.348259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:34.349322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:34.349322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:34.349322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:34.349322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:34.349322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:34.349322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:34.349322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:34.349322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:34.349322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 11 20:46:34.349322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:34.349322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 420/839] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:46:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:34.354843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205f307-f04c-4acd-bc10-06ac0667453a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:34.456494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205f307-f04c-4acd-bc10-06ac0667453a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:34.491640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25647401-addb-4f04-9c57-ad90cfb11ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:34.492695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25647401-addb-4f04-9c57-ad90cfb11ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:34.493177 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25647401-addb-4f04-9c57-ad90cfb11ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:34.493689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25647401-addb-4f04-9c57-ad90cfb11ad2 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:34.494747 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25647401-addb-4f04-9c57-ad90cfb11ad2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:34.495254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25647401-addb-4f04-9c57-ad90cfb11ad2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:34.496929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25647401-addb-4f04-9c57-ad90cfb11ad2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:34.515313 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 420/840] 10.222.0.35 () {56 vars in 1135 bytes} [Wed May 11 20:46:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:34.525577 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f201b-e4b5-445d-aac4-8ccdb036f3f4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:34.545277 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dd0e0-0a2f-42d5-a4dd-7570766e2f83 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:34.545583 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dd0e0-0a2f-42d5-a4dd-7570766e2f83 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:34.545796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dd0e0-0a2f-42d5-a4dd-7570766e2f83 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:34.547408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 421/841] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:34.552345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fe6d3-3731-4650-b1df-60806da42578 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:34.552635 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fe6d3-3731-4650-b1df-60806da42578 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:34.552918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fe6d3-3731-4650-b1df-60806da42578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:34.569499 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-002fe6d3-3731-4650-b1df-60806da42578 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:34.570708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-002fe6d3-3731-4650-b1df-60806da42578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:34.623961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f201b-e4b5-445d-aac4-8ccdb036f3f4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:34.639611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 422/842] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:46:34.658412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e4b66-ad75-45e4-8c18-9a38d8d7ae1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:34.659116 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e4b66-ad75-45e4-8c18-9a38d8d7ae1e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:34.659401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e4b66-ad75-45e4-8c18-9a38d8d7ae1e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:34.659685 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e4b66-ad75-45e4-8c18-9a38d8d7ae1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:34.663255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fe6d3-3731-4650-b1df-60806da42578 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:34.728834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e4b66-ad75-45e4-8c18-9a38d8d7ae1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:34.730321 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e4b66-ad75-45e4-8c18-9a38d8d7ae1e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:34.765704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fe6d3-3731-4650-b1df-60806da42578 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:34.802688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e434b7-a020-451c-9985-9ceec61fa50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:34.803421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e434b7-a020-451c-9985-9ceec61fa50f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:34.803704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e434b7-a020-451c-9985-9ceec61fa50f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:34.803976 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e434b7-a020-451c-9985-9ceec61fa50f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:34.816259 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e434b7-a020-451c-9985-9ceec61fa50f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-39e434b7-a020-451c-9985-9ceec61fa50f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:34.825032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:34.826088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:34.826944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:34.826944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:34.826944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:34.826944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:34.826944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:34.826944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:34.826944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:34.826944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:34.826944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:34.826944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:34.826944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:46:34.826944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:34.831314 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 423/843] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:46:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:34.832314 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e434b7-a020-451c-9985-9ceec61fa50f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:34.841561 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 421/844] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:46:34.847521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e4b66-ad75-45e4-8c18-9a38d8d7ae1e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:34.960910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e434b7-a020-451c-9985-9ceec61fa50f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:34.961111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e4b66-ad75-45e4-8c18-9a38d8d7ae1e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:34.993919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e339-2a0f-4ac1-9d69-f48dc495c0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:34.994386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc00df-b1ca-4af7-9021-4c954b763fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:34.994715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e339-2a0f-4ac1-9d69-f48dc495c0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:34.994999 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e339-2a0f-4ac1-9d69-f48dc495c0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:34.995097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc00df-b1ca-4af7-9021-4c954b763fcb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:34.995274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e339-2a0f-4ac1-9d69-f48dc495c0a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:34.995369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc00df-b1ca-4af7-9021-4c954b763fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:34.995611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc00df-b1ca-4af7-9021-4c954b763fcb None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:34.996416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc00df-b1ca-4af7-9021-4c954b763fcb None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:34.996723 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc00df-b1ca-4af7-9021-4c954b763fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:34.998136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc00df-b1ca-4af7-9021-4c954b763fcb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:35.005474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40e339-2a0f-4ac1-9d69-f48dc495c0a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:35.005987 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 424/845] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:46:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:35.006931 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40e339-2a0f-4ac1-9d69-f48dc495c0a3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:35.007294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a473c4-b1d4-4ca4-893b-cdd4f1097a20 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.007505 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a473c4-b1d4-4ca4-893b-cdd4f1097a20 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.007788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a473c4-b1d4-4ca4-893b-cdd4f1097a20 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.009083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 425/846] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:35.010071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57c21c-5f13-4452-83e9-a82eff02ad74 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.010358 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57c21c-5f13-4452-83e9-a82eff02ad74 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.010636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57c21c-5f13-4452-83e9-a82eff02ad74 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.012593 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 426/847] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:35.013309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57c21c-5f13-4452-83e9-a82eff02ad74 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3d40e339-2a0f-4ac1-9d69-f48dc495c0a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:35.027104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:35.028770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:35.030051 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:35.030051 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:35.030051 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:35.030051 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:35.030051 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 422/848] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:35.030051 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60973f2-b79a-4189-9777-fb030df03438 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.030399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60973f2-b79a-4189-9777-fb030df03438 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.030624 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60973f2-b79a-4189-9777-fb030df03438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.046173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d60973f2-b79a-4189-9777-fb030df03438 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:35.047332 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d60973f2-b79a-4189-9777-fb030df03438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:35.109727 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 423/849] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:35.110827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80a59-e3ba-464f-8aa9-013bf33c3c0e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.111098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57c21c-5f13-4452-83e9-a82eff02ad74 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:35.111267 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80a59-e3ba-464f-8aa9-013bf33c3c0e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.111420 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b80a59-e3ba-464f-8aa9-013bf33c3c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.128917 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c5b80a59-e3ba-464f-8aa9-013bf33c3c0e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:35.130120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c5b80a59-e3ba-464f-8aa9-013bf33c3c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:35.144374 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32c6a1-400e-4156-b06e-d9edd68a0865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:35.145185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32c6a1-400e-4156-b06e-d9edd68a0865 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.145451 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32c6a1-400e-4156-b06e-d9edd68a0865 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.145814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32c6a1-400e-4156-b06e-d9edd68a0865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.155832 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32c6a1-400e-4156-b06e-d9edd68a0865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:35.157270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32c6a1-400e-4156-b06e-d9edd68a0865 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3a32c6a1-400e-4156-b06e-d9edd68a0865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:35.173464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:35.174408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:35.179817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:35.179817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:35.179817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:35.179817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:35.179817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 427/850] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:35.179817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32c6a1-400e-4156-b06e-d9edd68a0865 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:35.194047 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 424/851] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:35.194879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b80a59-e3ba-464f-8aa9-013bf33c3c0e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:35.268751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32c6a1-400e-4156-b06e-d9edd68a0865 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:35.286763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b80a59-e3ba-464f-8aa9-013bf33c3c0e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:35.299497 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a849c40-8a29-4cb0-8b1a-0c79dfb93427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:35.300152 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a849c40-8a29-4cb0-8b1a-0c79dfb93427 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.300430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a849c40-8a29-4cb0-8b1a-0c79dfb93427 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.300698 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a849c40-8a29-4cb0-8b1a-0c79dfb93427 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.301404 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a849c40-8a29-4cb0-8b1a-0c79dfb93427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:35.301734 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a849c40-8a29-4cb0-8b1a-0c79dfb93427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:35.303084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a849c40-8a29-4cb0-8b1a-0c79dfb93427 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:35.314575 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 428/852] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:35.315349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a849c40-8a29-4cb0-8b1a-0c79dfb93427 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:35.324195 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f36dd-e112-4430-a499-b08796c389e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:35.325607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f36dd-e112-4430-a499-b08796c389e2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.325890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f36dd-e112-4430-a499-b08796c389e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.326168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f36dd-e112-4430-a499-b08796c389e2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.326822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f36dd-e112-4430-a499-b08796c389e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:35.328179 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f36dd-e112-4430-a499-b08796c389e2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-433f36dd-e112-4430-a499-b08796c389e2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:35.340089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:35.341229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:35.342132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 425/853] 10.222.0.35 () {56 vars in 1132 bytes} [Wed May 11 20:46:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:35.343118 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f36dd-e112-4430-a499-b08796c389e2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:35.411630 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a849c40-8a29-4cb0-8b1a-0c79dfb93427 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:35.437886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f36dd-e112-4430-a499-b08796c389e2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:35.443627 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7594-0de7-4872-a1ee-f6c6135bbf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:35.444286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7594-0de7-4872-a1ee-f6c6135bbf5b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.444563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7594-0de7-4872-a1ee-f6c6135bbf5b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.444833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7594-0de7-4872-a1ee-f6c6135bbf5b None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.445558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f7594-0de7-4872-a1ee-f6c6135bbf5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:35.445865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f7594-0de7-4872-a1ee-f6c6135bbf5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:35.447220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f7594-0de7-4872-a1ee-f6c6135bbf5b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:35.458506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 429/854] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:35.459283 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7594-0de7-4872-a1ee-f6c6135bbf5b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:35.470176 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd13349-04b3-4b58-9b96-91f2d8faec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:35.470969 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd13349-04b3-4b58-9b96-91f2d8faec19 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.471252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd13349-04b3-4b58-9b96-91f2d8faec19 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.471524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd13349-04b3-4b58-9b96-91f2d8faec19 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.472169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd13349-04b3-4b58-9b96-91f2d8faec19 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:35.473521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd13349-04b3-4b58-9b96-91f2d8faec19 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ccd13349-04b3-4b58-9b96-91f2d8faec19 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:35.485484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:35.486582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:35.487439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 426/855] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:46:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:35.488764 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd13349-04b3-4b58-9b96-91f2d8faec19 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:35.552025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7594-0de7-4872-a1ee-f6c6135bbf5b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:35.581624 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd13349-04b3-4b58-9b96-91f2d8faec19 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:35.583858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b6ee3-28b1-4ddb-acd3-8e232343b0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:35.584642 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6ee3-28b1-4ddb-acd3-8e232343b0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.584926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6ee3-28b1-4ddb-acd3-8e232343b0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.585201 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6ee3-28b1-4ddb-acd3-8e232343b0d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.592189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b6ee3-28b1-4ddb-acd3-8e232343b0d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:35.593743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b6ee3-28b1-4ddb-acd3-8e232343b0d1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c88b6ee3-28b1-4ddb-acd3-8e232343b0d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:35.607437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:35.608331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:35.609220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:35.609220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:35.609220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:35.609220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:35.609220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:35.609220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:35.609220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:35.609220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:35.609220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 430/856] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:35.610064 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b6ee3-28b1-4ddb-acd3-8e232343b0d1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:35.616337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1358ae6-243d-42cc-b29b-f2a2dbf563ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:35.616998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1358ae6-243d-42cc-b29b-f2a2dbf563ed None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.617282 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1358ae6-243d-42cc-b29b-f2a2dbf563ed None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.617583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1358ae6-243d-42cc-b29b-f2a2dbf563ed None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.618284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1358ae6-243d-42cc-b29b-f2a2dbf563ed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:35.618594 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1358ae6-243d-42cc-b29b-f2a2dbf563ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:35.619943 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1358ae6-243d-42cc-b29b-f2a2dbf563ed None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:35.624338 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 427/857] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 11 20:46:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:35.625092 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1358ae6-243d-42cc-b29b-f2a2dbf563ed None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:35.705190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b6ee3-28b1-4ddb-acd3-8e232343b0d1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:35.717839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1358ae6-243d-42cc-b29b-f2a2dbf563ed None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:35.736629 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772403b3-65e2-46ca-bc0a-e7b2a4523239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:35.737431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772403b3-65e2-46ca-bc0a-e7b2a4523239 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.737738 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772403b3-65e2-46ca-bc0a-e7b2a4523239 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.738010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772403b3-65e2-46ca-bc0a-e7b2a4523239 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.744778 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772403b3-65e2-46ca-bc0a-e7b2a4523239 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:35.746268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772403b3-65e2-46ca-bc0a-e7b2a4523239 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:35.749579 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97e021-6d2f-4c02-bb7c-852fbd192336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:35.750227 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97e021-6d2f-4c02-bb7c-852fbd192336 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.750509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97e021-6d2f-4c02-bb7c-852fbd192336 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.750781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97e021-6d2f-4c02-bb7c-852fbd192336 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.751471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97e021-6d2f-4c02-bb7c-852fbd192336 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:35.751774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97e021-6d2f-4c02-bb7c-852fbd192336 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:35.753108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97e021-6d2f-4c02-bb7c-852fbd192336 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:35.757289 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 428/858] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:46:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:35.758078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97e021-6d2f-4c02-bb7c-852fbd192336 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-772403b3-65e2-46ca-bc0a-e7b2a4523239 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:35.760701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:35.762696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:35.763679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:35.763679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:35.763679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:35.763679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:35.763679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:35.763679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:35.763679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:35.763679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:35.763679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 20:46:35.763679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:35.763679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 431/859] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 11 20:46:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:35.763679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772403b3-65e2-46ca-bc0a-e7b2a4523239 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:35.852229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97e021-6d2f-4c02-bb7c-852fbd192336 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:35.859611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772403b3-65e2-46ca-bc0a-e7b2a4523239 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:35.884002 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20746b-88c0-4769-bbf0-c6d229aa489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:35.884841 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20746b-88c0-4769-bbf0-c6d229aa489c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.885332 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20746b-88c0-4769-bbf0-c6d229aa489c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.885630 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20746b-88c0-4769-bbf0-c6d229aa489c None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.886392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20746b-88c0-4769-bbf0-c6d229aa489c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:35.886705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20746b-88c0-4769-bbf0-c6d229aa489c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:35.888680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20746b-88c0-4769-bbf0-c6d229aa489c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:35.891839 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15fcd2-5c8a-4e8d-89e6-6fde7e0bdf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:35.892491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15fcd2-5c8a-4e8d-89e6-6fde7e0bdf16 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:35.892772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15fcd2-5c8a-4e8d-89e6-6fde7e0bdf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:35.893044 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15fcd2-5c8a-4e8d-89e6-6fde7e0bdf16 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:35.893767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15fcd2-5c8a-4e8d-89e6-6fde7e0bdf16 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:35.894338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15fcd2-5c8a-4e8d-89e6-6fde7e0bdf16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:35.895685 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15fcd2-5c8a-4e8d-89e6-6fde7e0bdf16 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:35.900048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 432/860] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 11 20:46:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:35.900640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15fcd2-5c8a-4e8d-89e6-6fde7e0bdf16 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:35.901244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 429/861] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:35.902243 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20746b-88c0-4769-bbf0-c6d229aa489c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:36.007473 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20746b-88c0-4769-bbf0-c6d229aa489c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:36.010812 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15fcd2-5c8a-4e8d-89e6-6fde7e0bdf16 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:36.042668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9099bc-a4f5-4c97-a257-2032261e2a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:36.043385 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9099bc-a4f5-4c97-a257-2032261e2a6a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:36.043670 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9099bc-a4f5-4c97-a257-2032261e2a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:36.043952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9099bc-a4f5-4c97-a257-2032261e2a6a None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:36.044800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9099bc-a4f5-4c97-a257-2032261e2a6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:36.045113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9099bc-a4f5-4c97-a257-2032261e2a6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:36.046607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9099bc-a4f5-4c97-a257-2032261e2a6a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:36.053105 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aae6b8-5f71-4359-b904-ae97d1d5132e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:36.054382 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aae6b8-5f71-4359-b904-ae97d1d5132e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:36.054933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aae6b8-5f71-4359-b904-ae97d1d5132e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:36.055535 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aae6b8-5f71-4359-b904-ae97d1d5132e None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:36.057438 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aae6b8-5f71-4359-b904-ae97d1d5132e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:36.057925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aae6b8-5f71-4359-b904-ae97d1d5132e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:36.060016 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aae6b8-5f71-4359-b904-ae97d1d5132e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:36.065819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 430/862] 10.222.0.35 () {56 vars in 1149 bytes} [Wed May 11 20:46:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:36.073555 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9099bc-a4f5-4c97-a257-2032261e2a6a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:36.073776 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 433/863] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:46:35 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:36.074964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aae6b8-5f71-4359-b904-ae97d1d5132e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:36.197341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9099bc-a4f5-4c97-a257-2032261e2a6a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:36.207761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aae6b8-5f71-4359-b904-ae97d1d5132e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:36.240813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13492a2d-623e-4bf0-9f66-13f04d0d30e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:36.241487 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13492a2d-623e-4bf0-9f66-13f04d0d30e8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:36.241869 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13492a2d-623e-4bf0-9f66-13f04d0d30e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:36.242145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13492a2d-623e-4bf0-9f66-13f04d0d30e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:36.243154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13492a2d-623e-4bf0-9f66-13f04d0d30e8 None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=85cb784bf9984abc9977c665a6db1656) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:36.243468 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13492a2d-623e-4bf0-9f66-13f04d0d30e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:36.245577 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13492a2d-623e-4bf0-9f66-13f04d0d30e8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:36.249482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec0668-eb1a-4361-8a2f-f16d9a2c8a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:36.250405 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec0668-eb1a-4361-8a2f-f16d9a2c8a3f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:36.250866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec0668-eb1a-4361-8a2f-f16d9a2c8a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:36.251324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec0668-eb1a-4361-8a2f-f16d9a2c8a3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:36.252755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 431/864] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:36 2022] GET /identity/v3/role_assignments?user.id=85cb784bf9984abc9977c665a6db1656&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:36.337180 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec0668-eb1a-4361-8a2f-f16d9a2c8a3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:36.338802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec0668-eb1a-4361-8a2f-f16d9a2c8a3f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:36.449517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 434/865] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:36 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 20:46:36.455001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13492a2d-623e-4bf0-9f66-13f04d0d30e8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:36.562713 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13492a2d-623e-4bf0-9f66-13f04d0d30e8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:36.597022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a4942-b818-47d2-a9fe-05fa5a3c1c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:36.597776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a4942-b818-47d2-a9fe-05fa5a3c1c89 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:36.598056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a4942-b818-47d2-a9fe-05fa5a3c1c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:36.598335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a4942-b818-47d2-a9fe-05fa5a3c1c89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:36.609987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a4942-b818-47d2-a9fe-05fa5a3c1c89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:36.611450 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a4942-b818-47d2-a9fe-05fa5a3c1c89 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a11a4942-b818-47d2-a9fe-05fa5a3c1c89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:36.628956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:36.629977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:36.630889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:36.630889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:36.630889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:36.630889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:36.630889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 432/866] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:36.635916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec0668-eb1a-4361-8a2f-f16d9a2c8a3f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:36.737638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec0668-eb1a-4361-8a2f-f16d9a2c8a3f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:36.772310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c979907-e716-412f-bfbc-a0fbed59cd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:36.772989 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c979907-e716-412f-bfbc-a0fbed59cd48 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:36.773274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c979907-e716-412f-bfbc-a0fbed59cd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:36.773580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c979907-e716-412f-bfbc-a0fbed59cd48 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:36.774315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c979907-e716-412f-bfbc-a0fbed59cd48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:36.774628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c979907-e716-412f-bfbc-a0fbed59cd48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:36.776016 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c979907-e716-412f-bfbc-a0fbed59cd48 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:36.788510 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 435/867] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:36.794523 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a4942-b818-47d2-a9fe-05fa5a3c1c89 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:36.897408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a4942-b818-47d2-a9fe-05fa5a3c1c89 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:36.931908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a16aa-cde5-43e0-99b6-a29ff061fc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:36.932709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a16aa-cde5-43e0-99b6-a29ff061fc22 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:36.932995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a16aa-cde5-43e0-99b6-a29ff061fc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:36.933276 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a16aa-cde5-43e0-99b6-a29ff061fc22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:36.940292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a16aa-cde5-43e0-99b6-a29ff061fc22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:36.941796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a16aa-cde5-43e0-99b6-a29ff061fc22 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a26a16aa-cde5-43e0-99b6-a29ff061fc22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:36.956770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:36.957729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:36.958668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:36.958668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:36.958668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:36.958668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:36.958668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:36.958668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:36.958668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:36.958668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:36.958668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 433/868] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:36.963933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c979907-e716-412f-bfbc-a0fbed59cd48 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:37.066250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c979907-e716-412f-bfbc-a0fbed59cd48 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:37.100392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef1f27-fe8e-4b13-ad01-45a2a31d283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:37.101067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1f27-fe8e-4b13-ad01-45a2a31d283f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:37.101354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1f27-fe8e-4b13-ad01-45a2a31d283f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:37.101665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef1f27-fe8e-4b13-ad01-45a2a31d283f None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:37.102456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef1f27-fe8e-4b13-ad01-45a2a31d283f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:37.102771 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef1f27-fe8e-4b13-ad01-45a2a31d283f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:37.104202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef1f27-fe8e-4b13-ad01-45a2a31d283f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:37.117107 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 436/869] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:37.123519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a16aa-cde5-43e0-99b6-a29ff061fc22 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:37.225348 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a16aa-cde5-43e0-99b6-a29ff061fc22 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:37.261291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46e8cf-a165-46b7-8022-11a3033a2027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:37.262501 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46e8cf-a165-46b7-8022-11a3033a2027 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:37.262785 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46e8cf-a165-46b7-8022-11a3033a2027 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:37.263055 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46e8cf-a165-46b7-8022-11a3033a2027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:37.263880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46e8cf-a165-46b7-8022-11a3033a2027 None admin] RBAC: Adding query filter params (role.id=b18c84f91b764bea92cc22c80a49bcaa, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=0c5f278013574823afa0ad70db22f866) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:37.264194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46e8cf-a165-46b7-8022-11a3033a2027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:37.265641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46e8cf-a165-46b7-8022-11a3033a2027 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:37.272054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 434/870] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:37 2022] GET /identity/v3/role_assignments?user.id=0c5f278013574823afa0ad70db22f866&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=b18c84f91b764bea92cc22c80a49bcaa => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:38.161516 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdd7a0-0e70-4397-bcd2-3a021daa53e0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:38.162225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdd7a0-0e70-4397-bcd2-3a021daa53e0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:38.162225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdd7a0-0e70-4397-bcd2-3a021daa53e0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:38.163609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 437/871] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:38.169441 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefed93f-7c0e-4b83-bd35-9b3d9a01ee0c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:38.170116 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefed93f-7c0e-4b83-bd35-9b3d9a01ee0c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:38.170116 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefed93f-7c0e-4b83-bd35-9b3d9a01ee0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:38.188929 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-eefed93f-7c0e-4b83-bd35-9b3d9a01ee0c None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:38.190207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eefed93f-7c0e-4b83-bd35-9b3d9a01ee0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:38.259677 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 435/872] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:38.283388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdd7a0-0e70-4397-bcd2-3a021daa53e0 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:38.365604 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77228af2-de5f-4cb8-b273-1d329038324f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:38.365930 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77228af2-de5f-4cb8-b273-1d329038324f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:38.366217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77228af2-de5f-4cb8-b273-1d329038324f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:38.368288 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 436/873] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:38.374848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405880ec-2ef7-46d0-817a-dd39fc1bfbb2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:38.375257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405880ec-2ef7-46d0-817a-dd39fc1bfbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:38.375642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405880ec-2ef7-46d0-817a-dd39fc1bfbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:38.393482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdd7a0-0e70-4397-bcd2-3a021daa53e0 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:38.394548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-405880ec-2ef7-46d0-817a-dd39fc1bfbb2 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:38.395884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-405880ec-2ef7-46d0-817a-dd39fc1bfbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:38.430480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17837a1c-2bb6-4e81-9fba-c366939544e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:38.431045 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17837a1c-2bb6-4e81-9fba-c366939544e4 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:38.431285 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17837a1c-2bb6-4e81-9fba-c366939544e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:38.431561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17837a1c-2bb6-4e81-9fba-c366939544e4 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:38.432297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17837a1c-2bb6-4e81-9fba-c366939544e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:38.434235 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17837a1c-2bb6-4e81-9fba-c366939544e4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:38.465302 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 437/874] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:46:38.488694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405880ec-2ef7-46d0-817a-dd39fc1bfbb2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:38.522709 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 438/875] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 11 20:46:38 2022] POST /identity/v3/services => generated 269 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:46:38.581216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16de2c-8aa9-4e04-ba15-d8a597f696a0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:38.581603 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16de2c-8aa9-4e04-ba15-d8a597f696a0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:38.581804 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16de2c-8aa9-4e04-ba15-d8a597f696a0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:38.584602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 439/876] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:46:38.588988 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f4fb-3fb7-40e4-957c-dd667d94b4bc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:38.589276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f4fb-3fb7-40e4-957c-dd667d94b4bc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:38.589577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f4fb-3fb7-40e4-957c-dd667d94b4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:38.607683 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c0b7f4fb-3fb7-40e4-957c-dd667d94b4bc None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:38.608914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c0b7f4fb-3fb7-40e4-957c-dd667d94b4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:38.611376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405880ec-2ef7-46d0-817a-dd39fc1bfbb2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:38.657466 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e17b73-9ff4-42ef-8ec4-c2daa7bab8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:38.658192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e17b73-9ff4-42ef-8ec4-c2daa7bab8fe None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:38.658475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e17b73-9ff4-42ef-8ec4-c2daa7bab8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:38.658751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e17b73-9ff4-42ef-8ec4-c2daa7bab8fe None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:38.659477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e17b73-9ff4-42ef-8ec4-c2daa7bab8fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:38.660889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e17b73-9ff4-42ef-8ec4-c2daa7bab8fe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:38.687063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 440/877] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:38 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:38.709656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7f4fb-3fb7-40e4-957c-dd667d94b4bc None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:38.778317 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 438/878] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 11 20:46:38 2022] POST /identity/v3/services => generated 251 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 20:46:38.816545 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7f4fb-3fb7-40e4-957c-dd667d94b4bc None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:38.866480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f58cf6-a4a8-4eca-9371-442d22a421ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:38.867306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58cf6-a4a8-4eca-9371-442d22a421ff None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:38.867634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58cf6-a4a8-4eca-9371-442d22a421ff None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:38.867912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58cf6-a4a8-4eca-9371-442d22a421ff None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:38.868573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f58cf6-a4a8-4eca-9371-442d22a421ff None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:38.870083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f58cf6-a4a8-4eca-9371-442d22a421ff None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-67f58cf6-a4a8-4eca-9371-442d22a421ff None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:38.883866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:38.884971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:38.885882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:38.885882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:38.885882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:38.885882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:38.885882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:38.885882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:38.885882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:38.885882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:38.885882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:38.885882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:38.885882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:38.885882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:38.885882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:38.885882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:38.889861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 441/879] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 11 20:46:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:38.893196 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e17b73-9ff4-42ef-8ec4-c2daa7bab8fe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:38.998070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e17b73-9ff4-42ef-8ec4-c2daa7bab8fe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:39.032577 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e90e2-450f-4f31-a80c-06879d49f01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:39.033295 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e90e2-450f-4f31-a80c-06879d49f01e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:39.033604 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e90e2-450f-4f31-a80c-06879d49f01e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:39.033881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e90e2-450f-4f31-a80c-06879d49f01e None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:39.034645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e90e2-450f-4f31-a80c-06879d49f01e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:39.035007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e90e2-450f-4f31-a80c-06879d49f01e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:39.036386 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e90e2-450f-4f31-a80c-06879d49f01e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:39.045599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 439/880] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 11 20:46:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:39.047294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f58cf6-a4a8-4eca-9371-442d22a421ff None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:39.147539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f58cf6-a4a8-4eca-9371-442d22a421ff None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:39.181988 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652d7fb-5023-4653-9b09-8b9fc0bde26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:39.182753 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d7fb-5023-4653-9b09-8b9fc0bde26d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:39.182911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d7fb-5023-4653-9b09-8b9fc0bde26d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:39.183186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d7fb-5023-4653-9b09-8b9fc0bde26d None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:39.183936 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652d7fb-5023-4653-9b09-8b9fc0bde26d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:39.184244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652d7fb-5023-4653-9b09-8b9fc0bde26d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:39.185637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652d7fb-5023-4653-9b09-8b9fc0bde26d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:39.190858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 442/881] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 11 20:46:39 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:39.637758 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b07cf-f09f-4ddd-bbb0-cb6b4f2a6d99 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:39.638467 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b07cf-f09f-4ddd-bbb0-cb6b4f2a6d99 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:39.638467 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b07cf-f09f-4ddd-bbb0-cb6b4f2a6d99 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:39.639892 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 440/882] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:39.645588 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434c529-b8a2-4edb-add4-75ecf54b4f02 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:39.645885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434c529-b8a2-4edb-add4-75ecf54b4f02 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:39.646165 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434c529-b8a2-4edb-add4-75ecf54b4f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:39.662995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8434c529-b8a2-4edb-add4-75ecf54b4f02 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:39.664180 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8434c529-b8a2-4edb-add4-75ecf54b4f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:39.732588 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 443/883] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:39.756552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b07cf-f09f-4ddd-bbb0-cb6b4f2a6d99 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:39.869449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b07cf-f09f-4ddd-bbb0-cb6b4f2a6d99 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:39.904956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ccbbe-2ed2-4b98-b90e-11ad4d652135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:39.905774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ccbbe-2ed2-4b98-b90e-11ad4d652135 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:39.906195 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ccbbe-2ed2-4b98-b90e-11ad4d652135 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:39.906525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ccbbe-2ed2-4b98-b90e-11ad4d652135 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:39.918498 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ccbbe-2ed2-4b98-b90e-11ad4d652135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9e4ccbbe-2ed2-4b98-b90e-11ad4d652135 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:39.927032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:39.929253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:39.931377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:39.931377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:39.931377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:39.931377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:39.931377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:39.931377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:39.931377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:39.931377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:39.931377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:39.931377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:39.931377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 20:46:39.931377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:39.931377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 441/884] 10.222.0.35 () {56 vars in 1120 bytes} [Wed May 11 20:46:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:39.937551 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434c529-b8a2-4edb-add4-75ecf54b4f02 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:40.036562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434c529-b8a2-4edb-add4-75ecf54b4f02 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:40.070944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdc46a-915f-419b-b55a-7cdfd858be21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:40.071617 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdc46a-915f-419b-b55a-7cdfd858be21 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:40.071901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdc46a-915f-419b-b55a-7cdfd858be21 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:40.072181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdc46a-915f-419b-b55a-7cdfd858be21 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:40.072933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdc46a-915f-419b-b55a-7cdfd858be21 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:40.073242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdc46a-915f-419b-b55a-7cdfd858be21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:40.074830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdc46a-915f-419b-b55a-7cdfd858be21 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:40.083365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 444/885] 10.222.0.35 () {56 vars in 1115 bytes} [Wed May 11 20:46:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:40.088864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ccbbe-2ed2-4b98-b90e-11ad4d652135 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:40.188294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ccbbe-2ed2-4b98-b90e-11ad4d652135 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:40.221981 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109a4c9-06ba-4612-8825-c26f3e604ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:40.223107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a4c9-06ba-4612-8825-c26f3e604ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:40.223613 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a4c9-06ba-4612-8825-c26f3e604ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:40.224102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a4c9-06ba-4612-8825-c26f3e604ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:40.235161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109a4c9-06ba-4612-8825-c26f3e604ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:40.236883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109a4c9-06ba-4612-8825-c26f3e604ac4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f109a4c9-06ba-4612-8825-c26f3e604ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:40.255177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:40.256129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:40.257138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:40.257138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:40.257138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:40.257138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:40.259429 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 442/886] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:40.265264 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdc46a-915f-419b-b55a-7cdfd858be21 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:40.369777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdc46a-915f-419b-b55a-7cdfd858be21 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:40.404195 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50029d-2316-44ae-ba39-7b04aad3a399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:40.405268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50029d-2316-44ae-ba39-7b04aad3a399 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:40.405813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50029d-2316-44ae-ba39-7b04aad3a399 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:40.406316 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50029d-2316-44ae-ba39-7b04aad3a399 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:40.407272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50029d-2316-44ae-ba39-7b04aad3a399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:40.407793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50029d-2316-44ae-ba39-7b04aad3a399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:40.409398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50029d-2316-44ae-ba39-7b04aad3a399 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:40.422965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 445/887] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:40.428810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109a4c9-06ba-4612-8825-c26f3e604ac4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:40.531112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109a4c9-06ba-4612-8825-c26f3e604ac4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:40.565847 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872b250-0879-4442-a6ac-a7620bb114ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:40.567060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872b250-0879-4442-a6ac-a7620bb114ca None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:40.567576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872b250-0879-4442-a6ac-a7620bb114ca None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:40.568066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872b250-0879-4442-a6ac-a7620bb114ca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:40.577356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872b250-0879-4442-a6ac-a7620bb114ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:40.579143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872b250-0879-4442-a6ac-a7620bb114ca None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4872b250-0879-4442-a6ac-a7620bb114ca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:40.594022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:40.595008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:40.595987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:40.595987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:40.595987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:40.595987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:40.595987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:40.595987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:40.595987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:40.595987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:40.595987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 20:46:40.595987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:40.598644 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 443/888] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 11 20:46:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:40.604444 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50029d-2316-44ae-ba39-7b04aad3a399 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:40.705819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50029d-2316-44ae-ba39-7b04aad3a399 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:40.743998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8afcee-73f8-4e42-94a1-7eabe9d359db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:40.745129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8afcee-73f8-4e42-94a1-7eabe9d359db None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:40.745693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8afcee-73f8-4e42-94a1-7eabe9d359db None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:40.746225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8afcee-73f8-4e42-94a1-7eabe9d359db None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:40.747322 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8afcee-73f8-4e42-94a1-7eabe9d359db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:40.747856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8afcee-73f8-4e42-94a1-7eabe9d359db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:40.749585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8afcee-73f8-4e42-94a1-7eabe9d359db None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:40.768523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 446/889] 10.222.0.35 () {56 vars in 1149 bytes} [Wed May 11 20:46:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:40.774833 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872b250-0879-4442-a6ac-a7620bb114ca None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:40.877139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872b250-0879-4442-a6ac-a7620bb114ca None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:40.912191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0e2ae-dd71-4349-af70-c796d31faf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:40.912865 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e2ae-dd71-4349-af70-c796d31faf69 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:40.913150 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e2ae-dd71-4349-af70-c796d31faf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:40.913495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e2ae-dd71-4349-af70-c796d31faf69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:40.927508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b290ac5-1d08-4f33-9dd0-5c589a472489 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:40.927858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b290ac5-1d08-4f33-9dd0-5c589a472489 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:40.928056 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b290ac5-1d08-4f33-9dd0-5c589a472489 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:40.931120 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 447/890] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:46:40.937203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725fb22-f60e-4b50-b12c-258f07c4572b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:40.937879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725fb22-f60e-4b50-b12c-258f07c4572b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:40.938404 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725fb22-f60e-4b50-b12c-258f07c4572b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:40.956363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4725fb22-f60e-4b50-b12c-258f07c4572b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:40.957925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4725fb22-f60e-4b50-b12c-258f07c4572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:40.991649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0e2ae-dd71-4349-af70-c796d31faf69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:40.993342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0e2ae-dd71-4349-af70-c796d31faf69 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:41.033379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 448/891] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:41.049160 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725fb22-f60e-4b50-b12c-258f07c4572b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:41.095109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 444/892] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:40 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:46:41.100613 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0e2ae-dd71-4349-af70-c796d31faf69 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:41.149759 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725fb22-f60e-4b50-b12c-258f07c4572b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:41.183229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070ba71-f9d9-46f8-a941-8e044d841133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:41.185073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070ba71-f9d9-46f8-a941-8e044d841133 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:41.185506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070ba71-f9d9-46f8-a941-8e044d841133 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:41.185956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070ba71-f9d9-46f8-a941-8e044d841133 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:41.186765 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070ba71-f9d9-46f8-a941-8e044d841133 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:41.188972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070ba71-f9d9-46f8-a941-8e044d841133 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:41.198412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0e2ae-dd71-4349-af70-c796d31faf69 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-1070ba71-f9d9-46f8-a941-8e044d841133 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:41.204594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:41.205663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:41.206571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 449/893] 10.222.0.35 () {56 vars in 1132 bytes} [Wed May 11 20:46:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:41.207468 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51638dd7-1c20-4fe9-ade8-80e08cc931da None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:41.208137 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51638dd7-1c20-4fe9-ade8-80e08cc931da None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:41.208137 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51638dd7-1c20-4fe9-ade8-80e08cc931da None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:41.209380 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 450/894] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:41.211573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51638dd7-1c20-4fe9-ade8-80e08cc931da None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:41.238790 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf163ed-3ca8-4759-8f94-9bc8dce2a60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:41.239597 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf163ed-3ca8-4759-8f94-9bc8dce2a60f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:41.239878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf163ed-3ca8-4759-8f94-9bc8dce2a60f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:41.240215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf163ed-3ca8-4759-8f94-9bc8dce2a60f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:41.252032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf163ed-3ca8-4759-8f94-9bc8dce2a60f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:41.253513 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf163ed-3ca8-4759-8f94-9bc8dce2a60f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-bbf163ed-3ca8-4759-8f94-9bc8dce2a60f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:41.273094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:41.274272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:41.275379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:41.275379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:41.275379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:41.275379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:41.278846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 445/895] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:41.280284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598da52-8479-4ae2-98b3-5eca7551bc4c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:41.280576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598da52-8479-4ae2-98b3-5eca7551bc4c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:41.280856 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598da52-8479-4ae2-98b3-5eca7551bc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:41.297009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7598da52-8479-4ae2-98b3-5eca7551bc4c None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:41.298471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7598da52-8479-4ae2-98b3-5eca7551bc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:41.319070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51638dd7-1c20-4fe9-ade8-80e08cc931da None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:41.353132 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0f56e-90bc-4b09-b404-639004fbd3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:41.354047 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0f56e-90bc-4b09-b404-639004fbd3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:41.354509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0f56e-90bc-4b09-b404-639004fbd3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:41.354941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0f56e-90bc-4b09-b404-639004fbd3a2 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:41.355823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0f56e-90bc-4b09-b404-639004fbd3a2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:41.356276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0f56e-90bc-4b09-b404-639004fbd3a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:41.357821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0f56e-90bc-4b09-b404-639004fbd3a2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:41.362501 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 451/896] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 11 20:46:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:41.365563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 446/897] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:41.368914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598da52-8479-4ae2-98b3-5eca7551bc4c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:41.373761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0f56e-90bc-4b09-b404-639004fbd3a2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:41.465434 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598da52-8479-4ae2-98b3-5eca7551bc4c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:41.471207 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0f56e-90bc-4b09-b404-639004fbd3a2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:41.498081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6b619-0e65-4a73-a457-29df3b53d947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:41.498739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6b619-0e65-4a73-a457-29df3b53d947 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:41.499022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6b619-0e65-4a73-a457-29df3b53d947 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:41.499295 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6b619-0e65-4a73-a457-29df3b53d947 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:41.499991 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6b619-0e65-4a73-a457-29df3b53d947 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:41.500295 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6b619-0e65-4a73-a457-29df3b53d947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:41.501683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d6b619-0e65-4a73-a457-29df3b53d947 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:41.503357 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973322a5-8f4a-4e24-90f4-8e009cae3c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:41.504011 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973322a5-8f4a-4e24-90f4-8e009cae3c99 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:41.504292 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973322a5-8f4a-4e24-90f4-8e009cae3c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:41.504566 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973322a5-8f4a-4e24-90f4-8e009cae3c99 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:41.505275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973322a5-8f4a-4e24-90f4-8e009cae3c99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:41.505611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973322a5-8f4a-4e24-90f4-8e009cae3c99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:41.506351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 447/898] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 11 20:46:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:41.506982 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973322a5-8f4a-4e24-90f4-8e009cae3c99 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:41.507097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6b619-0e65-4a73-a457-29df3b53d947 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:41.523071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 452/899] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:41.523071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63662283-c12f-470a-8a34-a85c72db7d89 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:41.523071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63662283-c12f-470a-8a34-a85c72db7d89 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:41.523071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63662283-c12f-470a-8a34-a85c72db7d89 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:41.523071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 453/900] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:41.523071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63662283-c12f-470a-8a34-a85c72db7d89 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:41.600732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6b619-0e65-4a73-a457-29df3b53d947 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:41.618206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63662283-c12f-470a-8a34-a85c72db7d89 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:41.633064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d4e2f-ec30-4f1a-b250-1f2d9525e7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:41.633879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d4e2f-ec30-4f1a-b250-1f2d9525e7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:41.634161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d4e2f-ec30-4f1a-b250-1f2d9525e7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:41.634436 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d4e2f-ec30-4f1a-b250-1f2d9525e7c7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:41.635090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d4e2f-ec30-4f1a-b250-1f2d9525e7c7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:41.636442 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d4e2f-ec30-4f1a-b250-1f2d9525e7c7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-147d4e2f-ec30-4f1a-b250-1f2d9525e7c7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:41.648045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:41.649095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:41.650005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 448/901] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:46:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:41.650829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d4e2f-ec30-4f1a-b250-1f2d9525e7c7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:41.654909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60886d7-8c42-469d-9b36-ce03e432a610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:41.655565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60886d7-8c42-469d-9b36-ce03e432a610 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:41.655845 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60886d7-8c42-469d-9b36-ce03e432a610 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:41.656118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60886d7-8c42-469d-9b36-ce03e432a610 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:41.656896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60886d7-8c42-469d-9b36-ce03e432a610 None admin] RBAC: Adding query filter params (interface=public, service_id=3c158eb0420f41d886cb3b32597270f6, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:41.657204 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60886d7-8c42-469d-9b36-ce03e432a610 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:41.658605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60886d7-8c42-469d-9b36-ce03e432a610 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:41.663543 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 454/902] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 11 20:46:41 2022] GET /identity/v3/endpoints?service_id=3c158eb0420f41d886cb3b32597270f6&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:41.664746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe1781-e2b3-42c5-9858-0c20b1560ac5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:41.665026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe1781-e2b3-42c5-9858-0c20b1560ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:41.665305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe1781-e2b3-42c5-9858-0c20b1560ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:41.681097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e0fe1781-e2b3-42c5-9858-0c20b1560ac5 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:41.682280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e0fe1781-e2b3-42c5-9858-0c20b1560ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:41.743397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 455/903] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:41.744193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe1781-e2b3-42c5-9858-0c20b1560ac5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:41.747318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d4e2f-ec30-4f1a-b250-1f2d9525e7c7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:41.779862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd51905-be34-4538-96df-20fdc11b9324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:41.780645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51905-be34-4538-96df-20fdc11b9324 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:41.780923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51905-be34-4538-96df-20fdc11b9324 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:41.781228 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51905-be34-4538-96df-20fdc11b9324 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:41.787692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd51905-be34-4538-96df-20fdc11b9324 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:41.789114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd51905-be34-4538-96df-20fdc11b9324 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8fd51905-be34-4538-96df-20fdc11b9324 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:41.803336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:41.804250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:41.805188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:41.805188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:41.805188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:41.805188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:41.805188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:41.805188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:41.805188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:41.805188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:41.805188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 449/904] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:41.805763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd51905-be34-4538-96df-20fdc11b9324 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:41.840998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe1781-e2b3-42c5-9858-0c20b1560ac5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:41.873407 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a00170-fa41-49c4-9f68-532d3a1a4cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:41.874026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00170-fa41-49c4-9f68-532d3a1a4cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:41.874311 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00170-fa41-49c4-9f68-532d3a1a4cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:41.874586 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00170-fa41-49c4-9f68-532d3a1a4cc1 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:41.875289 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a00170-fa41-49c4-9f68-532d3a1a4cc1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:41.875597 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a00170-fa41-49c4-9f68-532d3a1a4cc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:41.876964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a00170-fa41-49c4-9f68-532d3a1a4cc1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:41.881511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 456/905] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:46:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:41.882123 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a00170-fa41-49c4-9f68-532d3a1a4cc1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:41.904256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd51905-be34-4538-96df-20fdc11b9324 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:41.936567 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a115bf5-ee2f-4345-87be-61fde8567d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:41.937221 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a115bf5-ee2f-4345-87be-61fde8567d1f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:41.937503 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a115bf5-ee2f-4345-87be-61fde8567d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:41.937807 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a115bf5-ee2f-4345-87be-61fde8567d1f None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:41.938487 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a115bf5-ee2f-4345-87be-61fde8567d1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:41.939838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a115bf5-ee2f-4345-87be-61fde8567d1f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:41.945291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 450/906] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 11 20:46:41 2022] GET /identity/v3/services => generated 1268 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 20:46:41.946100 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a115bf5-ee2f-4345-87be-61fde8567d1f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:41.978309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a00170-fa41-49c4-9f68-532d3a1a4cc1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:42.014549 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d41350-eb64-4d06-ae85-5f0cf8fed70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:42.015225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d41350-eb64-4d06-ae85-5f0cf8fed70a None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:42.015506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d41350-eb64-4d06-ae85-5f0cf8fed70a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:42.015782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d41350-eb64-4d06-ae85-5f0cf8fed70a None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:42.016515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d41350-eb64-4d06-ae85-5f0cf8fed70a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:42.017944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d41350-eb64-4d06-ae85-5f0cf8fed70a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:42.050877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a115bf5-ee2f-4345-87be-61fde8567d1f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:42.085949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaafad4-8193-411e-aeed-f664d7398ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:42.086622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaafad4-8193-411e-aeed-f664d7398ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:42.086906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaafad4-8193-411e-aeed-f664d7398ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:42.087180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaafad4-8193-411e-aeed-f664d7398ee9 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:42.087973 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaafad4-8193-411e-aeed-f664d7398ee9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:42.088280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaafad4-8193-411e-aeed-f664d7398ee9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:42.097881 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 457/907] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 11 20:46:41 2022] POST /identity/v3/services => generated 241 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:46:42.098126 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaafad4-8193-411e-aeed-f664d7398ee9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:42.098220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d41350-eb64-4d06-ae85-5f0cf8fed70a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:42.116089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 451/908] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:42.123512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaafad4-8193-411e-aeed-f664d7398ee9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:42.234755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaafad4-8193-411e-aeed-f664d7398ee9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:42.245106 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d41350-eb64-4d06-ae85-5f0cf8fed70a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:42.272428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9f4ed-4a38-485a-9edf-f4fb398f0802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:42.273201 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9f4ed-4a38-485a-9edf-f4fb398f0802 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:42.273580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9f4ed-4a38-485a-9edf-f4fb398f0802 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:42.273929 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9f4ed-4a38-485a-9edf-f4fb398f0802 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:42.274837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9f4ed-4a38-485a-9edf-f4fb398f0802 None admin] RBAC: Adding query filter params (role.id=2ddc595bde9b4177b6b72d37bfe70957, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=0c5f278013574823afa0ad70db22f866) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:42.275217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9f4ed-4a38-485a-9edf-f4fb398f0802 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:42.278010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9f4ed-4a38-485a-9edf-f4fb398f0802 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:42.283594 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 452/909] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:42 2022] GET /identity/v3/role_assignments?user.id=0c5f278013574823afa0ad70db22f866&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=2ddc595bde9b4177b6b72d37bfe70957 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:42.295004 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7f30f-03db-4e13-8295-f5de582d09a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:42.295701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7f30f-03db-4e13-8295-f5de582d09a1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:42.295991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7f30f-03db-4e13-8295-f5de582d09a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:42.296267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7f30f-03db-4e13-8295-f5de582d09a1 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:42.296999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7f30f-03db-4e13-8295-f5de582d09a1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:42.297309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7f30f-03db-4e13-8295-f5de582d09a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:42.298788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7f30f-03db-4e13-8295-f5de582d09a1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:42.305712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 458/910] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:46:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:42.311109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9f4ed-4a38-485a-9edf-f4fb398f0802 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:42.423544 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9f4ed-4a38-485a-9edf-f4fb398f0802 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:42.460434 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d2299-e446-4c47-b7e1-4c48d8c704c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:42.461462 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d2299-e446-4c47-b7e1-4c48d8c704c4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:42.461919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d2299-e446-4c47-b7e1-4c48d8c704c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:42.462339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d2299-e446-4c47-b7e1-4c48d8c704c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:42.463301 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d2299-e446-4c47-b7e1-4c48d8c704c4 None admin] RBAC: Adding query filter params (interface=public, service_id=882fffaac8c940d799c41eaa76efbf3b, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:42.463782 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d2299-e446-4c47-b7e1-4c48d8c704c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:42.465908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d2299-e446-4c47-b7e1-4c48d8c704c4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:42.476430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 453/911] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 11 20:46:42 2022] GET /identity/v3/endpoints?service_id=882fffaac8c940d799c41eaa76efbf3b&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:42.478107 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7f30f-03db-4e13-8295-f5de582d09a1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:42.579338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7f30f-03db-4e13-8295-f5de582d09a1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:42.612324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250df0d-1733-4f8f-af94-7ce1ecb6e155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:42.613220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250df0d-1733-4f8f-af94-7ce1ecb6e155 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:42.613698 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250df0d-1733-4f8f-af94-7ce1ecb6e155 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:42.614142 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250df0d-1733-4f8f-af94-7ce1ecb6e155 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:42.614964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250df0d-1733-4f8f-af94-7ce1ecb6e155 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:42.616494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250df0d-1733-4f8f-af94-7ce1ecb6e155 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:42.623128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 459/912] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 11 20:46:42 2022] GET /identity/v3/services => generated 1497 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 20:46:44.239162 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ed889-75d5-4d48-8dd4-7b12e6dce8e5 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:44.239675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ed889-75d5-4d48-8dd4-7b12e6dce8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:44.239675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ed889-75d5-4d48-8dd4-7b12e6dce8e5 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:44.241208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 454/913] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:44.247222 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6a05b-5d3a-48f5-aceb-b54e9d2114a6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:44.247655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6a05b-5d3a-48f5-aceb-b54e9d2114a6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:44.247837 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6a05b-5d3a-48f5-aceb-b54e9d2114a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:44.265861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ddb6a05b-5d3a-48f5-aceb-b54e9d2114a6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:44.267056 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ddb6a05b-5d3a-48f5-aceb-b54e9d2114a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:44.333934 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 460/914] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:44.357061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ed889-75d5-4d48-8dd4-7b12e6dce8e5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:44.397405 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825f65-8cbf-4824-9a19-be1b792a1d6b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:44.397729 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825f65-8cbf-4824-9a19-be1b792a1d6b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:44.397997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af825f65-8cbf-4824-9a19-be1b792a1d6b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:44.399478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 461/915] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:46:44.405854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04e5c2-084c-4b28-ad9c-f865c1d52159 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:44.406143 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04e5c2-084c-4b28-ad9c-f865c1d52159 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:44.406425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04e5c2-084c-4b28-ad9c-f865c1d52159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:44.427349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0f04e5c2-084c-4b28-ad9c-f865c1d52159 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:44.429111 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0f04e5c2-084c-4b28-ad9c-f865c1d52159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:44.466905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ed889-75d5-4d48-8dd4-7b12e6dce8e5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:44.501979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b512e23-478b-4cd8-84ef-3b88b3341340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:44.503136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b512e23-478b-4cd8-84ef-3b88b3341340 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:44.503599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b512e23-478b-4cd8-84ef-3b88b3341340 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:44.504054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b512e23-478b-4cd8-84ef-3b88b3341340 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:44.504889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b512e23-478b-4cd8-84ef-3b88b3341340 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:44.506484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b512e23-478b-4cd8-84ef-3b88b3341340 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:44.511737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 462/916] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4b512e23-478b-4cd8-84ef-3b88b3341340 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:44.523512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:44.524439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 11 20:46:44.525297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:44.527766 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 455/917] 10.222.0.35 () {56 vars in 1132 bytes} [Wed May 11 20:46:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:44.532900 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04e5c2-084c-4b28-ad9c-f865c1d52159 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:44.533769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b512e23-478b-4cd8-84ef-3b88b3341340 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:44.628602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04e5c2-084c-4b28-ad9c-f865c1d52159 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:44.629881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b512e23-478b-4cd8-84ef-3b88b3341340 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:44.660972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e31ed-8385-494b-b973-17d0772849f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:44.661806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e31ed-8385-494b-b973-17d0772849f4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:44.662030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e3a8a-69ab-49b8-8de4-b87079f6ade8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:44.662157 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e31ed-8385-494b-b973-17d0772849f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:44.662352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e31ed-8385-494b-b973-17d0772849f4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:44.662697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3a8a-69ab-49b8-8de4-b87079f6ade8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:44.662984 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3a8a-69ab-49b8-8de4-b87079f6ade8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:44.663088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e31ed-8385-494b-b973-17d0772849f4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:44.663261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3a8a-69ab-49b8-8de4-b87079f6ade8 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:44.663974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e3a8a-69ab-49b8-8de4-b87079f6ade8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:44.664287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e3a8a-69ab-49b8-8de4-b87079f6ade8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:44.664382 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e31ed-8385-494b-b973-17d0772849f4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:44.665704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e3a8a-69ab-49b8-8de4-b87079f6ade8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:44.675963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 456/918] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 11 20:46:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:44.675963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e85f25-dbd8-42f4-a0a7-8e470042645b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:44.675963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e85f25-dbd8-42f4-a0a7-8e470042645b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:44.675963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e85f25-dbd8-42f4-a0a7-8e470042645b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:44.675963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 457/919] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:44.677649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e85f25-dbd8-42f4-a0a7-8e470042645b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-735e31ed-8385-494b-b973-17d0772849f4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:44.677887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:44.678887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:44.679749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:44.679749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:44.679749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:44.679749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:44.679749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:44.679749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:44.679749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:44.679749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:44.679749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:44.679749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:44.679749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:44.679749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:44.679749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:44.679749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:44.684998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 463/920] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 11 20:46:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:44.686671 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99dfb-44cb-42fd-b1ba-e59601a7a553 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:44.686963 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99dfb-44cb-42fd-b1ba-e59601a7a553 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:44.687239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99dfb-44cb-42fd-b1ba-e59601a7a553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:44.704214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-37f99dfb-44cb-42fd-b1ba-e59601a7a553 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:44.705405 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-37f99dfb-44cb-42fd-b1ba-e59601a7a553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:44.770451 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 464/921] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:44.771209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f99dfb-44cb-42fd-b1ba-e59601a7a553 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:44.797877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e85f25-dbd8-42f4-a0a7-8e470042645b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:44.837537 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a201c8-1c73-45a9-87b2-af55d5d07899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:44.838218 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a201c8-1c73-45a9-87b2-af55d5d07899 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:44.838503 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a201c8-1c73-45a9-87b2-af55d5d07899 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:44.838781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a201c8-1c73-45a9-87b2-af55d5d07899 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:44.839973 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a201c8-1c73-45a9-87b2-af55d5d07899 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:44.840287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a201c8-1c73-45a9-87b2-af55d5d07899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:44.841699 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a201c8-1c73-45a9-87b2-af55d5d07899 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:44.850173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 458/922] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 11 20:46:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:44.851299 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a201c8-1c73-45a9-87b2-af55d5d07899 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:44.879194 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f99dfb-44cb-42fd-b1ba-e59601a7a553 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:44.911905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d122463-e2c3-4db4-b4bc-15f512c445a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:44.912571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d122463-e2c3-4db4-b4bc-15f512c445a4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:44.912889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d122463-e2c3-4db4-b4bc-15f512c445a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:44.913160 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d122463-e2c3-4db4-b4bc-15f512c445a4 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:44.913909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d122463-e2c3-4db4-b4bc-15f512c445a4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:44.914209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d122463-e2c3-4db4-b4bc-15f512c445a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:44.915571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d122463-e2c3-4db4-b4bc-15f512c445a4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:44.920956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 465/923] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 11 20:46:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:44.921737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d122463-e2c3-4db4-b4bc-15f512c445a4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:44.945977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a201c8-1c73-45a9-87b2-af55d5d07899 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:44.977465 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2643eae-33f9-47bd-8590-9e97eef00447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:44.978291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2643eae-33f9-47bd-8590-9e97eef00447 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:44.978574 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2643eae-33f9-47bd-8590-9e97eef00447 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:44.978844 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2643eae-33f9-47bd-8590-9e97eef00447 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:44.989346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2643eae-33f9-47bd-8590-9e97eef00447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b2643eae-33f9-47bd-8590-9e97eef00447 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:44.997469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:45.000113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:45.001006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:45.001006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:45.001006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:45.001006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:45.001006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:45.001006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:45.001006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:45.001006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:45.001006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:45.001006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:45.001006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 20:46:45.001006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:45.001006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 459/924] 10.222.0.35 () {56 vars in 1120 bytes} [Wed May 11 20:46:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:45.001006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd840c-6f73-4ece-b416-52162a6e20e1 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:45.001832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd840c-6f73-4ece-b416-52162a6e20e1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:45.001832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd840c-6f73-4ece-b416-52162a6e20e1 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:45.002299 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 460/925] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:45.003307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd840c-6f73-4ece-b416-52162a6e20e1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:45.017475 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d122463-e2c3-4db4-b4bc-15f512c445a4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:45.050595 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32466ada-6871-447b-931a-6cde429857de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:45.051247 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32466ada-6871-447b-931a-6cde429857de None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:45.051531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32466ada-6871-447b-931a-6cde429857de None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:45.051807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32466ada-6871-447b-931a-6cde429857de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:45.052540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32466ada-6871-447b-931a-6cde429857de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:45.053949 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32466ada-6871-447b-931a-6cde429857de None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:45.099068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd840c-6f73-4ece-b416-52162a6e20e1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:45.130265 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12c0c9-4452-43f2-9f3c-26d6a2834074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:45.130941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c0c9-4452-43f2-9f3c-26d6a2834074 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:45.131223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c0c9-4452-43f2-9f3c-26d6a2834074 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:45.131499 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c0c9-4452-43f2-9f3c-26d6a2834074 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:45.132204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12c0c9-4452-43f2-9f3c-26d6a2834074 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:45.132510 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12c0c9-4452-43f2-9f3c-26d6a2834074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:45.133901 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12c0c9-4452-43f2-9f3c-26d6a2834074 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:45.138477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 461/926] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 11 20:46:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:45.139317 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12c0c9-4452-43f2-9f3c-26d6a2834074 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:45.153950 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 466/927] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 11 20:46:44 2022] POST /identity/v3/endpoints => generated 347 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:46:45.155276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac5619-c5de-4cfe-98d2-c2e4779af013 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:45.155572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac5619-c5de-4cfe-98d2-c2e4779af013 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:45.155859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac5619-c5de-4cfe-98d2-c2e4779af013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:45.175354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-01ac5619-c5de-4cfe-98d2-c2e4779af013 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:45.176589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-01ac5619-c5de-4cfe-98d2-c2e4779af013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:45.246083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12c0c9-4452-43f2-9f3c-26d6a2834074 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:45.260534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 467/928] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:45.262659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac5619-c5de-4cfe-98d2-c2e4779af013 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:45.283264 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c92c3-15c2-437d-bbad-bd16853d26eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:45.284086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c92c3-15c2-437d-bbad-bd16853d26eb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:45.284671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c92c3-15c2-437d-bbad-bd16853d26eb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:45.284671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c92c3-15c2-437d-bbad-bd16853d26eb None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:45.285421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c92c3-15c2-437d-bbad-bd16853d26eb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:45.285748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c92c3-15c2-437d-bbad-bd16853d26eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:45.287153 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c92c3-15c2-437d-bbad-bd16853d26eb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:45.296536 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 462/929] 10.222.0.35 () {56 vars in 1115 bytes} [Wed May 11 20:46:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:45.297467 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c92c3-15c2-437d-bbad-bd16853d26eb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:45.365386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac5619-c5de-4cfe-98d2-c2e4779af013 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:45.399665 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c92c3-15c2-437d-bbad-bd16853d26eb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:45.400803 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16264f4-3ecb-4d93-a7db-3cc7a1e918a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:45.401466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16264f4-3ecb-4d93-a7db-3cc7a1e918a6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:45.401831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16264f4-3ecb-4d93-a7db-3cc7a1e918a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:45.402139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16264f4-3ecb-4d93-a7db-3cc7a1e918a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:45.402935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16264f4-3ecb-4d93-a7db-3cc7a1e918a6 None admin] RBAC: Adding query filter params (interface=public, service_id=57110beeded540488fdf5a2b54c822d3, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:45.403246 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16264f4-3ecb-4d93-a7db-3cc7a1e918a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:45.404618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16264f4-3ecb-4d93-a7db-3cc7a1e918a6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:45.409801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 468/930] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 11 20:46:45 2022] GET /identity/v3/endpoints?service_id=57110beeded540488fdf5a2b54c822d3&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:45.410596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16264f4-3ecb-4d93-a7db-3cc7a1e918a6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:45.439733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db55871-bcfa-4b23-a788-75de2a116121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:45.440526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db55871-bcfa-4b23-a788-75de2a116121 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:45.440810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db55871-bcfa-4b23-a788-75de2a116121 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:45.441082 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db55871-bcfa-4b23-a788-75de2a116121 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:45.441771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db55871-bcfa-4b23-a788-75de2a116121 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:45.443125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db55871-bcfa-4b23-a788-75de2a116121 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4db55871-bcfa-4b23-a788-75de2a116121 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:45.454626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:45.455649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:45.457184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 463/931] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:46:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:45.458046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db55871-bcfa-4b23-a788-75de2a116121 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:45.507840 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16264f4-3ecb-4d93-a7db-3cc7a1e918a6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:45.541948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9f1d2-c253-4876-9fcb-b6aa941cedc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:45.543314 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9f1d2-c253-4876-9fcb-b6aa941cedc6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:45.543598 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9f1d2-c253-4876-9fcb-b6aa941cedc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:45.543874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9f1d2-c253-4876-9fcb-b6aa941cedc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:45.553946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9f1d2-c253-4876-9fcb-b6aa941cedc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:45.555397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9f1d2-c253-4876-9fcb-b6aa941cedc6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:45.555695 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db55871-bcfa-4b23-a788-75de2a116121 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e3f9f1d2-c253-4876-9fcb-b6aa941cedc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:45.573169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:45.574356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:45.575660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:45.575660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:45.575660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:45.575660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:45.575660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 469/932] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:45.575660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9f1d2-c253-4876-9fcb-b6aa941cedc6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:45.593893 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f2ae7-0782-4a6a-85db-1f70ba9c38e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:45.594558 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f2ae7-0782-4a6a-85db-1f70ba9c38e7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:45.594840 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f2ae7-0782-4a6a-85db-1f70ba9c38e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:45.595114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f2ae7-0782-4a6a-85db-1f70ba9c38e7 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:45.595792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f2ae7-0782-4a6a-85db-1f70ba9c38e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:45.597148 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f2ae7-0782-4a6a-85db-1f70ba9c38e7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:45.602849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 464/933] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 11 20:46:45 2022] GET /identity/v3/services => generated 1497 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 20:46:45.603608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f2ae7-0782-4a6a-85db-1f70ba9c38e7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:45.716626 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9f1d2-c253-4876-9fcb-b6aa941cedc6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:45.718057 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f2ae7-0782-4a6a-85db-1f70ba9c38e7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:45.754585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66f206-849a-46bb-b898-c120866bf306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:45.755547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66f206-849a-46bb-b898-c120866bf306 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:45.755922 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66f206-849a-46bb-b898-c120866bf306 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:45.756267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66f206-849a-46bb-b898-c120866bf306 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:45.757634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66f206-849a-46bb-b898-c120866bf306 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:45.758152 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66f206-849a-46bb-b898-c120866bf306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:45.759654 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66f206-849a-46bb-b898-c120866bf306 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:45.762252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdf9f3-a5b3-41de-84e8-b69c9209063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:45.763106 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf9f3-a5b3-41de-84e8-b69c9209063e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:45.763552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf9f3-a5b3-41de-84e8-b69c9209063e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:45.763972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdf9f3-a5b3-41de-84e8-b69c9209063e None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:45.764918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdf9f3-a5b3-41de-84e8-b69c9209063e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:45.765387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdf9f3-a5b3-41de-84e8-b69c9209063e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:45.765758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 470/934] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:46:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:45.767142 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdf9f3-a5b3-41de-84e8-b69c9209063e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:45.771331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66f206-849a-46bb-b898-c120866bf306 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:45.790584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 465/935] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:45.796411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdf9f3-a5b3-41de-84e8-b69c9209063e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:45.890822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66f206-849a-46bb-b898-c120866bf306 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:45.908773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdf9f3-a5b3-41de-84e8-b69c9209063e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:45.927062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd89099-4d77-4408-a624-a8288cdb2e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:45.927964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd89099-4d77-4408-a624-a8288cdb2e26 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:45.928401 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd89099-4d77-4408-a624-a8288cdb2e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:45.928828 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd89099-4d77-4408-a624-a8288cdb2e26 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:45.929715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd89099-4d77-4408-a624-a8288cdb2e26 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:45.930203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd89099-4d77-4408-a624-a8288cdb2e26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:45.931754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd89099-4d77-4408-a624-a8288cdb2e26 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:45.937517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 471/936] 10.222.0.35 () {56 vars in 1114 bytes} [Wed May 11 20:46:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:45.943223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ebccd-5e09-4365-a17a-824d13bfb662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:45.943503 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd89099-4d77-4408-a624-a8288cdb2e26 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:45.944167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ebccd-5e09-4365-a17a-824d13bfb662 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:45.944454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ebccd-5e09-4365-a17a-824d13bfb662 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:45.944742 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ebccd-5e09-4365-a17a-824d13bfb662 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:45.952983 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ebccd-5e09-4365-a17a-824d13bfb662 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:45.954474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ebccd-5e09-4365-a17a-824d13bfb662 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c08ebccd-5e09-4365-a17a-824d13bfb662 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:45.970329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:45.971484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:45.972476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:45.972476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:45.972476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:45.972476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:45.972476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:45.972476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:45.972476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:45.972476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:45.972476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 20:46:45.972476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:45.972476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 466/937] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 11 20:46:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:45.978211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ebccd-5e09-4365-a17a-824d13bfb662 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:46.062879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd89099-4d77-4408-a624-a8288cdb2e26 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:46.081333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ebccd-5e09-4365-a17a-824d13bfb662 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:46.099099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e00dcb-b3dd-4b39-9e64-7e562ffb1c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:46.099965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e00dcb-b3dd-4b39-9e64-7e562ffb1c2a None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:46.100400 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e00dcb-b3dd-4b39-9e64-7e562ffb1c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:46.100825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e00dcb-b3dd-4b39-9e64-7e562ffb1c2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:46.101777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e00dcb-b3dd-4b39-9e64-7e562ffb1c2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:46.103290 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e00dcb-b3dd-4b39-9e64-7e562ffb1c2a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:46.116666 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da2077-f205-4278-ad8c-fbb66f7830e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:46.117552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da2077-f205-4278-ad8c-fbb66f7830e9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:46.117900 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da2077-f205-4278-ad8c-fbb66f7830e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:46.118240 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da2077-f205-4278-ad8c-fbb66f7830e9 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:46.119147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da2077-f205-4278-ad8c-fbb66f7830e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:46.119514 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da2077-f205-4278-ad8c-fbb66f7830e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:46.121099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da2077-f205-4278-ad8c-fbb66f7830e9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:46.138842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 467/938] 10.222.0.35 () {56 vars in 1149 bytes} [Wed May 11 20:46:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:46.144270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da2077-f205-4278-ad8c-fbb66f7830e9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:46.225897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 472/939] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 11 20:46:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:46:46.254752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da2077-f205-4278-ad8c-fbb66f7830e9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:46.300497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bc004-4547-4021-b4d7-4dcc79dff8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:46.301298 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bc004-4547-4021-b4d7-4dcc79dff8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:46.301597 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bc004-4547-4021-b4d7-4dcc79dff8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:46.301874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bc004-4547-4021-b4d7-4dcc79dff8d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:46.314571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bc004-4547-4021-b4d7-4dcc79dff8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:46.316100 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bc004-4547-4021-b4d7-4dcc79dff8d3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-175bc004-4547-4021-b4d7-4dcc79dff8d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:46.336816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:46.337858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:46.338781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:46.338781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:46.338781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:46.338781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:46.338781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 468/940] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:46.344182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e00dcb-b3dd-4b39-9e64-7e562ffb1c2a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:46.456863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e00dcb-b3dd-4b39-9e64-7e562ffb1c2a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:46.492052 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb6003-b436-461b-a632-cca7d768308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:46.492645 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6003-b436-461b-a632-cca7d768308f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:46.492931 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6003-b436-461b-a632-cca7d768308f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:46.493207 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6003-b436-461b-a632-cca7d768308f None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:46.493971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb6003-b436-461b-a632-cca7d768308f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:46.494286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb6003-b436-461b-a632-cca7d768308f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:46.496184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb6003-b436-461b-a632-cca7d768308f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:46.508231 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 473/941] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:46.514260 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bc004-4547-4021-b4d7-4dcc79dff8d3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:46.615210 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bc004-4547-4021-b4d7-4dcc79dff8d3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:46.650173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e20b2e-221d-47f2-a6b8-7faeeacc687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:46.650970 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e20b2e-221d-47f2-a6b8-7faeeacc687e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:46.651257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e20b2e-221d-47f2-a6b8-7faeeacc687e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:46.651537 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e20b2e-221d-47f2-a6b8-7faeeacc687e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:46.658319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e20b2e-221d-47f2-a6b8-7faeeacc687e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:46.659764 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e20b2e-221d-47f2-a6b8-7faeeacc687e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-55e20b2e-221d-47f2-a6b8-7faeeacc687e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:46.673690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:46.674588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:46.675494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:46.675494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:46.675494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:46.675494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:46.675494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:46.675494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:46.675494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:46.675494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:46.675494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 469/942] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:46.682200 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb6003-b436-461b-a632-cca7d768308f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:46.784932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb6003-b436-461b-a632-cca7d768308f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:46.821768 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab6b5e-c44c-475e-bba4-d940a5a2604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:46.822446 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab6b5e-c44c-475e-bba4-d940a5a2604a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:46.822734 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab6b5e-c44c-475e-bba4-d940a5a2604a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:46.823008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab6b5e-c44c-475e-bba4-d940a5a2604a None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:46.823828 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab6b5e-c44c-475e-bba4-d940a5a2604a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:46.824142 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab6b5e-c44c-475e-bba4-d940a5a2604a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:46.825679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab6b5e-c44c-475e-bba4-d940a5a2604a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:46.839019 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 474/943] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:46.844794 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e20b2e-221d-47f2-a6b8-7faeeacc687e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:46.949116 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e20b2e-221d-47f2-a6b8-7faeeacc687e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:46.983424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5781ada-bbb6-4465-bfef-b5f93c4fd4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:46.984318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781ada-bbb6-4465-bfef-b5f93c4fd4b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:46.984603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781ada-bbb6-4465-bfef-b5f93c4fd4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:46.984881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5781ada-bbb6-4465-bfef-b5f93c4fd4b0 None admin] PATH_INFO: `/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/0c5f278013574823afa0ad70db22f866/roles/2ddc595bde9b4177b6b72d37bfe70957` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:46.987356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5781ada-bbb6-4465-bfef-b5f93c4fd4b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c03e5fec995436aa5424d2be2e268aa, user_id=0c5f278013574823afa0ad70db22f866, role_id=2ddc595bde9b4177b6b72d37bfe70957)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:46.988794 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5781ada-bbb6-4465-bfef-b5f93c4fd4b0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:47.051995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 470/944] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:46:46 2022] PUT /identity/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/0c5f278013574823afa0ad70db22f866/roles/2ddc595bde9b4177b6b72d37bfe70957 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 20:46:47.437386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88ea46-618a-4d33-9a99-4aee9d3c8a56 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:47.438121 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88ea46-618a-4d33-9a99-4aee9d3c8a56 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:47.438121 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88ea46-618a-4d33-9a99-4aee9d3c8a56 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:47.439534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 475/945] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:47.451117 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc1ed4-4a91-4312-9b0d-6ca9a6e26296 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:47.451636 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc1ed4-4a91-4312-9b0d-6ca9a6e26296 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:47.451712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc1ed4-4a91-4312-9b0d-6ca9a6e26296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:47.471978 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1bcc1ed4-4a91-4312-9b0d-6ca9a6e26296 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:47.473508 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1bcc1ed4-4a91-4312-9b0d-6ca9a6e26296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:47.541872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 471/946] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:47.563918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88ea46-618a-4d33-9a99-4aee9d3c8a56 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:47.666864 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88ea46-618a-4d33-9a99-4aee9d3c8a56 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:47.700961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c83a97-da7a-4c2a-8741-28690f40ed7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:47.702127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c83a97-da7a-4c2a-8741-28690f40ed7e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:47.702620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c83a97-da7a-4c2a-8741-28690f40ed7e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:47.703152 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c83a97-da7a-4c2a-8741-28690f40ed7e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:47.704063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c83a97-da7a-4c2a-8741-28690f40ed7e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:47.705726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c83a97-da7a-4c2a-8741-28690f40ed7e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d2c83a97-da7a-4c2a-8741-28690f40ed7e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:47.720953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:47.722039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:47.723484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:47.723484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:47.723484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:47.723484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:47.723484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:47.723484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:47.723484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:47.723484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:47.723484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:47.723484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:47.723484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:47.723484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:47.723484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 20:46:47.723484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:47.726501 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 476/947] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:47.733297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc1ed4-4a91-4312-9b0d-6ca9a6e26296 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:47.834520 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc1ed4-4a91-4312-9b0d-6ca9a6e26296 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:47.868940 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26d979-ca90-4a3c-b3d3-4e9b9933ef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:47.869622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26d979-ca90-4a3c-b3d3-4e9b9933ef58 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:47.869907 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26d979-ca90-4a3c-b3d3-4e9b9933ef58 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:47.870176 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26d979-ca90-4a3c-b3d3-4e9b9933ef58 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:47.871411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26d979-ca90-4a3c-b3d3-4e9b9933ef58 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:47.871756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26d979-ca90-4a3c-b3d3-4e9b9933ef58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:47.873119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26d979-ca90-4a3c-b3d3-4e9b9933ef58 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:47.878430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 472/948] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 11 20:46:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:47.884109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c83a97-da7a-4c2a-8741-28690f40ed7e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:47.919879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d48258-212d-400a-9061-af9cb7b449bb None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:47.920505 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d48258-212d-400a-9061-af9cb7b449bb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:47.920989 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d48258-212d-400a-9061-af9cb7b449bb None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:47.922879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 473/949] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:46:47.928205 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b29bae-b585-49ba-af5d-c78db39285d2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:47.928726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b29bae-b585-49ba-af5d-c78db39285d2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:47.929208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b29bae-b585-49ba-af5d-c78db39285d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:47.946217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b2b29bae-b585-49ba-af5d-c78db39285d2 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:47.947696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b2b29bae-b585-49ba-af5d-c78db39285d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:47.996735 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c83a97-da7a-4c2a-8741-28690f40ed7e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:48.021793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 474/950] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:46:48.034386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3570e-171e-4bc4-84a0-40df89fbab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:48.035102 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3570e-171e-4bc4-84a0-40df89fbab90 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:48.035386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3570e-171e-4bc4-84a0-40df89fbab90 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:48.035665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3570e-171e-4bc4-84a0-40df89fbab90 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:48.036408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3570e-171e-4bc4-84a0-40df89fbab90 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:48.036720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3570e-171e-4bc4-84a0-40df89fbab90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:48.038159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3570e-171e-4bc4-84a0-40df89fbab90 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:48.042372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b29bae-b585-49ba-af5d-c78db39285d2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:48.042986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 477/951] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 11 20:46:47 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:48.155859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b29bae-b585-49ba-af5d-c78db39285d2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:48.195745 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82e5a5-54e9-4693-9488-7ac04f0e5038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:48.196935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e5a5-54e9-4693-9488-7ac04f0e5038 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:48.197453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e5a5-54e9-4693-9488-7ac04f0e5038 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:48.198003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e5a5-54e9-4693-9488-7ac04f0e5038 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:48.199481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82e5a5-54e9-4693-9488-7ac04f0e5038 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:48.201086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82e5a5-54e9-4693-9488-7ac04f0e5038 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ae82e5a5-54e9-4693-9488-7ac04f0e5038 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:48.214268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:48.215397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:48.216304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:48.216304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:48.216304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:48.216304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:48.216304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:48.216304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:48.216304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:48.216304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:48.216304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:48.216304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:48.216304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:48.216304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:48.216304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:48.216304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:48.219340 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 475/952] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 11 20:46:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:48.225600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3570e-171e-4bc4-84a0-40df89fbab90 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:48.333349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3570e-171e-4bc4-84a0-40df89fbab90 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:48.367076 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af8d86-da22-471d-b294-d45b0f58485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:48.368129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af8d86-da22-471d-b294-d45b0f58485d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:48.368619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af8d86-da22-471d-b294-d45b0f58485d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:48.369101 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af8d86-da22-471d-b294-d45b0f58485d None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:48.370111 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af8d86-da22-471d-b294-d45b0f58485d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:48.371201 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af8d86-da22-471d-b294-d45b0f58485d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:48.374138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af8d86-da22-471d-b294-d45b0f58485d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:48.380370 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 478/953] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 11 20:46:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:48.386547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82e5a5-54e9-4693-9488-7ac04f0e5038 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:48.490943 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82e5a5-54e9-4693-9488-7ac04f0e5038 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:48.527237 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075c9d0-efee-4406-94a7-93e200dcfbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:48.528319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c9d0-efee-4406-94a7-93e200dcfbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:48.528807 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c9d0-efee-4406-94a7-93e200dcfbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:48.529318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c9d0-efee-4406-94a7-93e200dcfbf9 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:48.530251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075c9d0-efee-4406-94a7-93e200dcfbf9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:48.530804 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075c9d0-efee-4406-94a7-93e200dcfbf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:48.532421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075c9d0-efee-4406-94a7-93e200dcfbf9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:48.538035 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 476/954] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 11 20:46:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:48.544505 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af8d86-da22-471d-b294-d45b0f58485d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:48.578328 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c2913-9d06-4286-8ae6-0d541a65778c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:48.578683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c2913-9d06-4286-8ae6-0d541a65778c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:48.578891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c2913-9d06-4286-8ae6-0d541a65778c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:48.580521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 477/955] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:46:48.585583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7b3ee-6942-4f7b-96d9-ec0339d0d234 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:48.585817 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7b3ee-6942-4f7b-96d9-ec0339d0d234 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:48.586095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7b3ee-6942-4f7b-96d9-ec0339d0d234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:48.602954 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5ab7b3ee-6942-4f7b-96d9-ec0339d0d234 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:48.604181 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5ab7b3ee-6942-4f7b-96d9-ec0339d0d234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:48.660626 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af8d86-da22-471d-b294-d45b0f58485d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:48.674509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 478/956] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:46:48.696456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7b3ee-6942-4f7b-96d9-ec0339d0d234 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:48.697780 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af87f4-f027-4223-a663-7820c41f29f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:48.698828 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af87f4-f027-4223-a663-7820c41f29f1 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:48.699298 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af87f4-f027-4223-a663-7820c41f29f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:48.700655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af87f4-f027-4223-a663-7820c41f29f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:48.701603 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af87f4-f027-4223-a663-7820c41f29f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:48.703185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af87f4-f027-4223-a663-7820c41f29f1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:48.789703 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 479/957] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 11 20:46:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:46:48.804224 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7b3ee-6942-4f7b-96d9-ec0339d0d234 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:48.862704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6dc5c-7cb4-43d3-89af-1bd7805cb740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:48.863379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6dc5c-7cb4-43d3-89af-1bd7805cb740 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:48.863662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6dc5c-7cb4-43d3-89af-1bd7805cb740 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:48.863939 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6dc5c-7cb4-43d3-89af-1bd7805cb740 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:48.864637 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6dc5c-7cb4-43d3-89af-1bd7805cb740 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:48.866137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6dc5c-7cb4-43d3-89af-1bd7805cb740 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:48.867700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: WARNING keystone.server.flask.common [None req-e1c6dc5c-7cb4-43d3-89af-1bd7805cb740 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 11 20:46:48.913138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.sql.core [None req-e1c6dc5c-7cb4-43d3-89af-1bd7805cb740 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 20:46:48.913138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 20:46:48.913138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [parameters: {'id': '3e70d8943a6c44998fb7bcd5941ef1fb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 20:46:48.913138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80192) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 20:46:48.931944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e1c6dc5c-7cb4-43d3-89af-1bd7805cb740 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3e70d8943a6c44998fb7bcd5941ef1fb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3e70d8943a6c44998fb7bcd5941ef1fb. May 11 20:46:48.931944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:48.931944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 20:46:48.931944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 20:46:48.931944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 20:46:48.931944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 20:46:48.931944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 20:46:48.931944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application result = self._query(query) May 11 20:46:48.931944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 20:46:48.931944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application conn.query(q) May 11 20:46:48.931944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 20:46:48.931944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 20:46:48.931944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application result.read() May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 11 20:46:48.932845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return project_ref.to_dict() May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application next(self.gen) May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application yield resource May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application next(self.gen) May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.session.rollback() May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.force_reraise() May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise self.value May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application session.commit() May 11 20:46:48.933949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._prepare_impl() May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.session.flush() May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._flush(objects) May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application compat.raise_( May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application flush_context.execute() May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 20:46:48.934937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rec.execute(self) May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application c = connection._execute_20( May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 20:46:48.935867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application result = self._query(query) May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application conn.query(q) May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application result.read() May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 20:46:48.936696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [parameters: {'id': '3e70d8943a6c44998fb7bcd5941ef1fb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:48.938972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:48.941147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:48.945372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:48.945372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 11 20:46:48.945372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 11 20:46:48.945372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:48.945372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:48.945372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 11 20:46:48.945372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.Conflict( May 11 20:46:48.945372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3e70d8943a6c44998fb7bcd5941ef1fb. May 11 20:46:48.945372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:48.945372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 479/958] 10.222.0.35 () {60 vars in 1140 bytes} [Wed May 11 20:46:48 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:48.946711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af87f4-f027-4223-a663-7820c41f29f1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:49.048276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af87f4-f027-4223-a663-7820c41f29f1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:49.080760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cef3b-e86e-4235-a527-18ed2aae4664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:49.081587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cef3b-e86e-4235-a527-18ed2aae4664 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:49.081875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cef3b-e86e-4235-a527-18ed2aae4664 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:49.082150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cef3b-e86e-4235-a527-18ed2aae4664 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:49.089335 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cef3b-e86e-4235-a527-18ed2aae4664 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:49.091430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cef3b-e86e-4235-a527-18ed2aae4664 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b46cef3b-e86e-4235-a527-18ed2aae4664 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:49.110026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:49.110986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:49.111912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:49.111912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:49.111912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:49.111912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:49.111912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:49.111912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:49.111912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:49.111912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:49.116242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 480/959] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:49.118117 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6dc5c-7cb4-43d3-89af-1bd7805cb740 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:49.223278 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6dc5c-7cb4-43d3-89af-1bd7805cb740 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:49.260372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a1726-5726-4164-a51a-6cde1e6768c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:49.261488 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a1726-5726-4164-a51a-6cde1e6768c1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:49.262014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a1726-5726-4164-a51a-6cde1e6768c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:49.262492 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a1726-5726-4164-a51a-6cde1e6768c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:49.263451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a1726-5726-4164-a51a-6cde1e6768c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:49.263959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a1726-5726-4164-a51a-6cde1e6768c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:49.266024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a1726-5726-4164-a51a-6cde1e6768c1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:49.287007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d487a-19c5-4638-b65c-0b9218091701 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:49.287460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d487a-19c5-4638-b65c-0b9218091701 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:49.287566 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d487a-19c5-4638-b65c-0b9218091701 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:49.288006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 480/960] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 11 20:46:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:49.289573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 481/961] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:49.295595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6340f9b-8e75-4de2-9ba3-6d64ac6ca371 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:49.295890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6340f9b-8e75-4de2-9ba3-6d64ac6ca371 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:49.296163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6340f9b-8e75-4de2-9ba3-6d64ac6ca371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:49.315732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e6340f9b-8e75-4de2-9ba3-6d64ac6ca371 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:49.317311 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e6340f9b-8e75-4de2-9ba3-6d64ac6ca371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:49.399167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 481/962] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:49.422839 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d487a-19c5-4638-b65c-0b9218091701 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:49.532367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d487a-19c5-4638-b65c-0b9218091701 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:49.568741 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbbfcd-4854-4110-a44e-d0506ef27fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:49.569688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbbfcd-4854-4110-a44e-d0506ef27fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:49.569977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbbfcd-4854-4110-a44e-d0506ef27fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:49.570253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbbfcd-4854-4110-a44e-d0506ef27fd8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:49.580915 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbbfcd-4854-4110-a44e-d0506ef27fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e4fbbfcd-4854-4110-a44e-d0506ef27fd8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:49.589819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:49.590772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:49.592193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:49.592193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:49.592193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:49.592193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:49.592193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:49.592193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:49.592193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:49.592193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:49.592193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:49.592193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:49.592193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 20:46:49.592193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:49.592193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 482/963] 10.222.0.35 () {56 vars in 1120 bytes} [Wed May 11 20:46:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:49.596975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6340f9b-8e75-4de2-9ba3-6d64ac6ca371 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:49.699075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6340f9b-8e75-4de2-9ba3-6d64ac6ca371 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:49.735466 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92039cd-65ee-4732-acd4-9b7d7ce0d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:49.736139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92039cd-65ee-4732-acd4-9b7d7ce0d76b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:49.736421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92039cd-65ee-4732-acd4-9b7d7ce0d76b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:49.736697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92039cd-65ee-4732-acd4-9b7d7ce0d76b None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:49.737443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92039cd-65ee-4732-acd4-9b7d7ce0d76b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:49.737775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92039cd-65ee-4732-acd4-9b7d7ce0d76b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:49.739156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92039cd-65ee-4732-acd4-9b7d7ce0d76b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:49.748146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 482/964] 10.222.0.35 () {56 vars in 1115 bytes} [Wed May 11 20:46:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:49.753503 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbbfcd-4854-4110-a44e-d0506ef27fd8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:49.855578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbbfcd-4854-4110-a44e-d0506ef27fd8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:49.889677 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b7883-caa3-4443-944b-6214040c7d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:49.890482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b7883-caa3-4443-944b-6214040c7d3d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:49.890767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b7883-caa3-4443-944b-6214040c7d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:49.891046 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b7883-caa3-4443-944b-6214040c7d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:49.902688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b7883-caa3-4443-944b-6214040c7d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:49.904145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b7883-caa3-4443-944b-6214040c7d3d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-1b1b7883-caa3-4443-944b-6214040c7d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:49.921399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:49.922368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:49.923836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:49.923836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:49.923836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:49.923836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:49.923836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 483/965] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:49.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92039cd-65ee-4732-acd4-9b7d7ce0d76b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:50.031664 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92039cd-65ee-4732-acd4-9b7d7ce0d76b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:50.068132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ff85c-e9c3-4cb9-a84d-6454d62046cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:50.068804 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ff85c-e9c3-4cb9-a84d-6454d62046cc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:50.069092 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ff85c-e9c3-4cb9-a84d-6454d62046cc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:50.069371 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ff85c-e9c3-4cb9-a84d-6454d62046cc None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:50.070130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ff85c-e9c3-4cb9-a84d-6454d62046cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:50.070441 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ff85c-e9c3-4cb9-a84d-6454d62046cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:50.071812 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ff85c-e9c3-4cb9-a84d-6454d62046cc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:50.084708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 483/966] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:50.090701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b7883-caa3-4443-944b-6214040c7d3d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:50.194712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b7883-caa3-4443-944b-6214040c7d3d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:50.231222 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332aaa4-a722-4a6e-92da-e61c20b4e4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:50.232051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332aaa4-a722-4a6e-92da-e61c20b4e4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:50.232339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332aaa4-a722-4a6e-92da-e61c20b4e4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:50.232618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332aaa4-a722-4a6e-92da-e61c20b4e4f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:50.241072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332aaa4-a722-4a6e-92da-e61c20b4e4f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:50.242563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332aaa4-a722-4a6e-92da-e61c20b4e4f5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-1332aaa4-a722-4a6e-92da-e61c20b4e4f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:50.257680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:50.259977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:50.262773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:50.262773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:50.262773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:50.262773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:50.262773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:50.262773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:50.262773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:50.262773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:50.262773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 11 20:46:50.262773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:50.262773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 484/967] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 11 20:46:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:50.265866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ff85c-e9c3-4cb9-a84d-6454d62046cc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:50.371290 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ff85c-e9c3-4cb9-a84d-6454d62046cc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:50.383198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54313deb-5958-416e-bd3a-f408736660d1 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:50.384114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54313deb-5958-416e-bd3a-f408736660d1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:50.384114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54313deb-5958-416e-bd3a-f408736660d1 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:50.385408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 485/968] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:46:50.392464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a01ad-6152-4d65-a1c4-05f090a9d28d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:50.392994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a01ad-6152-4d65-a1c4-05f090a9d28d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:50.393480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a01ad-6152-4d65-a1c4-05f090a9d28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:50.408845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984795f-1d8c-41b6-8791-6db12927af7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:50.409521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984795f-1d8c-41b6-8791-6db12927af7f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:50.409839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984795f-1d8c-41b6-8791-6db12927af7f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:50.410119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984795f-1d8c-41b6-8791-6db12927af7f None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:50.410960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984795f-1d8c-41b6-8791-6db12927af7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:50.411271 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984795f-1d8c-41b6-8791-6db12927af7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:50.412620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-208a01ad-6152-4d65-a1c4-05f090a9d28d None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:50.412804 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984795f-1d8c-41b6-8791-6db12927af7f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:50.414233 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-208a01ad-6152-4d65-a1c4-05f090a9d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:50.430432 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 484/969] 10.222.0.35 () {56 vars in 1149 bytes} [Wed May 11 20:46:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:50.438192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984795f-1d8c-41b6-8791-6db12927af7f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:50.492411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 486/970] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:46:50.514951 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a01ad-6152-4d65-a1c4-05f090a9d28d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:50.560345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984795f-1d8c-41b6-8791-6db12927af7f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:50.596501 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb469737-deab-4511-9f79-d1189dea378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:50.597020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb469737-deab-4511-9f79-d1189dea378a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:50.597583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb469737-deab-4511-9f79-d1189dea378a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:50.597583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb469737-deab-4511-9f79-d1189dea378a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:50.633031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a01ad-6152-4d65-a1c4-05f090a9d28d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:50.665910 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb469737-deab-4511-9f79-d1189dea378a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:50.667332 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb469737-deab-4511-9f79-d1189dea378a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:50.675958 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bf88b-c1bd-44bf-97ef-18e0c87625f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:50.676807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bf88b-c1bd-44bf-97ef-18e0c87625f0 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:50.677637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bf88b-c1bd-44bf-97ef-18e0c87625f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:50.678077 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bf88b-c1bd-44bf-97ef-18e0c87625f0 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:50.679526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bf88b-c1bd-44bf-97ef-18e0c87625f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:50.681302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bf88b-c1bd-44bf-97ef-18e0c87625f0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:50.769648 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 485/971] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:46:50 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:46:50.769868 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 487/972] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 11 20:46:50 2022] POST /identity/v3/services => generated 242 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 20:46:50.771654 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb469737-deab-4511-9f79-d1189dea378a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:50.884768 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb469737-deab-4511-9f79-d1189dea378a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:50.930198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce8e38-589e-4bae-ac4a-e5ba6a72bae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:50.931009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce8e38-589e-4bae-ac4a-e5ba6a72bae3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:50.931298 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce8e38-589e-4bae-ac4a-e5ba6a72bae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:50.931626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce8e38-589e-4bae-ac4a-e5ba6a72bae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:50.943571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce8e38-589e-4bae-ac4a-e5ba6a72bae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:50.945102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce8e38-589e-4bae-ac4a-e5ba6a72bae3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-14ce8e38-589e-4bae-ac4a-e5ba6a72bae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:50.964668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:50.966337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:50.967427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:50.967427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:50.967427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:50.967427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:50.967427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 486/973] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:50.973425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bf88b-c1bd-44bf-97ef-18e0c87625f0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:51.084192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bf88b-c1bd-44bf-97ef-18e0c87625f0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:51.118042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb416e-4c3d-427a-8ef4-88d60dab63d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:51.118718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb416e-4c3d-427a-8ef4-88d60dab63d5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:51.119005 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb416e-4c3d-427a-8ef4-88d60dab63d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:51.119286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb416e-4c3d-427a-8ef4-88d60dab63d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:51.120016 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb416e-4c3d-427a-8ef4-88d60dab63d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:51.120344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb416e-4c3d-427a-8ef4-88d60dab63d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:51.122261 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb416e-4c3d-427a-8ef4-88d60dab63d5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:51.134508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 488/974] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:51.140671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce8e38-589e-4bae-ac4a-e5ba6a72bae3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:51.206058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fc9fd-e56f-45b1-8c30-0758fe5fe2f8 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:51.206387 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fc9fd-e56f-45b1-8c30-0758fe5fe2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:51.206617 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fc9fd-e56f-45b1-8c30-0758fe5fe2f8 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:51.209295 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 489/975] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:51.213346 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99475c-5d50-4c63-a7dd-b1af24f894b5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:51.213682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99475c-5d50-4c63-a7dd-b1af24f894b5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:51.213966 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99475c-5d50-4c63-a7dd-b1af24f894b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:51.230827 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ac99475c-5d50-4c63-a7dd-b1af24f894b5 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:51.232006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ac99475c-5d50-4c63-a7dd-b1af24f894b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:51.251335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce8e38-589e-4bae-ac4a-e5ba6a72bae3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:51.286464 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8099-6671-483e-801c-e79478fd28a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:51.287294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8099-6671-483e-801c-e79478fd28a1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:51.287579 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8099-6671-483e-801c-e79478fd28a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:51.288215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8099-6671-483e-801c-e79478fd28a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:51.295577 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d8099-6671-483e-801c-e79478fd28a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:51.297029 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d8099-6671-483e-801c-e79478fd28a1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8c8d8099-6671-483e-801c-e79478fd28a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:46:51.311623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:51.312615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:51.313573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:46:51.313573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:46:51.313573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:46:51.313573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:46:51.313573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:46:51.313573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:46:51.313573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:46:51.313573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:51.313573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 487/976] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:51.318246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8099-6671-483e-801c-e79478fd28a1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:51.321632 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 490/977] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:46:51.344547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99475c-5d50-4c63-a7dd-b1af24f894b5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:51.453792 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99475c-5d50-4c63-a7dd-b1af24f894b5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:51.454366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8099-6671-483e-801c-e79478fd28a1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:51.492112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69557c47-48a8-4e1e-8756-c96c53752c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:51.492998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69557c47-48a8-4e1e-8756-c96c53752c36 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:51.493215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69557c47-48a8-4e1e-8756-c96c53752c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:51.493493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69557c47-48a8-4e1e-8756-c96c53752c36 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:51.494191 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69557c47-48a8-4e1e-8756-c96c53752c36 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:51.496577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69557c47-48a8-4e1e-8756-c96c53752c36 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:51.498913 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b7fd-ebaa-4010-abef-bec8f7220658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:51.500137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b7fd-ebaa-4010-abef-bec8f7220658 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:51.500895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b7fd-ebaa-4010-abef-bec8f7220658 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:51.501383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b7fd-ebaa-4010-abef-bec8f7220658 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:51.502419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10b7fd-ebaa-4010-abef-bec8f7220658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:51.502939 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10b7fd-ebaa-4010-abef-bec8f7220658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:51.504602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10b7fd-ebaa-4010-abef-bec8f7220658 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-69557c47-48a8-4e1e-8756-c96c53752c36 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:51.509208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:51.510355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:51.511305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:51.511305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:51.511305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:51.511305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:51.511305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:51.511305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:51.511305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:51.511305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:51.511305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:51.511305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:51.511305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:51.511305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:51.511305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:51.511305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:51.516148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 491/978] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 11 20:46:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:51.516951 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69557c47-48a8-4e1e-8756-c96c53752c36 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:51.522851 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 488/979] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:51.528971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b7fd-ebaa-4010-abef-bec8f7220658 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:51.633848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b7fd-ebaa-4010-abef-bec8f7220658 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:51.641459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69557c47-48a8-4e1e-8756-c96c53752c36 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:51.668151 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de146379-16b6-48c7-be2e-4a0d6c8f0f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:51.668813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de146379-16b6-48c7-be2e-4a0d6c8f0f6f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:51.669097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de146379-16b6-48c7-be2e-4a0d6c8f0f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:51.669371 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de146379-16b6-48c7-be2e-4a0d6c8f0f6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:51.670241 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de146379-16b6-48c7-be2e-4a0d6c8f0f6f None admin] RBAC: Adding query filter params (role.id=2ddc595bde9b4177b6b72d37bfe70957, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=0c5f278013574823afa0ad70db22f866) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:51.670554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de146379-16b6-48c7-be2e-4a0d6c8f0f6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:51.671988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de146379-16b6-48c7-be2e-4a0d6c8f0f6f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:51.675686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e707-bf63-4b44-8fc1-9d6b511d9484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:51.676610 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e707-bf63-4b44-8fc1-9d6b511d9484 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:51.677046 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e707-bf63-4b44-8fc1-9d6b511d9484 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:51.677464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e707-bf63-4b44-8fc1-9d6b511d9484 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:51.677952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 489/980] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:46:51 2022] GET /identity/v3/role_assignments?user.id=0c5f278013574823afa0ad70db22f866&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=2ddc595bde9b4177b6b72d37bfe70957 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:51.678502 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39e707-bf63-4b44-8fc1-9d6b511d9484 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:51.678936 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39e707-bf63-4b44-8fc1-9d6b511d9484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:51.679241 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4c7db-6918-4909-838b-65555f920783 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:51.679585 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4c7db-6918-4909-838b-65555f920783 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:51.679866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4c7db-6918-4909-838b-65555f920783 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:51.680850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39e707-bf63-4b44-8fc1-9d6b511d9484 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:51.681563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 490/981] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:51.687290 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07647a6-e38a-4ef1-971c-5f8dd8b169ce None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:51.687820 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07647a6-e38a-4ef1-971c-5f8dd8b169ce None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:51.688246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07647a6-e38a-4ef1-971c-5f8dd8b169ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:51.695631 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 492/982] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 11 20:46:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:51.697495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e707-bf63-4b44-8fc1-9d6b511d9484 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:51.709866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b07647a6-e38a-4ef1-971c-5f8dd8b169ce None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:51.711485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b07647a6-e38a-4ef1-971c-5f8dd8b169ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:51.801385 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 491/983] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:51.810322 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e707-bf63-4b44-8fc1-9d6b511d9484 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:51.827737 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07647a6-e38a-4ef1-971c-5f8dd8b169ce None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:51.858574 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee4a80-ec67-47c8-a0eb-08845d442730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:51.859729 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee4a80-ec67-47c8-a0eb-08845d442730 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:51.860216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee4a80-ec67-47c8-a0eb-08845d442730 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:51.860730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee4a80-ec67-47c8-a0eb-08845d442730 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:51.861691 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee4a80-ec67-47c8-a0eb-08845d442730 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:51.862261 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee4a80-ec67-47c8-a0eb-08845d442730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:51.863864 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee4a80-ec67-47c8-a0eb-08845d442730 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:51.869745 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 493/984] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 11 20:46:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:51.876193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee4a80-ec67-47c8-a0eb-08845d442730 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:51.972443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07647a6-e38a-4ef1-971c-5f8dd8b169ce None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:52.005128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee4a80-ec67-47c8-a0eb-08845d442730 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:52.007048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aa596-1fb4-4f7c-a1ec-6fba9a1c0c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:52.007824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aa596-1fb4-4f7c-a1ec-6fba9a1c0c3f None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:52.008853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aa596-1fb4-4f7c-a1ec-6fba9a1c0c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:52.008853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aa596-1fb4-4f7c-a1ec-6fba9a1c0c3f None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:52.009206 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2aa596-1fb4-4f7c-a1ec-6fba9a1c0c3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:52.010753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2aa596-1fb4-4f7c-a1ec-6fba9a1c0c3f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:52.041361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e67d4-2d98-4d8a-9b1f-0e451d527cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:52.042057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e67d4-2d98-4d8a-9b1f-0e451d527cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:52.042870 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e67d4-2d98-4d8a-9b1f-0e451d527cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:52.043148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e67d4-2d98-4d8a-9b1f-0e451d527cf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:52.043944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e67d4-2d98-4d8a-9b1f-0e451d527cf5 None admin] RBAC: Adding query filter params (interface=admin, service_id=57110beeded540488fdf5a2b54c822d3, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:52.044257 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e67d4-2d98-4d8a-9b1f-0e451d527cf5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:52.045661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e67d4-2d98-4d8a-9b1f-0e451d527cf5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:52.050996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 494/985] 10.222.0.35 () {56 vars in 1249 bytes} [Wed May 11 20:46:51 2022] GET /identity/v3/endpoints?service_id=57110beeded540488fdf5a2b54c822d3&interface=admin®ion_id=RegionOne => generated 193 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:52.056473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e67d4-2d98-4d8a-9b1f-0e451d527cf5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:52.057041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.sql.core [None req-db2aa596-1fb4-4f7c-a1ec-6fba9a1c0c3f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 20:46:52.057041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 20:46:52.057041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [parameters: {'user_id': '166ecd242b1e436ab27a1da8dd23fc6a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 20:46:52.057041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80192) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-db2aa596-1fb4-4f7c-a1ec-6fba9a1c0c3f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application result = self._query(query) May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application conn.query(q) May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application result.read() May 11 20:46:52.067204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 20:46:52.068129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application next(self.gen) May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application yield resource May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application next(self.gen) May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.session.rollback() May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.force_reraise() May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise self.value May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application session.commit() May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 11 20:46:52.069138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._prepare_impl() May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.session.flush() May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._flush(objects) May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application compat.raise_( May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application flush_context.execute() May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rec.execute(self) May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 11 20:46:52.070163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application _emit_insert_statements( May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application result = connection._execute_20( May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ret = self._execute_context( May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 11 20:46:52.071112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self.dialect.do_execute( May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application result = self._query(query) May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application conn.query(q) May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application result.read() May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 11 20:46:52.071979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application packet.raise_for_error() May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [parameters: {'user_id': '166ecd242b1e436ab27a1da8dd23fc6a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:52.072845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 11 20:46:52.075114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 11 20:46:52.077349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 11 20:46:52.077349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 11 20:46:52.077349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 11 20:46:52.077349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 11 20:46:52.077349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 11 20:46:52.077349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:52.077349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 492/986] 10.222.0.35 () {60 vars in 1131 bytes} [Wed May 11 20:46:51 2022] POST /identity/v3/users => generated 160 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:52.077349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aa596-1fb4-4f7c-a1ec-6fba9a1c0c3f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:52.185801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aa596-1fb4-4f7c-a1ec-6fba9a1c0c3f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:52.202579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e67d4-2d98-4d8a-9b1f-0e451d527cf5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:52.224885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aa922-4431-4a0d-bb12-741b0bbb7404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:52.226552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aa922-4431-4a0d-bb12-741b0bbb7404 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:52.227050 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aa922-4431-4a0d-bb12-741b0bbb7404 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:52.227668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aa922-4431-4a0d-bb12-741b0bbb7404 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:52.236468 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d192af-83e1-42dc-a20c-1ddf29dda9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:52.237204 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d192af-83e1-42dc-a20c-1ddf29dda9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:52.237615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d192af-83e1-42dc-a20c-1ddf29dda9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:52.237929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d192af-83e1-42dc-a20c-1ddf29dda9a6 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:52.238681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d192af-83e1-42dc-a20c-1ddf29dda9a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:52.239173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11aa922-4431-4a0d-bb12-741b0bbb7404 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:52.240282 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d192af-83e1-42dc-a20c-1ddf29dda9a6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:52.241378 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11aa922-4431-4a0d-bb12-741b0bbb7404 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:52.247652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 495/987] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 11 20:46:52 2022] GET /identity/v3/services => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a11aa922-4431-4a0d-bb12-741b0bbb7404 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:46:52.260018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:52.261145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:52.262167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:52.262167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:52.262167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:46:52.262167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:46:52.262167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:46:52.262167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:46:52.262167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:46:52.262167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:46:52.262167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 11 20:46:52.262167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:52.267805 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d192af-83e1-42dc-a20c-1ddf29dda9a6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:52.272684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 493/988] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:46:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:52.377913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d192af-83e1-42dc-a20c-1ddf29dda9a6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:52.415563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1104fb-6932-4214-940a-24e07bef2119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:52.416252 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1104fb-6932-4214-940a-24e07bef2119 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:52.416535 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1104fb-6932-4214-940a-24e07bef2119 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:52.416809 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1104fb-6932-4214-940a-24e07bef2119 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:52.418298 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1104fb-6932-4214-940a-24e07bef2119 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:52.418609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1104fb-6932-4214-940a-24e07bef2119 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:52.420076 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1104fb-6932-4214-940a-24e07bef2119 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:52.458786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 496/989] 10.222.0.35 () {56 vars in 1101 bytes} [Wed May 11 20:46:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:53.053980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07441164-b8c5-40d6-8138-c4eb8a746281 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:53.054497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07441164-b8c5-40d6-8138-c4eb8a746281 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:53.054575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07441164-b8c5-40d6-8138-c4eb8a746281 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:53.059375 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 494/990] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:53.064530 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d4922-dbf3-4bc9-b24d-8f840a2f8dd1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:53.064939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d4922-dbf3-4bc9-b24d-8f840a2f8dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:53.065129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d4922-dbf3-4bc9-b24d-8f840a2f8dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:53.082398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3c0d4922-dbf3-4bc9-b24d-8f840a2f8dd1 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:53.083568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3c0d4922-dbf3-4bc9-b24d-8f840a2f8dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:53.146282 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 497/991] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:53.168600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07441164-b8c5-40d6-8138-c4eb8a746281 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:53.262949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07441164-b8c5-40d6-8138-c4eb8a746281 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:53.294816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beada7-c8ae-486b-b1d4-a61b78589d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:53.295597 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beada7-c8ae-486b-b1d4-a61b78589d99 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:53.295877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beada7-c8ae-486b-b1d4-a61b78589d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:53.296148 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beada7-c8ae-486b-b1d4-a61b78589d99 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:53.296791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beada7-c8ae-486b-b1d4-a61b78589d99 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:53.298163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beada7-c8ae-486b-b1d4-a61b78589d99 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d8beada7-c8ae-486b-b1d4-a61b78589d99 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:53.309452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:53.310621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:53.311534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:53.311534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:53.311534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:53.311534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:53.311534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:53.311534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:53.311534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:53.311534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:53.311534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:53.311534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:53.311534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:53.311534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:53.311534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 20:46:53.311534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:53.313046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 495/992] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:53.316529 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d4922-dbf3-4bc9-b24d-8f840a2f8dd1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:53.413047 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d4922-dbf3-4bc9-b24d-8f840a2f8dd1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:53.445956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5933d-715d-4831-a516-650ba38bd34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:53.446632 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5933d-715d-4831-a516-650ba38bd34d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:53.446922 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5933d-715d-4831-a516-650ba38bd34d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:53.447203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5933d-715d-4831-a516-650ba38bd34d None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:53.447910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5933d-715d-4831-a516-650ba38bd34d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:53.448222 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5933d-715d-4831-a516-650ba38bd34d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:53.450256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5933d-715d-4831-a516-650ba38bd34d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:53.459518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 498/993] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 11 20:46:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:53.460579 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beada7-c8ae-486b-b1d4-a61b78589d99 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:53.557772 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beada7-c8ae-486b-b1d4-a61b78589d99 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:53.590498 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16036a72-91be-40a2-82dd-770cb072e0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:53.591169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16036a72-91be-40a2-82dd-770cb072e0ad None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:53.591456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16036a72-91be-40a2-82dd-770cb072e0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:53.591733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16036a72-91be-40a2-82dd-770cb072e0ad None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:53.592439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16036a72-91be-40a2-82dd-770cb072e0ad None admin] RBAC: Adding query filter params (type=compute) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:53.592750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16036a72-91be-40a2-82dd-770cb072e0ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:53.594144 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16036a72-91be-40a2-82dd-770cb072e0ad None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:53.603737 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 496/994] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 11 20:46:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:53.604715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5933d-715d-4831-a516-650ba38bd34d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:53.700087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5933d-715d-4831-a516-650ba38bd34d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:53.732062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd460349-c988-4c04-a499-79b57e1510a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:53.732722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd460349-c988-4c04-a499-79b57e1510a7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:53.733009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd460349-c988-4c04-a499-79b57e1510a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:53.733289 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd460349-c988-4c04-a499-79b57e1510a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:53.734114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd460349-c988-4c04-a499-79b57e1510a7 None admin] RBAC: Adding query filter params (interface=public, service_id=7ea52cbf16cb4b2aba9f94338c517570, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:53.734432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd460349-c988-4c04-a499-79b57e1510a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:53.735797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd460349-c988-4c04-a499-79b57e1510a7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:53.745022 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 499/995] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 11 20:46:53 2022] GET /identity/v3/endpoints?service_id=7ea52cbf16cb4b2aba9f94338c517570&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:53.746319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16036a72-91be-40a2-82dd-770cb072e0ad None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:53.853331 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16036a72-91be-40a2-82dd-770cb072e0ad None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:53.887390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e6958-f26b-477b-b9b8-f3ed889ee341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:53.888063 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e6958-f26b-477b-b9b8-f3ed889ee341 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:53.888350 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e6958-f26b-477b-b9b8-f3ed889ee341 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:53.888630 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e6958-f26b-477b-b9b8-f3ed889ee341 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:53.889316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e6958-f26b-477b-b9b8-f3ed889ee341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:53.890721 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e6958-f26b-477b-b9b8-f3ed889ee341 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:53.905565 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 497/996] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 11 20:46:53 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 20:46:54.019322 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc476b2-fc63-47e2-a315-6fabbaf222e7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:54.019519 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc476b2-fc63-47e2-a315-6fabbaf222e7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:54.019793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc476b2-fc63-47e2-a315-6fabbaf222e7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:54.021331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 500/997] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:54.026908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2453bd3-59d1-42e3-8931-321baf8b90bb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:54.027212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2453bd3-59d1-42e3-8931-321baf8b90bb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:54.027481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2453bd3-59d1-42e3-8931-321baf8b90bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:54.044937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d2453bd3-59d1-42e3-8931-321baf8b90bb None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:54.046520 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d2453bd3-59d1-42e3-8931-321baf8b90bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:54.115963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 498/998] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:54.138999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc476b2-fc63-47e2-a315-6fabbaf222e7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:54.236162 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc476b2-fc63-47e2-a315-6fabbaf222e7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:54.274245 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a5cbb-cb5e-4a9d-98cb-2719532eaeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:54.274965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a5cbb-cb5e-4a9d-98cb-2719532eaeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:54.275253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a5cbb-cb5e-4a9d-98cb-2719532eaeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:54.275534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a5cbb-cb5e-4a9d-98cb-2719532eaeb3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:54.276187 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a5cbb-cb5e-4a9d-98cb-2719532eaeb3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:54.277636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a5cbb-cb5e-4a9d-98cb-2719532eaeb3 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a59a5cbb-cb5e-4a9d-98cb-2719532eaeb3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:54.289083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:54.290173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:54.291049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 501/999] 10.222.0.35 () {56 vars in 1105 bytes} [Wed May 11 20:46:54 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:54.298733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2453bd3-59d1-42e3-8931-321baf8b90bb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:54.396732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2453bd3-59d1-42e3-8931-321baf8b90bb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:54.429835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f6346-994e-4b15-bffe-c2b1e9c948b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:54.430863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6346-994e-4b15-bffe-c2b1e9c948b2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:54.431351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6346-994e-4b15-bffe-c2b1e9c948b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:54.431874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f6346-994e-4b15-bffe-c2b1e9c948b2 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:54.433399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f6346-994e-4b15-bffe-c2b1e9c948b2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:54.433932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f6346-994e-4b15-bffe-c2b1e9c948b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:54.435509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f6346-994e-4b15-bffe-c2b1e9c948b2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:54.444759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 499/1000] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:54.446252 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a5cbb-cb5e-4a9d-98cb-2719532eaeb3 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:54.489957 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe9cf1-bd3e-4ab4-9035-75b43ff7e60b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:54.490283 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe9cf1-bd3e-4ab4-9035-75b43ff7e60b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:54.490539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe9cf1-bd3e-4ab4-9035-75b43ff7e60b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:54.492020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 500/1001] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:46:54.496924 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2b4a5-9484-42c6-83ed-94e84f82f4d8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:54.497217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2b4a5-9484-42c6-83ed-94e84f82f4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:54.497501 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2b4a5-9484-42c6-83ed-94e84f82f4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:54.514714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c8c2b4a5-9484-42c6-83ed-94e84f82f4d8 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:54.515913 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c8c2b4a5-9484-42c6-83ed-94e84f82f4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:54.544831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a5cbb-cb5e-4a9d-98cb-2719532eaeb3 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:54.578591 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b1fbe-d6ad-44e3-926c-5e76b2b1e084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:54.579466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b1fbe-d6ad-44e3-926c-5e76b2b1e084 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:54.579755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b1fbe-d6ad-44e3-926c-5e76b2b1e084 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:54.580046 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b1fbe-d6ad-44e3-926c-5e76b2b1e084 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:54.580746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b1fbe-d6ad-44e3-926c-5e76b2b1e084 None admin] RBAC: Adding query filter params (type=image) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:54.581055 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b1fbe-d6ad-44e3-926c-5e76b2b1e084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:54.585561 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 501/1002] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:46:54.585718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b1fbe-d6ad-44e3-926c-5e76b2b1e084 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:54.589576 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 502/1003] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:54.605476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2b4a5-9484-42c6-83ed-94e84f82f4d8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:54.708391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2b4a5-9484-42c6-83ed-94e84f82f4d8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:54.743414 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3d61b-09d7-4975-8b59-8904f0e09a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:54.744269 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3d61b-09d7-4975-8b59-8904f0e09a8c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:54.744560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3d61b-09d7-4975-8b59-8904f0e09a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:54.744832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3d61b-09d7-4975-8b59-8904f0e09a8c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:54.746042 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3d61b-09d7-4975-8b59-8904f0e09a8c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:54.747415 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3d61b-09d7-4975-8b59-8904f0e09a8c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-07c3d61b-09d7-4975-8b59-8904f0e09a8c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:54.759919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:54.767009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:54.767912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 502/1004] 10.222.0.35 () {56 vars in 1126 bytes} [Wed May 11 20:46:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:54.768824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b1fbe-d6ad-44e3-926c-5e76b2b1e084 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:54.868339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b1fbe-d6ad-44e3-926c-5e76b2b1e084 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:54.899802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13717ccf-34fd-4afe-94d5-984ffb65134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:54.900468 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13717ccf-34fd-4afe-94d5-984ffb65134d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:54.900749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13717ccf-34fd-4afe-94d5-984ffb65134d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:54.901025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13717ccf-34fd-4afe-94d5-984ffb65134d None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:54.902265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13717ccf-34fd-4afe-94d5-984ffb65134d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:54.902576 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13717ccf-34fd-4afe-94d5-984ffb65134d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:54.903941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13717ccf-34fd-4afe-94d5-984ffb65134d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:54.913060 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 503/1005] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 11 20:46:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:54.914038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3d61b-09d7-4975-8b59-8904f0e09a8c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:55.010650 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3d61b-09d7-4975-8b59-8904f0e09a8c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:55.045879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49162b1d-608b-4437-9d4b-e6ec96649cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:55.046545 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49162b1d-608b-4437-9d4b-e6ec96649cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:55.046826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49162b1d-608b-4437-9d4b-e6ec96649cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:55.047098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49162b1d-608b-4437-9d4b-e6ec96649cc7 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:55.047805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49162b1d-608b-4437-9d4b-e6ec96649cc7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:55.048111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49162b1d-608b-4437-9d4b-e6ec96649cc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:55.049554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49162b1d-608b-4437-9d4b-e6ec96649cc7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:55.060514 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 503/1006] 10.222.0.35 () {56 vars in 1122 bytes} [Wed May 11 20:46:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:55.060701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13717ccf-34fd-4afe-94d5-984ffb65134d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:55.158439 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13717ccf-34fd-4afe-94d5-984ffb65134d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:55.191232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3b13d-71df-410f-92ac-46fc3e6c3933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:55.191881 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3b13d-71df-410f-92ac-46fc3e6c3933 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:55.192161 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3b13d-71df-410f-92ac-46fc3e6c3933 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:55.192433 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3b13d-71df-410f-92ac-46fc3e6c3933 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:55.193163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3b13d-71df-410f-92ac-46fc3e6c3933 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:55.194553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3b13d-71df-410f-92ac-46fc3e6c3933 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:55.256149 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 504/1007] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 11 20:46:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 20:46:56.105341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2a3e5-05af-458a-873a-422bed65360b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:56.105879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2a3e5-05af-458a-873a-422bed65360b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:56.105879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2a3e5-05af-458a-873a-422bed65360b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:56.107350 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 504/1008] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:56.112438 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e27a-1078-4ae4-bccb-e3ab712bf78f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:56.112733 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e27a-1078-4ae4-bccb-e3ab712bf78f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:56.113015 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38e27a-1078-4ae4-bccb-e3ab712bf78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:56.129795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8a38e27a-1078-4ae4-bccb-e3ab712bf78f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:56.130965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8a38e27a-1078-4ae4-bccb-e3ab712bf78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:56.199119 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 505/1009] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:56 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:56.222001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2a3e5-05af-458a-873a-422bed65360b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:56.318623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2a3e5-05af-458a-873a-422bed65360b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:56.350678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f849c2-3f21-43c6-bab9-b77951ac03b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:56.351467 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f849c2-3f21-43c6-bab9-b77951ac03b1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:56.351754 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f849c2-3f21-43c6-bab9-b77951ac03b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:56.352029 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f849c2-3f21-43c6-bab9-b77951ac03b1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:56.352675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f849c2-3f21-43c6-bab9-b77951ac03b1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:56.354080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f849c2-3f21-43c6-bab9-b77951ac03b1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-40f849c2-3f21-43c6-bab9-b77951ac03b1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:56.366059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:56.367111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:56.367966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:56.367966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:56.367966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:56.367966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:56.367966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:56.367966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:56.367966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:56.367966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:56.367966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:56.367966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:56.367966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:56.367966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:56.367966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 11 20:46:56.367966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:56.369915 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 505/1010] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:46:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:56.374087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e27a-1078-4ae4-bccb-e3ab712bf78f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:56.468284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38e27a-1078-4ae4-bccb-e3ab712bf78f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:56.501112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28d5bd-0710-4755-b01c-27311aa4e535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:56.501801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28d5bd-0710-4755-b01c-27311aa4e535 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:56.502083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28d5bd-0710-4755-b01c-27311aa4e535 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:56.502354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28d5bd-0710-4755-b01c-27311aa4e535 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:56.503053 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28d5bd-0710-4755-b01c-27311aa4e535 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:56.503358 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28d5bd-0710-4755-b01c-27311aa4e535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:56.504719 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de28d5bd-0710-4755-b01c-27311aa4e535 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:56.513990 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 506/1011] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 11 20:46:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:56.515543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f849c2-3f21-43c6-bab9-b77951ac03b1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:56.610731 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f849c2-3f21-43c6-bab9-b77951ac03b1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:56.646436 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbaf8a-bbd4-488d-9355-0cf60a131aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:56.647026 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbaf8a-bbd4-488d-9355-0cf60a131aaf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:56.647301 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbaf8a-bbd4-488d-9355-0cf60a131aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:56.647570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbaf8a-bbd4-488d-9355-0cf60a131aaf None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:56.648270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbaf8a-bbd4-488d-9355-0cf60a131aaf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:56.648573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbaf8a-bbd4-488d-9355-0cf60a131aaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:56.649970 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbaf8a-bbd4-488d-9355-0cf60a131aaf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:56.659312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 506/1012] 10.222.0.35 () {56 vars in 1112 bytes} [Wed May 11 20:46:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:56.660859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28d5bd-0710-4755-b01c-27311aa4e535 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:56.756150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de28d5bd-0710-4755-b01c-27311aa4e535 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:56.788629 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43344f61-1793-480d-b00f-58e5792777f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:56.789291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43344f61-1793-480d-b00f-58e5792777f5 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:56.789601 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43344f61-1793-480d-b00f-58e5792777f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:56.789880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43344f61-1793-480d-b00f-58e5792777f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:56.790613 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43344f61-1793-480d-b00f-58e5792777f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:56.793138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43344f61-1793-480d-b00f-58e5792777f5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:56.803001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a0269-c68e-4b30-96e3-e235c04ac006 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:56.803297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a0269-c68e-4b30-96e3-e235c04ac006 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:56.803599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a0269-c68e-4b30-96e3-e235c04ac006 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:56.805081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 507/1013] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:46:56.810218 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a69b5-ece4-4eac-ac67-eecda9026023 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:56.810504 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a69b5-ece4-4eac-ac67-eecda9026023 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:56.810781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a69b5-ece4-4eac-ac67-eecda9026023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:56.827159 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f41a69b5-ece4-4eac-ac67-eecda9026023 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:56.828322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f41a69b5-ece4-4eac-ac67-eecda9026023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:56.870403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 507/1014] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 11 20:46:56 2022] POST /identity/v3/endpoints => generated 334 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:46:56.915447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 508/1015] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:56 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:46:56.928245 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43344f61-1793-480d-b00f-58e5792777f5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:57.035155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43344f61-1793-480d-b00f-58e5792777f5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:57.070828 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d8852-1bc4-4cfd-821a-40188a5d1f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:57.071501 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d8852-1bc4-4cfd-821a-40188a5d1f1e None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:57.071799 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d8852-1bc4-4cfd-821a-40188a5d1f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:57.072068 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d8852-1bc4-4cfd-821a-40188a5d1f1e None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:57.072798 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d8852-1bc4-4cfd-821a-40188a5d1f1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:57.074240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d8852-1bc4-4cfd-821a-40188a5d1f1e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:57.148355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 508/1016] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 11 20:46:56 2022] POST /identity/v3/services => generated 242 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:46:57.478196 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da085cfe-49bd-4f67-82bd-3e89c26d83ab None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:57.478719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da085cfe-49bd-4f67-82bd-3e89c26d83ab None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:57.478797 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da085cfe-49bd-4f67-82bd-3e89c26d83ab None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:57.480140 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 509/1017] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:57.485626 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09fc02-f940-41e3-9bd7-4f7b651a9132 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:57.486029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09fc02-f940-41e3-9bd7-4f7b651a9132 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:57.486210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09fc02-f940-41e3-9bd7-4f7b651a9132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:57.503489 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-af09fc02-f940-41e3-9bd7-4f7b651a9132 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:57.504651 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-af09fc02-f940-41e3-9bd7-4f7b651a9132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:57.575188 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 509/1018] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:57.598400 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da085cfe-49bd-4f67-82bd-3e89c26d83ab None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:57.697925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da085cfe-49bd-4f67-82bd-3e89c26d83ab None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:57.734824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffee03-a5db-444b-9e9f-356adb4f4c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:57.735969 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffee03-a5db-444b-9e9f-356adb4f4c49 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:57.736474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffee03-a5db-444b-9e9f-356adb4f4c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:57.736965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffee03-a5db-444b-9e9f-356adb4f4c49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:57.738378 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffee03-a5db-444b-9e9f-356adb4f4c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:57.740072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffee03-a5db-444b-9e9f-356adb4f4c49 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:57.742312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 510/1019] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:57.747766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09fc02-f940-41e3-9bd7-4f7b651a9132 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:57.844447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09fc02-f940-41e3-9bd7-4f7b651a9132 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:57.877133 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507d851-528b-4c74-b088-2a00490b7d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:57.877820 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507d851-528b-4c74-b088-2a00490b7d39 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:57.878102 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507d851-528b-4c74-b088-2a00490b7d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:57.878381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507d851-528b-4c74-b088-2a00490b7d39 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:57.879086 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507d851-528b-4c74-b088-2a00490b7d39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:57.880514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507d851-528b-4c74-b088-2a00490b7d39 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:57.973553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 510/1020] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 11 20:46:57 2022] POST /identity/v3/projects => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:46:59.208810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d93da4-2858-49f2-94db-a3ce9403cb70 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:59.209322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d93da4-2858-49f2-94db-a3ce9403cb70 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:59.209322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d93da4-2858-49f2-94db-a3ce9403cb70 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:59.210735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 511/1021] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:46:59.217391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c0326-6987-4abb-b7f5-817047e9821c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:59.218059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c0326-6987-4abb-b7f5-817047e9821c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:59.218059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c0326-6987-4abb-b7f5-817047e9821c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:59.235251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-958c0326-6987-4abb-b7f5-817047e9821c None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:59.236447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-958c0326-6987-4abb-b7f5-817047e9821c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:59.300517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 511/1022] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:46:59.324673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d93da4-2858-49f2-94db-a3ce9403cb70 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:59.387635 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5944aca-fc05-496e-b5eb-3c38ccd5e411 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:59.387956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5944aca-fc05-496e-b5eb-3c38ccd5e411 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:59.388207 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5944aca-fc05-496e-b5eb-3c38ccd5e411 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:59.389737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 512/1023] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:46:59.394565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f8d0-7da0-4778-951f-5b667c873d4d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:59.394855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f8d0-7da0-4778-951f-5b667c873d4d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:59.395139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f8d0-7da0-4778-951f-5b667c873d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:59.411666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1b02f8d0-7da0-4778-951f-5b667c873d4d None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:46:59.412843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1b02f8d0-7da0-4778-951f-5b667c873d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:46:59.423980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d93da4-2858-49f2-94db-a3ce9403cb70 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:59.457515 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a149-b5e9-4379-a407-a2d5e983e151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:59.458334 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a149-b5e9-4379-a407-a2d5e983e151 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:59.458614 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a149-b5e9-4379-a407-a2d5e983e151 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:59.458941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a149-b5e9-4379-a407-a2d5e983e151 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:59.468527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2a149-b5e9-4379-a407-a2d5e983e151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-84a2a149-b5e9-4379-a407-a2d5e983e151 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:46:59.476692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:59.478192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:59.479084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:59.479084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:59.479084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:59.479084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:59.479084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:46:59.479084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:46:59.479084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:46:59.479084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:46:59.479084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:46:59.479084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:46:59.479084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 20:46:59.479084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:59.480613 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 513/1024] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:46:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:46:59.480928 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 512/1025] 10.222.0.35 () {56 vars in 1120 bytes} [Wed May 11 20:46:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:59.484774 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02f8d0-7da0-4778-951f-5b667c873d4d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:59.499302 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a149-b5e9-4379-a407-a2d5e983e151 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:59.579403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02f8d0-7da0-4778-951f-5b667c873d4d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:59.595880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a149-b5e9-4379-a407-a2d5e983e151 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:59.615525 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed0c5d-5f9c-4e0c-ad4d-5248740d137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:59.616204 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed0c5d-5f9c-4e0c-ad4d-5248740d137c None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:59.616493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed0c5d-5f9c-4e0c-ad4d-5248740d137c None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:59.616772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed0c5d-5f9c-4e0c-ad4d-5248740d137c None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:59.617558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed0c5d-5f9c-4e0c-ad4d-5248740d137c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:59.617867 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed0c5d-5f9c-4e0c-ad4d-5248740d137c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:59.619250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed0c5d-5f9c-4e0c-ad4d-5248740d137c None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:59.632672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 514/1026] 10.222.0.35 () {56 vars in 1115 bytes} [Wed May 11 20:46:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:59.633638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed0c5d-5f9c-4e0c-ad4d-5248740d137c None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:59.633747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0603eaf-5093-4442-b38e-bf646c3a427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:59.634520 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0603eaf-5093-4442-b38e-bf646c3a427d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:59.634806 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0603eaf-5093-4442-b38e-bf646c3a427d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:59.635085 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0603eaf-5093-4442-b38e-bf646c3a427d None admin] PATH_INFO: `/v3/services/image` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:59.635765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0603eaf-5093-4442-b38e-bf646c3a427d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:59.637133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0603eaf-5093-4442-b38e-bf646c3a427d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f0603eaf-5093-4442-b38e-bf646c3a427d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:59.648805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:59.649878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:46:59.650774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 513/1027] 10.222.0.35 () {56 vars in 1105 bytes} [Wed May 11 20:46:59 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:46:59.658008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0603eaf-5093-4442-b38e-bf646c3a427d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:59.730363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed0c5d-5f9c-4e0c-ad4d-5248740d137c None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:59.758631 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0603eaf-5093-4442-b38e-bf646c3a427d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:59.763167 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fae891-74b3-436a-a62a-d57716e2f452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:59.763974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fae891-74b3-436a-a62a-d57716e2f452 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:59.764260 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fae891-74b3-436a-a62a-d57716e2f452 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:59.764539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fae891-74b3-436a-a62a-d57716e2f452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:59.775221 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fae891-74b3-436a-a62a-d57716e2f452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:59.776726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fae891-74b3-436a-a62a-d57716e2f452 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:59.793762 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2279c5-d3de-4e9f-ae08-7ace6a6f410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:59.794427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2279c5-d3de-4e9f-ae08-7ace6a6f410c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b2fae891-74b3-436a-a62a-d57716e2f452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:46:59.794652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:46:59.795528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:46:59.801486 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:46:59.801486 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:46:59.801486 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:46:59.801486 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:46:59.801742 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2279c5-d3de-4e9f-ae08-7ace6a6f410c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:59.801742 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2279c5-d3de-4e9f-ae08-7ace6a6f410c None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:59.801742 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2279c5-d3de-4e9f-ae08-7ace6a6f410c None admin] RBAC: Adding query filter params (name=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:59.801742 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2279c5-d3de-4e9f-ae08-7ace6a6f410c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:59.802000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 515/1028] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:46:59.802069 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2279c5-d3de-4e9f-ae08-7ace6a6f410c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:59.802136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fae891-74b3-436a-a62a-d57716e2f452 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:59.807122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 514/1029] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:59.808568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2279c5-d3de-4e9f-ae08-7ace6a6f410c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:59.906354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fae891-74b3-436a-a62a-d57716e2f452 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:59.910678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2279c5-d3de-4e9f-ae08-7ace6a6f410c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:46:59.939941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec712f1e-3ff3-4022-8220-d7020bc228d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:59.940609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec712f1e-3ff3-4022-8220-d7020bc228d1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:59.940895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec712f1e-3ff3-4022-8220-d7020bc228d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:59.941174 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec712f1e-3ff3-4022-8220-d7020bc228d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:59.941927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec712f1e-3ff3-4022-8220-d7020bc228d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:59.942239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec712f1e-3ff3-4022-8220-d7020bc228d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:59.943081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc82054-6cff-4940-88eb-877f2165b443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:46:59.943615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec712f1e-3ff3-4022-8220-d7020bc228d1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:59.943715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc82054-6cff-4940-88eb-877f2165b443 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:46:59.944001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc82054-6cff-4940-88eb-877f2165b443 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:46:59.944274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc82054-6cff-4940-88eb-877f2165b443 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:46:59.944965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc82054-6cff-4940-88eb-877f2165b443 None admin] RBAC: Adding query filter params (type=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:46:59.945268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc82054-6cff-4940-88eb-877f2165b443 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:46:59.946644 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc82054-6cff-4940-88eb-877f2165b443 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:46:59.951491 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 515/1030] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:46:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:46:59.955314 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 516/1031] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:46:59.959021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc82054-6cff-4940-88eb-877f2165b443 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:46:59.960399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec712f1e-3ff3-4022-8220-d7020bc228d1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:00.059186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc82054-6cff-4940-88eb-877f2165b443 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:00.059540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec712f1e-3ff3-4022-8220-d7020bc228d1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:00.092071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961265a3-6aa9-4090-9214-03843247e115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:00.092732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961265a3-6aa9-4090-9214-03843247e115 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:00.093017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961265a3-6aa9-4090-9214-03843247e115 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:00.093239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bfddf-af27-4372-8067-8d7669f08af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:00.093356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961265a3-6aa9-4090-9214-03843247e115 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:00.094101 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961265a3-6aa9-4090-9214-03843247e115 None admin] RBAC: Adding query filter params (interface=public, service_id=01404af305e84b5c90f831d5396a1db1, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:00.094417 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961265a3-6aa9-4090-9214-03843247e115 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:00.094820 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bfddf-af27-4372-8067-8d7669f08af0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:00.095315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bfddf-af27-4372-8067-8d7669f08af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:00.095782 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961265a3-6aa9-4090-9214-03843247e115 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:00.095994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961bfddf-af27-4372-8067-8d7669f08af0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:00.100828 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 516/1032] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 11 20:46:59 2022] GET /identity/v3/endpoints?service_id=01404af305e84b5c90f831d5396a1db1&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:00.103811 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961bfddf-af27-4372-8067-8d7669f08af0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:00.105670 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961bfddf-af27-4372-8067-8d7669f08af0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:00.106604 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961265a3-6aa9-4090-9214-03843247e115 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-961bfddf-af27-4372-8067-8d7669f08af0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:47:00.122088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:00.123084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:00.124057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:00.124057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:00.124057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:47:00.124057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:47:00.124057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:47:00.124057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:47:00.124057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:47:00.124057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:47:00.124057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 20:47:00.124057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:00.124057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 517/1033] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 11 20:46:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:47:00.129185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bfddf-af27-4372-8067-8d7669f08af0 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:00.206602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961265a3-6aa9-4090-9214-03843247e115 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:00.229183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961bfddf-af27-4372-8067-8d7669f08af0 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:00.238648 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e10f6f-11eb-4d37-a9d0-67a227ff40dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:00.239306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e10f6f-11eb-4d37-a9d0-67a227ff40dd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:00.239590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e10f6f-11eb-4d37-a9d0-67a227ff40dd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:00.239866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e10f6f-11eb-4d37-a9d0-67a227ff40dd None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:00.240545 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e10f6f-11eb-4d37-a9d0-67a227ff40dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:00.242005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e10f6f-11eb-4d37-a9d0-67a227ff40dd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:00.248775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 517/1034] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 11 20:47:00 2022] GET /identity/v3/services => generated 1957 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 20:47:00.249989 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ebd8-3b54-4542-938f-6ea1e9037317 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:00.250274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ebd8-3b54-4542-938f-6ea1e9037317 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:00.250556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ebd8-3b54-4542-938f-6ea1e9037317 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:00.253584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 518/1035] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:00.257501 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05f848-a046-4b87-82c5-145f08aced4a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:00.257826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05f848-a046-4b87-82c5-145f08aced4a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:00.258108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05f848-a046-4b87-82c5-145f08aced4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:00.264805 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a552e7-9474-4311-956a-9ca6b7eb3de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:00.265502 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a552e7-9474-4311-956a-9ca6b7eb3de8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:00.265830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a552e7-9474-4311-956a-9ca6b7eb3de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:00.266109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a552e7-9474-4311-956a-9ca6b7eb3de8 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:00.266980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a552e7-9474-4311-956a-9ca6b7eb3de8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:00.267485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a552e7-9474-4311-956a-9ca6b7eb3de8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:00.269253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a552e7-9474-4311-956a-9ca6b7eb3de8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:00.276201 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8d05f848-a046-4b87-82c5-145f08aced4a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:00.277425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8d05f848-a046-4b87-82c5-145f08aced4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:00.289177 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 518/1036] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 11 20:47:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:00.295759 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a552e7-9474-4311-956a-9ca6b7eb3de8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:00.353033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 519/1037] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:00.379217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05f848-a046-4b87-82c5-145f08aced4a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:00.399210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a552e7-9474-4311-956a-9ca6b7eb3de8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:00.436874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f61680-a4b4-46e6-b0cc-491c24c26e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:00.437554 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61680-a4b4-46e6-b0cc-491c24c26e8d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:00.437847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61680-a4b4-46e6-b0cc-491c24c26e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:00.438126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61680-a4b4-46e6-b0cc-491c24c26e8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:00.485301 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05f848-a046-4b87-82c5-145f08aced4a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:00.507073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f61680-a4b4-46e6-b0cc-491c24c26e8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:00.508819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f61680-a4b4-46e6-b0cc-491c24c26e8d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:00.520759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26de74-4091-4897-85bb-cca248c4c21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:00.521578 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26de74-4091-4897-85bb-cca248c4c21c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:00.521863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26de74-4091-4897-85bb-cca248c4c21c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:00.522138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26de74-4091-4897-85bb-cca248c4c21c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:00.523305 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26de74-4091-4897-85bb-cca248c4c21c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:00.524727 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26de74-4091-4897-85bb-cca248c4c21c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:00.531444 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 520/1038] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:47:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:00.532838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26de74-4091-4897-85bb-cca248c4c21c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:00.614147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 519/1039] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:47:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 20:47:00.615151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f61680-a4b4-46e6-b0cc-491c24c26e8d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:00.635172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26de74-4091-4897-85bb-cca248c4c21c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:00.668431 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c565a6-c0c0-4cd0-924c-df937c22d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:00.669095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c565a6-c0c0-4cd0-924c-df937c22d3d9 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:00.669372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c565a6-c0c0-4cd0-924c-df937c22d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:00.669696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c565a6-c0c0-4cd0-924c-df937c22d3d9 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:00.670386 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c565a6-c0c0-4cd0-924c-df937c22d3d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:00.671809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c565a6-c0c0-4cd0-924c-df937c22d3d9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:00.711908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f61680-a4b4-46e6-b0cc-491c24c26e8d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:00.743429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e176d-0982-4a75-b3ec-c2dfd4c6e4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:00.744219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e176d-0982-4a75-b3ec-c2dfd4c6e4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:00.744503 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e176d-0982-4a75-b3ec-c2dfd4c6e4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:00.744777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e176d-0982-4a75-b3ec-c2dfd4c6e4c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:00.754947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e176d-0982-4a75-b3ec-c2dfd4c6e4c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:00.756396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e176d-0982-4a75-b3ec-c2dfd4c6e4c7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-978e176d-0982-4a75-b3ec-c2dfd4c6e4c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:47:00.776363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:00.777467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:00.778479 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:47:00.778479 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:47:00.778479 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:47:00.778479 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:00.778479 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 520/1040] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:00.782996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e176d-0982-4a75-b3ec-c2dfd4c6e4c7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:00.798259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 521/1041] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:47:00 2022] POST /identity/v3/users => generated 285 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:47:00.890660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e176d-0982-4a75-b3ec-c2dfd4c6e4c7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:00.925688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ad8ff-de16-4d0d-a4ea-c137b05f0c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:00.926531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ad8ff-de16-4d0d-a4ea-c137b05f0c79 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:00.926918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ad8ff-de16-4d0d-a4ea-c137b05f0c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:00.927299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ad8ff-de16-4d0d-a4ea-c137b05f0c79 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:00.928164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ad8ff-de16-4d0d-a4ea-c137b05f0c79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:00.928580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ad8ff-de16-4d0d-a4ea-c137b05f0c79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:00.930109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ad8ff-de16-4d0d-a4ea-c137b05f0c79 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:00.943344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 521/1042] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:00.948923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c565a6-c0c0-4cd0-924c-df937c22d3d9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:01.054102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c565a6-c0c0-4cd0-924c-df937c22d3d9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:01.087094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7014456-63c7-401e-aa55-31ab29f98029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:01.088131 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014456-63c7-401e-aa55-31ab29f98029 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:01.088591 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014456-63c7-401e-aa55-31ab29f98029 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:01.089600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014456-63c7-401e-aa55-31ab29f98029 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:01.096498 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7014456-63c7-401e-aa55-31ab29f98029 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:01.098147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7014456-63c7-401e-aa55-31ab29f98029 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c7014456-63c7-401e-aa55-31ab29f98029 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:47:01.112238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:01.113254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:01.114211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:47:01.114211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:47:01.114211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:47:01.114211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:47:01.114211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:47:01.114211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:47:01.114211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:47:01.114211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:47:01.114651 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 522/1043] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:47:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:01.120767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ad8ff-de16-4d0d-a4ea-c137b05f0c79 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:01.217396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ad8ff-de16-4d0d-a4ea-c137b05f0c79 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:01.248381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c586bcd-1e28-499d-bcad-9034d0286060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:01.249109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c586bcd-1e28-499d-bcad-9034d0286060 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:01.249320 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c586bcd-1e28-499d-bcad-9034d0286060 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:01.249612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c586bcd-1e28-499d-bcad-9034d0286060 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:01.250393 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c586bcd-1e28-499d-bcad-9034d0286060 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:01.250700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c586bcd-1e28-499d-bcad-9034d0286060 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:01.252122 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c586bcd-1e28-499d-bcad-9034d0286060 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:01.264366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 522/1044] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:47:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:01.270594 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7014456-63c7-401e-aa55-31ab29f98029 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:01.372396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7014456-63c7-401e-aa55-31ab29f98029 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:01.409639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700368c-ca27-43b2-9c53-e0d01ebf85e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:01.410678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700368c-ca27-43b2-9c53-e0d01ebf85e8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:01.411201 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700368c-ca27-43b2-9c53-e0d01ebf85e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:01.411699 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700368c-ca27-43b2-9c53-e0d01ebf85e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:01.412724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700368c-ca27-43b2-9c53-e0d01ebf85e8 None admin] RBAC: Adding query filter params (role.id=2ddc595bde9b4177b6b72d37bfe70957, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=f400b94d3fbc40bdace4860fe83a0891) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:01.413246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700368c-ca27-43b2-9c53-e0d01ebf85e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:01.414987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700368c-ca27-43b2-9c53-e0d01ebf85e8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:01.421280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 523/1045] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:47:01 2022] GET /identity/v3/role_assignments?user.id=f400b94d3fbc40bdace4860fe83a0891&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=2ddc595bde9b4177b6b72d37bfe70957 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:02.476884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ffdb4-226d-42ee-b142-b87bec248ff4 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:02.477449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ffdb4-226d-42ee-b142-b87bec248ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:02.477449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ffdb4-226d-42ee-b142-b87bec248ff4 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:02.478857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 523/1046] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:02.484544 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7282-09cd-4457-970a-f48507a81646 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:02.484955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7282-09cd-4457-970a-f48507a81646 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:02.485119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7282-09cd-4457-970a-f48507a81646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:02.503612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ed2a7282-09cd-4457-970a-f48507a81646 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:02.504794 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ed2a7282-09cd-4457-970a-f48507a81646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:02.570747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 524/1047] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:02.592968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ffdb4-226d-42ee-b142-b87bec248ff4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:02.690119 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ffdb4-226d-42ee-b142-b87bec248ff4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:02.722003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18a83d-1c0f-4f33-8f55-e369c7b5ecce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:02.722795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18a83d-1c0f-4f33-8f55-e369c7b5ecce None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:02.723080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18a83d-1c0f-4f33-8f55-e369c7b5ecce None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:02.723394 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18a83d-1c0f-4f33-8f55-e369c7b5ecce None admin] PATH_INFO: `/v3/services/image` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:02.724048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18a83d-1c0f-4f33-8f55-e369c7b5ecce None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:02.725419 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18a83d-1c0f-4f33-8f55-e369c7b5ecce None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-ae18a83d-1c0f-4f33-8f55-e369c7b5ecce None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:02.737203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:02.738388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:02.739270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:02.739270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:47:02.739270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:02.739270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:02.739270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:02.739270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:02.739270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:02.739270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:02.739270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:02.739270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:02.739270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:47:02.739270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:47:02.739270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 11 20:47:02.739270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:02.741875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 524/1048] 10.222.0.35 () {56 vars in 1105 bytes} [Wed May 11 20:47:02 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:02.744309 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a7282-09cd-4457-970a-f48507a81646 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:02.854342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a7282-09cd-4457-970a-f48507a81646 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:02.889053 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27af072-a345-4c72-8b85-2f726a480a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:02.889776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27af072-a345-4c72-8b85-2f726a480a28 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:02.890064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27af072-a345-4c72-8b85-2f726a480a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:02.890337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27af072-a345-4c72-8b85-2f726a480a28 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:02.891058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27af072-a345-4c72-8b85-2f726a480a28 None admin] RBAC: Adding query filter params (name=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:02.891366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27af072-a345-4c72-8b85-2f726a480a28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:02.892763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27af072-a345-4c72-8b85-2f726a480a28 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:02.903855 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 525/1049] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:47:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:02.904843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18a83d-1c0f-4f33-8f55-e369c7b5ecce None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:03.001017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18a83d-1c0f-4f33-8f55-e369c7b5ecce None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:03.033267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a36ea-3390-4e83-9280-78aaff22572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:03.033973 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a36ea-3390-4e83-9280-78aaff22572a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:03.034254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a36ea-3390-4e83-9280-78aaff22572a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:03.034532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a36ea-3390-4e83-9280-78aaff22572a None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:03.035233 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a36ea-3390-4e83-9280-78aaff22572a None admin] RBAC: Adding query filter params (type=image) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:03.035542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a36ea-3390-4e83-9280-78aaff22572a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:03.037023 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a36ea-3390-4e83-9280-78aaff22572a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:03.048493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 525/1050] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:47:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:03.048671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27af072-a345-4c72-8b85-2f726a480a28 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:03.061682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81091d96-1753-4515-9c90-6c649cf4ae88 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:03.061961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81091d96-1753-4515-9c90-6c649cf4ae88 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:03.062242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81091d96-1753-4515-9c90-6c649cf4ae88 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:03.063728 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 526/1051] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:47:03.068347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ed28e-c483-4f73-8db4-edd1ec9d6311 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:03.068636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ed28e-c483-4f73-8db4-edd1ec9d6311 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:03.068912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ed28e-c483-4f73-8db4-edd1ec9d6311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:03.085003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-356ed28e-c483-4f73-8db4-edd1ec9d6311 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:03.086196 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-356ed28e-c483-4f73-8db4-edd1ec9d6311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:03.144629 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27af072-a345-4c72-8b85-2f726a480a28 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:03.150311 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 527/1052] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:47:03.175248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ed28e-c483-4f73-8db4-edd1ec9d6311 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:03.183852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd754e5-9252-46da-9511-f087676f1d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:03.184519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd754e5-9252-46da-9511-f087676f1d9e None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:03.184805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd754e5-9252-46da-9511-f087676f1d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:03.185143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd754e5-9252-46da-9511-f087676f1d9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:03.185922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd754e5-9252-46da-9511-f087676f1d9e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:03.187351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd754e5-9252-46da-9511-f087676f1d9e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:03.262564 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 526/1053] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 11 20:47:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:47:03.269672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ed28e-c483-4f73-8db4-edd1ec9d6311 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:03.313122 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25557b1d-61bb-4572-a358-9e8f8cc26f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:03.314030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25557b1d-61bb-4572-a358-9e8f8cc26f73 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:03.314316 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25557b1d-61bb-4572-a358-9e8f8cc26f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:03.314586 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25557b1d-61bb-4572-a358-9e8f8cc26f73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:03.326613 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25557b1d-61bb-4572-a358-9e8f8cc26f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-25557b1d-61bb-4572-a358-9e8f8cc26f73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:47:03.334481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:03.335531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:03.342493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:03.342493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:03.342493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:03.342493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:03.342493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:47:03.342493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:47:03.342493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:47:03.342493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:47:03.342493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:47:03.342493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:47:03.342493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:03.342493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:03.342493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 528/1054] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:47:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:47:03.345014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd754e5-9252-46da-9511-f087676f1d9e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:03.448761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd754e5-9252-46da-9511-f087676f1d9e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:03.488905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaa073-19b8-40af-91e4-9b0b7074184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:03.490300 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaa073-19b8-40af-91e4-9b0b7074184e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:03.490583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaa073-19b8-40af-91e4-9b0b7074184e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:03.490855 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaa073-19b8-40af-91e4-9b0b7074184e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:03.491612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaa073-19b8-40af-91e4-9b0b7074184e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:03.491920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaa073-19b8-40af-91e4-9b0b7074184e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:03.493308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aaa073-19b8-40af-91e4-9b0b7074184e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:03.503586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 527/1055] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:47:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:03.509237 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25557b1d-61bb-4572-a358-9e8f8cc26f73 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:03.605774 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25557b1d-61bb-4572-a358-9e8f8cc26f73 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:03.638976 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de75e8-55ae-4dd1-b33b-f42b495245fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:03.640206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de75e8-55ae-4dd1-b33b-f42b495245fc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:03.640685 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de75e8-55ae-4dd1-b33b-f42b495245fc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:03.641154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de75e8-55ae-4dd1-b33b-f42b495245fc None admin] PATH_INFO: `/v3/users/a396c927592349179b1fd35c0cc1084d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:03.648442 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4a6d-3c2a-4006-9be5-39a9656f1e74 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:03.648736 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4a6d-3c2a-4006-9be5-39a9656f1e74 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:03.649022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4a6d-3c2a-4006-9be5-39a9656f1e74 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:03.650655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 528/1056] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:47:03.655532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78900e-8591-4206-89cf-6f836995cc47 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:03.655821 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78900e-8591-4206-89cf-6f836995cc47 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:03.656103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78900e-8591-4206-89cf-6f836995cc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:03.656715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de75e8-55ae-4dd1-b33b-f42b495245fc None admin] RBAC: Authorizing `identity:get_user(user_id=a396c927592349179b1fd35c0cc1084d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:03.658337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de75e8-55ae-4dd1-b33b-f42b495245fc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:03.664467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 529/1057] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:03 2022] GET /identity/v3/users/a396c927592349179b1fd35c0cc1084d => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:03.665866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de75e8-55ae-4dd1-b33b-f42b495245fc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:03.672243 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ee78900e-8591-4206-89cf-6f836995cc47 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:03.673438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ee78900e-8591-4206-89cf-6f836995cc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:03.739178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 529/1058] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:47:03.761404 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78900e-8591-4206-89cf-6f836995cc47 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:03.766498 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de75e8-55ae-4dd1-b33b-f42b495245fc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:03.801911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5a410-b2c0-4dc0-a7bf-34b09096b43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:03.802568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5a410-b2c0-4dc0-a7bf-34b09096b43b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:03.802855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5a410-b2c0-4dc0-a7bf-34b09096b43b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:03.803134 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5a410-b2c0-4dc0-a7bf-34b09096b43b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:03.865080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78900e-8591-4206-89cf-6f836995cc47 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:03.871440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5a410-b2c0-4dc0-a7bf-34b09096b43b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:03.872899 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5a410-b2c0-4dc0-a7bf-34b09096b43b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:03.902898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9be4ff-447c-4e45-9bf2-eaaa5e7888a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:03.903844 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9be4ff-447c-4e45-9bf2-eaaa5e7888a2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:03.904236 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9be4ff-447c-4e45-9bf2-eaaa5e7888a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:03.904519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9be4ff-447c-4e45-9bf2-eaaa5e7888a2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:03.914482 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9be4ff-447c-4e45-9bf2-eaaa5e7888a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2c9be4ff-447c-4e45-9bf2-eaaa5e7888a2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:47:03.922767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:03.923791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:03.924674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:03.924674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:03.924674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:03.924674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:03.924674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:47:03.924674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:47:03.924674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:47:03.924674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:47:03.924674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:47:03.924674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:47:03.924674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 20:47:03.924674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:47:03.929030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 530/1059] 10.222.0.35 () {56 vars in 1120 bytes} [Wed May 11 20:47:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:03.929832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9be4ff-447c-4e45-9bf2-eaaa5e7888a2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:03.970509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 530/1060] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:47:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 20:47:03.976097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5a410-b2c0-4dc0-a7bf-34b09096b43b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:04.028562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9be4ff-447c-4e45-9bf2-eaaa5e7888a2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:04.061324 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d737c-41f7-49b5-a7fc-1863cbf4dc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:04.062355 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d737c-41f7-49b5-a7fc-1863cbf4dc91 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:04.062858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d737c-41f7-49b5-a7fc-1863cbf4dc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:04.063288 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d737c-41f7-49b5-a7fc-1863cbf4dc91 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:04.064025 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d737c-41f7-49b5-a7fc-1863cbf4dc91 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:04.064332 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d737c-41f7-49b5-a7fc-1863cbf4dc91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:04.065713 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d737c-41f7-49b5-a7fc-1863cbf4dc91 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:04.071490 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5a410-b2c0-4dc0-a7bf-34b09096b43b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:04.074260 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 531/1061] 10.222.0.35 () {56 vars in 1115 bytes} [Wed May 11 20:47:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:04.079788 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d737c-41f7-49b5-a7fc-1863cbf4dc91 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:04.110209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e77729-d22f-46c0-a752-4f7f7d0e3e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:04.111167 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e77729-d22f-46c0-a752-4f7f7d0e3e75 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:04.111450 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e77729-d22f-46c0-a752-4f7f7d0e3e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:04.111721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e77729-d22f-46c0-a752-4f7f7d0e3e75 None admin] PATH_INFO: `/v3/projects/adc5d9effe9f4ada91f771c38da04019` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:04.112880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e77729-d22f-46c0-a752-4f7f7d0e3e75 None admin] RBAC: Authorizing `identity:get_project(project_id=adc5d9effe9f4ada91f771c38da04019)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:04.114353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e77729-d22f-46c0-a752-4f7f7d0e3e75 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:04.116263 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 531/1062] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:47:03 2022] GET /identity/v3/projects/adc5d9effe9f4ada91f771c38da04019 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:04.121889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e77729-d22f-46c0-a752-4f7f7d0e3e75 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:04.178194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d737c-41f7-49b5-a7fc-1863cbf4dc91 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:04.210835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb6088-8269-4417-bc6d-80820d52d718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:04.211625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb6088-8269-4417-bc6d-80820d52d718 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:04.211908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb6088-8269-4417-bc6d-80820d52d718 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:04.212184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb6088-8269-4417-bc6d-80820d52d718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:04.216486 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e77729-d22f-46c0-a752-4f7f7d0e3e75 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:04.223012 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb6088-8269-4417-bc6d-80820d52d718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:04.224454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb6088-8269-4417-bc6d-80820d52d718 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-66cb6088-8269-4417-bc6d-80820d52d718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:47:04.241739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:04.242649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:04.243573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:47:04.243573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:47:04.243573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:47:04.243573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:47:04.243573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 532/1063] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:47:04.250601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb6088-8269-4417-bc6d-80820d52d718 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:04.251646 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd177e5-e9d7-43e3-82b6-7d5a39dd7dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:04.252298 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd177e5-e9d7-43e3-82b6-7d5a39dd7dde None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:04.252583 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd177e5-e9d7-43e3-82b6-7d5a39dd7dde None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:04.252859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd177e5-e9d7-43e3-82b6-7d5a39dd7dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:04.253712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd177e5-e9d7-43e3-82b6-7d5a39dd7dde None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=adc5d9effe9f4ada91f771c38da04019, user.id=a396c927592349179b1fd35c0cc1084d) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:04.254028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd177e5-e9d7-43e3-82b6-7d5a39dd7dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:04.255460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd177e5-e9d7-43e3-82b6-7d5a39dd7dde None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:04.261080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 532/1064] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:47:04 2022] GET /identity/v3/role_assignments?user.id=a396c927592349179b1fd35c0cc1084d&scope.project.id=adc5d9effe9f4ada91f771c38da04019&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:04.363093 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb6088-8269-4417-bc6d-80820d52d718 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:04.397494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b676d6b-f664-4516-8cd6-c11541a958d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:04.398609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b676d6b-f664-4516-8cd6-c11541a958d7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:04.399080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b676d6b-f664-4516-8cd6-c11541a958d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:04.399541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b676d6b-f664-4516-8cd6-c11541a958d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:04.400511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b676d6b-f664-4516-8cd6-c11541a958d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:04.401595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b676d6b-f664-4516-8cd6-c11541a958d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:04.403254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b676d6b-f664-4516-8cd6-c11541a958d7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:04.422705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 533/1065] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:04.423971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd177e5-e9d7-43e3-82b6-7d5a39dd7dde None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:04.525020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd177e5-e9d7-43e3-82b6-7d5a39dd7dde None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:04.557924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370e47b-d090-43f2-8be0-15e3547b0936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:04.558722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370e47b-d090-43f2-8be0-15e3547b0936 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:04.559007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370e47b-d090-43f2-8be0-15e3547b0936 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:04.559284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370e47b-d090-43f2-8be0-15e3547b0936 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:04.566636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370e47b-d090-43f2-8be0-15e3547b0936 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:04.568070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370e47b-d090-43f2-8be0-15e3547b0936 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-1370e47b-d090-43f2-8be0-15e3547b0936 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:47:04.581910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:04.582885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:04.583851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:04.583851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:04.583851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:47:04.583851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:47:04.583851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:47:04.583851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:47:04.583851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:47:04.583851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:47:04.583851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 20:47:04.583851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:04.583851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 533/1066] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 11 20:47:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:47:04.589301 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b676d6b-f664-4516-8cd6-c11541a958d7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:04.687168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b676d6b-f664-4516-8cd6-c11541a958d7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:04.719406 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be74633-0b91-4e4f-80c2-305e1b3dc444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:04.720069 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be74633-0b91-4e4f-80c2-305e1b3dc444 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:04.720442 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be74633-0b91-4e4f-80c2-305e1b3dc444 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:04.720650 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be74633-0b91-4e4f-80c2-305e1b3dc444 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:04.721438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be74633-0b91-4e4f-80c2-305e1b3dc444 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:04.721775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be74633-0b91-4e4f-80c2-305e1b3dc444 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:04.723242 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be74633-0b91-4e4f-80c2-305e1b3dc444 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:04.744283 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 534/1067] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 11 20:47:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:04.745608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370e47b-d090-43f2-8be0-15e3547b0936 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:04.850835 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370e47b-d090-43f2-8be0-15e3547b0936 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:04.895916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b56e7-c725-4de0-95ad-0a887b1f918d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:04.896708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b56e7-c725-4de0-95ad-0a887b1f918d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:04.896991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b56e7-c725-4de0-95ad-0a887b1f918d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:04.897264 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b56e7-c725-4de0-95ad-0a887b1f918d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:04.907932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b56e7-c725-4de0-95ad-0a887b1f918d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:04.909382 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b56e7-c725-4de0-95ad-0a887b1f918d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-bf6b56e7-c725-4de0-95ad-0a887b1f918d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:47:04.930620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:04.931619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:04.932684 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:47:04.932684 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:47:04.932684 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:47:04.932684 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:04.933854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 534/1068] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:04.937477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be74633-0b91-4e4f-80c2-305e1b3dc444 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:05.033097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be74633-0b91-4e4f-80c2-305e1b3dc444 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:05.065416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba68ab5-efe5-4bcc-a445-b80d08fb9597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:05.066102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba68ab5-efe5-4bcc-a445-b80d08fb9597 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:05.066381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba68ab5-efe5-4bcc-a445-b80d08fb9597 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:05.066651 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba68ab5-efe5-4bcc-a445-b80d08fb9597 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:05.067365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba68ab5-efe5-4bcc-a445-b80d08fb9597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:05.067670 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba68ab5-efe5-4bcc-a445-b80d08fb9597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:05.069022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba68ab5-efe5-4bcc-a445-b80d08fb9597 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:05.080138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 535/1069] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:05.085721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b56e7-c725-4de0-95ad-0a887b1f918d None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:05.181353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b56e7-c725-4de0-95ad-0a887b1f918d None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:05.213261 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078bcc4-2657-49b7-861b-8fa25afb5e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:05.214517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078bcc4-2657-49b7-861b-8fa25afb5e77 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:05.214801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078bcc4-2657-49b7-861b-8fa25afb5e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:05.215061 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078bcc4-2657-49b7-861b-8fa25afb5e77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:05.221430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078bcc4-2657-49b7-861b-8fa25afb5e77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:05.222916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078bcc4-2657-49b7-861b-8fa25afb5e77 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-0078bcc4-2657-49b7-861b-8fa25afb5e77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:47:05.237244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:05.238321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:05.243956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:47:05.243956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:47:05.243956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:47:05.243956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:47:05.243956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:47:05.243956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:47:05.243956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:47:05.243956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:05.243956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 535/1070] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:05.244461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba68ab5-efe5-4bcc-a445-b80d08fb9597 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:05.340957 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba68ab5-efe5-4bcc-a445-b80d08fb9597 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:05.376421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad8f59-acda-4cbf-a080-24b1f215465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:05.377080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad8f59-acda-4cbf-a080-24b1f215465c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:05.377364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad8f59-acda-4cbf-a080-24b1f215465c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:05.377663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad8f59-acda-4cbf-a080-24b1f215465c None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:05.378446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad8f59-acda-4cbf-a080-24b1f215465c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:05.378752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad8f59-acda-4cbf-a080-24b1f215465c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:05.380172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad8f59-acda-4cbf-a080-24b1f215465c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:05.392457 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 536/1071] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:47:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:05.398393 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078bcc4-2657-49b7-861b-8fa25afb5e77 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:05.492932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078bcc4-2657-49b7-861b-8fa25afb5e77 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:05.517315 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c8bc-4dc1-40ca-b423-9fbb2be74989 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:05.517622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c8bc-4dc1-40ca-b423-9fbb2be74989 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:05.517899 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c8bc-4dc1-40ca-b423-9fbb2be74989 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:05.519507 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 537/1072] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:47:05.524396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaff3c-8929-4fe2-ac50-ca706cfb9e57 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:05.524678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaff3c-8929-4fe2-ac50-ca706cfb9e57 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:05.524957 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaff3c-8929-4fe2-ac50-ca706cfb9e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:05.526734 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe2786-5a0a-41f9-98a3-4a02ac464a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:05.527916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe2786-5a0a-41f9-98a3-4a02ac464a3e None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:05.527916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe2786-5a0a-41f9-98a3-4a02ac464a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:05.528160 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe2786-5a0a-41f9-98a3-4a02ac464a3e None admin] PATH_INFO: `/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/f400b94d3fbc40bdace4860fe83a0891/roles/2ddc595bde9b4177b6b72d37bfe70957` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:05.530360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe2786-5a0a-41f9-98a3-4a02ac464a3e None admin] RBAC: Authorizing `identity:create_grant(project_id=7c03e5fec995436aa5424d2be2e268aa, user_id=f400b94d3fbc40bdace4860fe83a0891, role_id=2ddc595bde9b4177b6b72d37bfe70957)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:05.531810 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe2786-5a0a-41f9-98a3-4a02ac464a3e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:05.542947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-abcaff3c-8929-4fe2-ac50-ca706cfb9e57 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:05.549717 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-abcaff3c-8929-4fe2-ac50-ca706cfb9e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:05.601365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 536/1073] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:47:05 2022] PUT /identity/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/f400b94d3fbc40bdace4860fe83a0891/roles/2ddc595bde9b4177b6b72d37bfe70957 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:47:05.613517 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 538/1074] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:47:05.631384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe2786-5a0a-41f9-98a3-4a02ac464a3e None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:05.734346 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe2786-5a0a-41f9-98a3-4a02ac464a3e None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:05.769206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c478-4b1d-4db0-927a-bcb5a4c200cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:05.769826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c478-4b1d-4db0-927a-bcb5a4c200cb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:05.770109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c478-4b1d-4db0-927a-bcb5a4c200cb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:05.770384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2c478-4b1d-4db0-927a-bcb5a4c200cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:05.839497 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2c478-4b1d-4db0-927a-bcb5a4c200cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:05.841019 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2c478-4b1d-4db0-927a-bcb5a4c200cb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:05.934268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 537/1075] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:47:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:47:05.939830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaff3c-8929-4fe2-ac50-ca706cfb9e57 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:06.042178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaff3c-8929-4fe2-ac50-ca706cfb9e57 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:06.075046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8127e-7909-4b42-90a5-278614dc0948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:06.075835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8127e-7909-4b42-90a5-278614dc0948 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:06.076116 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8127e-7909-4b42-90a5-278614dc0948 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:06.076389 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8127e-7909-4b42-90a5-278614dc0948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:06.086127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8127e-7909-4b42-90a5-278614dc0948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:06.087577 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8127e-7909-4b42-90a5-278614dc0948 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b2b8127e-7909-4b42-90a5-278614dc0948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:47:06.105518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:06.106490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:06.107423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:47:06.107423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:47:06.107423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:47:06.107423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:47:06.107423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 539/1076] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:47:06.113577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c478-4b1d-4db0-927a-bcb5a4c200cb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:06.209457 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2c478-4b1d-4db0-927a-bcb5a4c200cb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:06.242113 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fc49f-04ef-44d7-92b3-6b68b5592c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:06.242769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fc49f-04ef-44d7-92b3-6b68b5592c58 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:06.243051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fc49f-04ef-44d7-92b3-6b68b5592c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:06.243321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fc49f-04ef-44d7-92b3-6b68b5592c58 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:06.244031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fc49f-04ef-44d7-92b3-6b68b5592c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:06.244334 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fc49f-04ef-44d7-92b3-6b68b5592c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:06.245752 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fc49f-04ef-44d7-92b3-6b68b5592c58 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:06.265565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 538/1077] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:06.509259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c042a-40eb-49a5-ae64-3ccc55c6dda3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:06.509626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c042a-40eb-49a5-ae64-3ccc55c6dda3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:06.509825 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c042a-40eb-49a5-ae64-3ccc55c6dda3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:06.511194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 540/1078] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:06.516550 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95263f51-040f-4496-8d85-e6350310eaff None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:06.516847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95263f51-040f-4496-8d85-e6350310eaff None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:06.517129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95263f51-040f-4496-8d85-e6350310eaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:06.534676 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-95263f51-040f-4496-8d85-e6350310eaff None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:06.535861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-95263f51-040f-4496-8d85-e6350310eaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:06.601860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 539/1079] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:06.624677 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c042a-40eb-49a5-ae64-3ccc55c6dda3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:06.720858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c042a-40eb-49a5-ae64-3ccc55c6dda3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:06.755450 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdc50c-88f2-4d36-a1b3-62d28f17c8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:06.756239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdc50c-88f2-4d36-a1b3-62d28f17c8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:06.756527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdc50c-88f2-4d36-a1b3-62d28f17c8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:06.756809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdc50c-88f2-4d36-a1b3-62d28f17c8f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:06.766643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdc50c-88f2-4d36-a1b3-62d28f17c8f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c9fdc50c-88f2-4d36-a1b3-62d28f17c8f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:47:06.774421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:06.775527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:06.776932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:06.776932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:06.776932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:06.776932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:06.776932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:47:06.776932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:47:06.776932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:47:06.776932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:47:06.776932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:47:06.776932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:47:06.776932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:06.776932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:47:06.776932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 541/1080] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:47:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:06.782500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95263f51-040f-4496-8d85-e6350310eaff None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:06.882126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95263f51-040f-4496-8d85-e6350310eaff None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:06.914344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a47bee-5129-4e84-9cc2-fd14abde0e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:06.915010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a47bee-5129-4e84-9cc2-fd14abde0e57 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:06.915294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a47bee-5129-4e84-9cc2-fd14abde0e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:06.915573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a47bee-5129-4e84-9cc2-fd14abde0e57 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:06.916313 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a47bee-5129-4e84-9cc2-fd14abde0e57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:06.917236 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a47bee-5129-4e84-9cc2-fd14abde0e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:06.918637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a47bee-5129-4e84-9cc2-fd14abde0e57 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:06.931018 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 540/1081] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:47:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:06.932377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdc50c-88f2-4d36-a1b3-62d28f17c8f9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:07.031015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdc50c-88f2-4d36-a1b3-62d28f17c8f9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:07.066166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f708479-5a44-45e1-a68e-c5676a2e3123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:07.067023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f708479-5a44-45e1-a68e-c5676a2e3123 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:07.067311 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f708479-5a44-45e1-a68e-c5676a2e3123 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:07.067587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f708479-5a44-45e1-a68e-c5676a2e3123 None admin] PATH_INFO: `/v3/users/a396c927592349179b1fd35c0cc1084d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:07.068771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f708479-5a44-45e1-a68e-c5676a2e3123 None admin] RBAC: Authorizing `identity:get_user(user_id=a396c927592349179b1fd35c0cc1084d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:07.070245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f708479-5a44-45e1-a68e-c5676a2e3123 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:07.072013 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 542/1082] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:06 2022] GET /identity/v3/users/a396c927592349179b1fd35c0cc1084d => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:07.078112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a47bee-5129-4e84-9cc2-fd14abde0e57 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:07.172523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a47bee-5129-4e84-9cc2-fd14abde0e57 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:07.203980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fb7b4-facb-4f22-824b-84a8d9329aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:07.204839 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fb7b4-facb-4f22-824b-84a8d9329aaa None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:07.205123 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fb7b4-facb-4f22-824b-84a8d9329aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:07.205506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fb7b4-facb-4f22-824b-84a8d9329aaa None admin] PATH_INFO: `/v3/projects/adc5d9effe9f4ada91f771c38da04019` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:07.206720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fb7b4-facb-4f22-824b-84a8d9329aaa None admin] RBAC: Authorizing `identity:get_project(project_id=adc5d9effe9f4ada91f771c38da04019)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:07.208163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fb7b4-facb-4f22-824b-84a8d9329aaa None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:07.209886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 541/1083] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:47:07 2022] GET /identity/v3/projects/adc5d9effe9f4ada91f771c38da04019 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:07.216391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f708479-5a44-45e1-a68e-c5676a2e3123 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:07.310040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f708479-5a44-45e1-a68e-c5676a2e3123 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:07.341241 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417362f3-8187-45c5-b44f-ab0e3e3b194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:07.342152 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417362f3-8187-45c5-b44f-ab0e3e3b194b None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:07.342430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417362f3-8187-45c5-b44f-ab0e3e3b194b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:07.342698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417362f3-8187-45c5-b44f-ab0e3e3b194b None admin] PATH_INFO: `/v3/projects/adc5d9effe9f4ada91f771c38da04019/users/a396c927592349179b1fd35c0cc1084d/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:07.344619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417362f3-8187-45c5-b44f-ab0e3e3b194b None admin] RBAC: Authorizing `identity:create_grant(project_id=adc5d9effe9f4ada91f771c38da04019, user_id=a396c927592349179b1fd35c0cc1084d, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:07.346077 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417362f3-8187-45c5-b44f-ab0e3e3b194b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:07.429931 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 543/1084] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:47:07 2022] PUT /identity/v3/projects/adc5d9effe9f4ada91f771c38da04019/users/a396c927592349179b1fd35c0cc1084d/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:47:07.823796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4aa90-7977-4592-98f5-69fbf295fe9f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:07.824341 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4aa90-7977-4592-98f5-69fbf295fe9f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:07.824341 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4aa90-7977-4592-98f5-69fbf295fe9f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:07.825732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 542/1085] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:07.831250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac4670-34e9-4b0e-afac-b60b99384b75 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:07.831658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac4670-34e9-4b0e-afac-b60b99384b75 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:07.831816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac4670-34e9-4b0e-afac-b60b99384b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:07.856182 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-18ac4670-34e9-4b0e-afac-b60b99384b75 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:07.857365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-18ac4670-34e9-4b0e-afac-b60b99384b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:07.921724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 544/1086] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:47:07.944975 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4aa90-7977-4592-98f5-69fbf295fe9f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:08.040897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4aa90-7977-4592-98f5-69fbf295fe9f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:08.073364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a99a7-fa16-4842-9d3c-c5100f77f850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:08.074242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a99a7-fa16-4842-9d3c-c5100f77f850 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:08.074476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a99a7-fa16-4842-9d3c-c5100f77f850 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:08.074750 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a99a7-fa16-4842-9d3c-c5100f77f850 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:08.084447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a99a7-fa16-4842-9d3c-c5100f77f850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-bc5a99a7-fa16-4842-9d3c-c5100f77f850 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:47:08.093431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:08.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:08.095808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:08.095808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:08.095808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:08.095808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:08.095808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:47:08.095808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:47:08.095808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:47:08.095808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:47:08.095808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:47:08.095808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:47:08.095808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 11 20:47:08.095808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:08.095808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 543/1087] 10.222.0.35 () {56 vars in 1120 bytes} [Wed May 11 20:47:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:08.100753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac4670-34e9-4b0e-afac-b60b99384b75 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:08.194603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac4670-34e9-4b0e-afac-b60b99384b75 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:08.226713 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46682e2-d191-4799-bd32-4338e6c630db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:08.227377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46682e2-d191-4799-bd32-4338e6c630db None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:08.227661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46682e2-d191-4799-bd32-4338e6c630db None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:08.227936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46682e2-d191-4799-bd32-4338e6c630db None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:08.228679 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46682e2-d191-4799-bd32-4338e6c630db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:08.229619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46682e2-d191-4799-bd32-4338e6c630db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:08.231056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46682e2-d191-4799-bd32-4338e6c630db None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:08.239383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 545/1088] 10.222.0.35 () {56 vars in 1115 bytes} [Wed May 11 20:47:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:08.245029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a99a7-fa16-4842-9d3c-c5100f77f850 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:08.340137 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a99a7-fa16-4842-9d3c-c5100f77f850 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:08.371541 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c08022-7b5a-4269-93f2-13f80dc26dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:08.372316 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c08022-7b5a-4269-93f2-13f80dc26dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:08.372596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c08022-7b5a-4269-93f2-13f80dc26dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:08.372869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c08022-7b5a-4269-93f2-13f80dc26dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:08.382853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c08022-7b5a-4269-93f2-13f80dc26dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:08.384310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c08022-7b5a-4269-93f2-13f80dc26dc6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c8c08022-7b5a-4269-93f2-13f80dc26dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:47:08.401483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:08.402614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:08.408640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:47:08.408640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:47:08.408640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:47:08.408640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:08.408640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 544/1089] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:08.409141 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46682e2-d191-4799-bd32-4338e6c630db None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:08.504079 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46682e2-d191-4799-bd32-4338e6c630db None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:08.540419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a24c0-498c-4ac4-9e83-a3e6786c90fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:08.541080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a24c0-498c-4ac4-9e83-a3e6786c90fd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:08.541392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a24c0-498c-4ac4-9e83-a3e6786c90fd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:08.541703 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a24c0-498c-4ac4-9e83-a3e6786c90fd None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:08.542422 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a24c0-498c-4ac4-9e83-a3e6786c90fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:08.542731 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a24c0-498c-4ac4-9e83-a3e6786c90fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:08.544106 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a24c0-498c-4ac4-9e83-a3e6786c90fd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:08.555492 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 546/1090] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:08.561357 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c08022-7b5a-4269-93f2-13f80dc26dc6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:08.659848 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c08022-7b5a-4269-93f2-13f80dc26dc6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:08.691034 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d16925-4bb5-46ad-af27-7a2e152d3282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:08.691821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d16925-4bb5-46ad-af27-7a2e152d3282 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:08.692108 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d16925-4bb5-46ad-af27-7a2e152d3282 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:08.692386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d16925-4bb5-46ad-af27-7a2e152d3282 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:08.700123 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d16925-4bb5-46ad-af27-7a2e152d3282 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:08.701605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d16925-4bb5-46ad-af27-7a2e152d3282 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-52d16925-4bb5-46ad-af27-7a2e152d3282 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:47:08.716208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:08.717173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:08.718495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:08.718495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:08.718495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:47:08.718495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:47:08.718495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:47:08.718495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:47:08.718495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:47:08.718495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:47:08.718495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 11 20:47:08.718495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:08.718495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 545/1091] 10.222.0.35 () {56 vars in 1093 bytes} [Wed May 11 20:47:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:08.723127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a24c0-498c-4ac4-9e83-a3e6786c90fd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:08.818425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a24c0-498c-4ac4-9e83-a3e6786c90fd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:08.853521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677055b-69df-453a-b6e2-1e2ca1e7f739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:08.854248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677055b-69df-453a-b6e2-1e2ca1e7f739 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:08.854534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677055b-69df-453a-b6e2-1e2ca1e7f739 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:08.854815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677055b-69df-453a-b6e2-1e2ca1e7f739 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:08.855681 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677055b-69df-453a-b6e2-1e2ca1e7f739 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:08.856030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677055b-69df-453a-b6e2-1e2ca1e7f739 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:08.857510 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677055b-69df-453a-b6e2-1e2ca1e7f739 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:08.875113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 547/1092] 10.222.0.35 () {56 vars in 1133 bytes} [Wed May 11 20:47:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:08.880865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d16925-4bb5-46ad-af27-7a2e152d3282 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:08.976274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d16925-4bb5-46ad-af27-7a2e152d3282 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:09.007961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72119981-ebe2-48b0-b172-e81576d852b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:09.008604 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119981-ebe2-48b0-b172-e81576d852b9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:09.008885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119981-ebe2-48b0-b172-e81576d852b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:09.009156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72119981-ebe2-48b0-b172-e81576d852b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:09.073386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72119981-ebe2-48b0-b172-e81576d852b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:09.074863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72119981-ebe2-48b0-b172-e81576d852b9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:09.168150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 546/1093] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:47:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:47:09.173954 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677055b-69df-453a-b6e2-1e2ca1e7f739 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:09.271470 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677055b-69df-453a-b6e2-1e2ca1e7f739 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:09.307912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7a959-7238-401b-9868-df938952f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:09.308706 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7a959-7238-401b-9868-df938952f138 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:09.308993 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7a959-7238-401b-9868-df938952f138 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:09.309271 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7a959-7238-401b-9868-df938952f138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:09.319141 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7a959-7238-401b-9868-df938952f138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:09.320655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7a959-7238-401b-9868-df938952f138 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3ff7a959-7238-401b-9868-df938952f138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:47:09.338277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:09.339860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:09.341318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:47:09.341318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:47:09.341318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:47:09.341318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:47:09.341318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 548/1094] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:09.345587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72119981-ebe2-48b0-b172-e81576d852b9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:09.441249 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72119981-ebe2-48b0-b172-e81576d852b9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:09.474378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc358c8-0c70-41a2-8191-90bb6445b610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:09.475040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc358c8-0c70-41a2-8191-90bb6445b610 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:09.475326 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc358c8-0c70-41a2-8191-90bb6445b610 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:09.475602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc358c8-0c70-41a2-8191-90bb6445b610 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:09.476319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc358c8-0c70-41a2-8191-90bb6445b610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:09.476625 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc358c8-0c70-41a2-8191-90bb6445b610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:09.478019 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc358c8-0c70-41a2-8191-90bb6445b610 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:09.488864 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 547/1095] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:09.494265 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7a959-7238-401b-9868-df938952f138 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:09.590544 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7a959-7238-401b-9868-df938952f138 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:09.598129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae39aeb-8658-41d1-8b96-a6ce9ccbd491 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:09.598420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae39aeb-8658-41d1-8b96-a6ce9ccbd491 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:09.598702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae39aeb-8658-41d1-8b96-a6ce9ccbd491 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:09.600056 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 548/1096] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:47:09.604927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff53b0a-5d0d-44fb-9171-0c8f13127af3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:09.605211 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff53b0a-5d0d-44fb-9171-0c8f13127af3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:09.605490 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff53b0a-5d0d-44fb-9171-0c8f13127af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:09.621965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7ff53b0a-5d0d-44fb-9171-0c8f13127af3 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:09.623139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7ff53b0a-5d0d-44fb-9171-0c8f13127af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:09.623737 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21040eae-8a9e-4581-b812-43e1cfabaf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:09.624519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21040eae-8a9e-4581-b812-43e1cfabaf3e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:09.624802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21040eae-8a9e-4581-b812-43e1cfabaf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:09.625076 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21040eae-8a9e-4581-b812-43e1cfabaf3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:09.631578 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21040eae-8a9e-4581-b812-43e1cfabaf3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:09.633013 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21040eae-8a9e-4581-b812-43e1cfabaf3e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-21040eae-8a9e-4581-b812-43e1cfabaf3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:47:09.647191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:09.648158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:09.649135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:47:09.649135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:47:09.649135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:47:09.649135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:47:09.649135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:47:09.649135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:47:09.649135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:47:09.649135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:47:09.649135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 549/1097] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:47:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:09.654121 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21040eae-8a9e-4581-b812-43e1cfabaf3e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:09.688362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 549/1098] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:47:09.711540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff53b0a-5d0d-44fb-9171-0c8f13127af3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:09.748256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21040eae-8a9e-4581-b812-43e1cfabaf3e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:09.779971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ae9a3-89e0-40ca-b018-ccb30f03edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:09.780621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ae9a3-89e0-40ca-b018-ccb30f03edd5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:09.780904 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ae9a3-89e0-40ca-b018-ccb30f03edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:09.781175 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ae9a3-89e0-40ca-b018-ccb30f03edd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:09.781975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ae9a3-89e0-40ca-b018-ccb30f03edd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:09.782284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ae9a3-89e0-40ca-b018-ccb30f03edd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:09.783710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ae9a3-89e0-40ca-b018-ccb30f03edd5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:09.795291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 550/1099] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:47:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:09.801129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ae9a3-89e0-40ca-b018-ccb30f03edd5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:09.801715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff53b0a-5d0d-44fb-9171-0c8f13127af3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:09.835937 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163a65d-b4d7-47d8-a47f-64fce23a8968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:09.836773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163a65d-b4d7-47d8-a47f-64fce23a8968 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:09.837059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163a65d-b4d7-47d8-a47f-64fce23a8968 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:09.837350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163a65d-b4d7-47d8-a47f-64fce23a8968 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:09.849210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163a65d-b4d7-47d8-a47f-64fce23a8968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-1163a65d-b4d7-47d8-a47f-64fce23a8968 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:47:09.856873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:09.857955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:09.858830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:09.858830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:09.858830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:09.858830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:09.858830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:47:09.858830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:47:09.858830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:47:09.858830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:47:09.858830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:47:09.858830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:47:09.858830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:09.858830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:09.858830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 550/1100] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:47:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 11 20:47:09.863836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163a65d-b4d7-47d8-a47f-64fce23a8968 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:09.895329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ae9a3-89e0-40ca-b018-ccb30f03edd5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:09.926715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1c452-718a-455a-910b-94a8cdac6d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:09.927378 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1c452-718a-455a-910b-94a8cdac6d7b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:09.927668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1c452-718a-455a-910b-94a8cdac6d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:09.927946 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1c452-718a-455a-910b-94a8cdac6d7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:09.928774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1c452-718a-455a-910b-94a8cdac6d7b None admin] RBAC: Adding query filter params (role.id=2ddc595bde9b4177b6b72d37bfe70957, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=f400b94d3fbc40bdace4860fe83a0891) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:09.929088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1c452-718a-455a-910b-94a8cdac6d7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:09.930557 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1c452-718a-455a-910b-94a8cdac6d7b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:09.936698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 551/1101] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:47:09 2022] GET /identity/v3/role_assignments?user.id=f400b94d3fbc40bdace4860fe83a0891&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=2ddc595bde9b4177b6b72d37bfe70957 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:09.958073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163a65d-b4d7-47d8-a47f-64fce23a8968 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:09.992487 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda96ab-b4c6-4a1b-bd59-67d45f0296d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:09.993179 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda96ab-b4c6-4a1b-bd59-67d45f0296d1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:09.993459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda96ab-b4c6-4a1b-bd59-67d45f0296d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:09.993761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda96ab-b4c6-4a1b-bd59-67d45f0296d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:09.995080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda96ab-b4c6-4a1b-bd59-67d45f0296d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:09.995384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda96ab-b4c6-4a1b-bd59-67d45f0296d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:09.996805 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda96ab-b4c6-4a1b-bd59-67d45f0296d1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:10.006211 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 551/1102] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:47:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:10.012321 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1c452-718a-455a-910b-94a8cdac6d7b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:10.117143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1c452-718a-455a-910b-94a8cdac6d7b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:10.150804 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f04434-343d-411e-813d-d16e30525e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:10.151724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f04434-343d-411e-813d-d16e30525e1b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:10.152026 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f04434-343d-411e-813d-d16e30525e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:10.152298 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f04434-343d-411e-813d-d16e30525e1b None admin] PATH_INFO: `/v3/users/a396c927592349179b1fd35c0cc1084d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:10.153477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f04434-343d-411e-813d-d16e30525e1b None admin] RBAC: Authorizing `identity:get_user(user_id=a396c927592349179b1fd35c0cc1084d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:10.154923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f04434-343d-411e-813d-d16e30525e1b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:10.156530 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 552/1103] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:10 2022] GET /identity/v3/users/a396c927592349179b1fd35c0cc1084d => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:10.162744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda96ab-b4c6-4a1b-bd59-67d45f0296d1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:10.262848 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda96ab-b4c6-4a1b-bd59-67d45f0296d1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:10.296241 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357418e-2732-4ddd-a5ea-74194c51a8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:10.296901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357418e-2732-4ddd-a5ea-74194c51a8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:10.297178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357418e-2732-4ddd-a5ea-74194c51a8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:10.297453 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357418e-2732-4ddd-a5ea-74194c51a8b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:10.362527 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357418e-2732-4ddd-a5ea-74194c51a8b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:10.363994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357418e-2732-4ddd-a5ea-74194c51a8b9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:10.458431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 552/1104] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:47:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:47:10.464918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f04434-343d-411e-813d-d16e30525e1b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:10.568101 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f04434-343d-411e-813d-d16e30525e1b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:10.600625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640d424-ebec-4d8a-a013-6cbc9b0f3f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:10.601493 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d424-ebec-4d8a-a013-6cbc9b0f3f99 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:10.601808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d424-ebec-4d8a-a013-6cbc9b0f3f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:10.602082 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d424-ebec-4d8a-a013-6cbc9b0f3f99 None admin] PATH_INFO: `/v3/projects/adc5d9effe9f4ada91f771c38da04019` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:10.603270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640d424-ebec-4d8a-a013-6cbc9b0f3f99 None admin] RBAC: Authorizing `identity:get_project(project_id=adc5d9effe9f4ada91f771c38da04019)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:10.605342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640d424-ebec-4d8a-a013-6cbc9b0f3f99 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:10.607249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 553/1105] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:47:10 2022] GET /identity/v3/projects/adc5d9effe9f4ada91f771c38da04019 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:10.613293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357418e-2732-4ddd-a5ea-74194c51a8b9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:10.711019 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357418e-2732-4ddd-a5ea-74194c51a8b9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:10.746553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607e633-51e8-45fd-a8b1-d88fe9cad04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:10.747205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607e633-51e8-45fd-a8b1-d88fe9cad04e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:10.747486 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607e633-51e8-45fd-a8b1-d88fe9cad04e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:10.747761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607e633-51e8-45fd-a8b1-d88fe9cad04e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:10.748583 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607e633-51e8-45fd-a8b1-d88fe9cad04e None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=adc5d9effe9f4ada91f771c38da04019, user.id=a396c927592349179b1fd35c0cc1084d) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:10.748894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607e633-51e8-45fd-a8b1-d88fe9cad04e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:10.750345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607e633-51e8-45fd-a8b1-d88fe9cad04e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:10.756181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 553/1106] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:47:10 2022] GET /identity/v3/role_assignments?user.id=a396c927592349179b1fd35c0cc1084d&scope.project.id=adc5d9effe9f4ada91f771c38da04019&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:13.072856 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af638a-6452-497a-979a-1704e0522daa None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:13.073401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af638a-6452-497a-979a-1704e0522daa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:13.073401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af638a-6452-497a-979a-1704e0522daa None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:13.074816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 554/1107] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:13.080072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef5fa9-8b86-4e8f-b1f5-b33b45c7af6a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:13.080513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef5fa9-8b86-4e8f-b1f5-b33b45c7af6a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:13.080609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef5fa9-8b86-4e8f-b1f5-b33b45c7af6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:13.097455 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f1ef5fa9-8b86-4e8f-b1f5-b33b45c7af6a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:13.098576 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f1ef5fa9-8b86-4e8f-b1f5-b33b45c7af6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:13.160216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 554/1108] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:13.183950 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af638a-6452-497a-979a-1704e0522daa None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:13.279964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af638a-6452-497a-979a-1704e0522daa None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:13.312669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e368df-aef0-47e1-bd3a-edf5f3368e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:13.313441 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e368df-aef0-47e1-bd3a-edf5f3368e18 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:13.313748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e368df-aef0-47e1-bd3a-edf5f3368e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:13.314022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e368df-aef0-47e1-bd3a-edf5f3368e18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:13.315170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e368df-aef0-47e1-bd3a-edf5f3368e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:13.316594 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e368df-aef0-47e1-bd3a-edf5f3368e18 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:13.318217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 555/1109] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:47:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:13.324620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef5fa9-8b86-4e8f-b1f5-b33b45c7af6a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:13.419243 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef5fa9-8b86-4e8f-b1f5-b33b45c7af6a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:13.452030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3b032-5578-405c-b1ad-c6659e680cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:13.452686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3b032-5578-405c-b1ad-c6659e680cb4 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:13.452971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3b032-5578-405c-b1ad-c6659e680cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:13.453247 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3b032-5578-405c-b1ad-c6659e680cb4 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:13.453972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3b032-5578-405c-b1ad-c6659e680cb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:13.455413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3b032-5578-405c-b1ad-c6659e680cb4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:13.554791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 555/1110] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:47:13 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:47:15.801350 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f191d80-fbb2-4a59-b7f7-cb7275b1b971 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:15.801941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f191d80-fbb2-4a59-b7f7-cb7275b1b971 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:15.801941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f191d80-fbb2-4a59-b7f7-cb7275b1b971 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:15.803273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 556/1111] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:15.808542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39312c24-8cce-4615-bc6a-d5d7e2b16b06 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:15.808930 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39312c24-8cce-4615-bc6a-d5d7e2b16b06 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:15.809100 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39312c24-8cce-4615-bc6a-d5d7e2b16b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:15.825369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-39312c24-8cce-4615-bc6a-d5d7e2b16b06 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:15.826570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-39312c24-8cce-4615-bc6a-d5d7e2b16b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:15.888194 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 556/1112] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:15.911579 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f191d80-fbb2-4a59-b7f7-cb7275b1b971 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:16.010570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f191d80-fbb2-4a59-b7f7-cb7275b1b971 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:16.042833 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651ab93-bd5a-47a4-bd04-3e1736c1ddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:16.043658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651ab93-bd5a-47a4-bd04-3e1736c1ddf0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:16.043933 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651ab93-bd5a-47a4-bd04-3e1736c1ddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:16.044199 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651ab93-bd5a-47a4-bd04-3e1736c1ddf0 None admin] PATH_INFO: `/v3/roles/6437cf432fe44cc28aa54208759f1265` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:16.045660 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651ab93-bd5a-47a4-bd04-3e1736c1ddf0 None admin] RBAC: Authorizing `identity:get_role(role_id=6437cf432fe44cc28aa54208759f1265)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:16.047027 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651ab93-bd5a-47a4-bd04-3e1736c1ddf0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:16.048348 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 557/1113] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:15 2022] GET /identity/v3/roles/6437cf432fe44cc28aa54208759f1265 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:16.054076 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39312c24-8cce-4615-bc6a-d5d7e2b16b06 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:16.145482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39312c24-8cce-4615-bc6a-d5d7e2b16b06 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:16.177128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd332b16-6ead-4718-a54f-6fbb137b3db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:16.178004 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd332b16-6ead-4718-a54f-6fbb137b3db5 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:16.178292 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd332b16-6ead-4718-a54f-6fbb137b3db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:16.178567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd332b16-6ead-4718-a54f-6fbb137b3db5 None admin] PATH_INFO: `/v3/users/38d4e18c8d1e4adc9935ca4032204acd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:16.190759 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd332b16-6ead-4718-a54f-6fbb137b3db5 None admin] RBAC: Authorizing `identity:get_user(user_id=38d4e18c8d1e4adc9935ca4032204acd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:16.192195 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd332b16-6ead-4718-a54f-6fbb137b3db5 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:16.193824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 557/1114] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:16 2022] GET /identity/v3/users/38d4e18c8d1e4adc9935ca4032204acd => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:16.199919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651ab93-bd5a-47a4-bd04-3e1736c1ddf0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:16.293709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651ab93-bd5a-47a4-bd04-3e1736c1ddf0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:16.324939 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5348b-ccdc-44c1-b2b0-99aacc80f384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:16.325511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5348b-ccdc-44c1-b2b0-99aacc80f384 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:16.325821 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5348b-ccdc-44c1-b2b0-99aacc80f384 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:16.326092 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5348b-ccdc-44c1-b2b0-99aacc80f384 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:16.387986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5348b-ccdc-44c1-b2b0-99aacc80f384 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:16.389413 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5348b-ccdc-44c1-b2b0-99aacc80f384 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:16.480463 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 558/1115] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:47:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:47:16.486312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd332b16-6ead-4718-a54f-6fbb137b3db5 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:16.579586 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd332b16-6ead-4718-a54f-6fbb137b3db5 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:16.611528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45f507-b566-4bb8-90fa-5d0cefde707d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:16.612372 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45f507-b566-4bb8-90fa-5d0cefde707d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:16.612656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45f507-b566-4bb8-90fa-5d0cefde707d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:16.612928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45f507-b566-4bb8-90fa-5d0cefde707d None admin] PATH_INFO: `/v3/projects/adc5d9effe9f4ada91f771c38da04019` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:16.614108 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45f507-b566-4bb8-90fa-5d0cefde707d None admin] RBAC: Authorizing `identity:get_project(project_id=adc5d9effe9f4ada91f771c38da04019)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:16.615533 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45f507-b566-4bb8-90fa-5d0cefde707d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:16.617185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 558/1116] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:47:16 2022] GET /identity/v3/projects/adc5d9effe9f4ada91f771c38da04019 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:16.623833 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5348b-ccdc-44c1-b2b0-99aacc80f384 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:16.715477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5348b-ccdc-44c1-b2b0-99aacc80f384 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:16.747599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61783311-c147-47bd-b756-5e77c1da82a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:16.748312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61783311-c147-47bd-b756-5e77c1da82a9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:16.748598 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61783311-c147-47bd-b756-5e77c1da82a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:16.748874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61783311-c147-47bd-b756-5e77c1da82a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:16.749708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61783311-c147-47bd-b756-5e77c1da82a9 None admin] RBAC: Adding query filter params (role.id=6437cf432fe44cc28aa54208759f1265, scope.project.id=adc5d9effe9f4ada91f771c38da04019, user.id=38d4e18c8d1e4adc9935ca4032204acd) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:16.750022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61783311-c147-47bd-b756-5e77c1da82a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:16.751429 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61783311-c147-47bd-b756-5e77c1da82a9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:16.756528 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 559/1117] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:47:16 2022] GET /identity/v3/role_assignments?user.id=38d4e18c8d1e4adc9935ca4032204acd&scope.project.id=adc5d9effe9f4ada91f771c38da04019&role.id=6437cf432fe44cc28aa54208759f1265 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:18.917686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51903942-7fa0-410c-8f5f-a24ad41ad5b2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:18.918175 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51903942-7fa0-410c-8f5f-a24ad41ad5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:18.918286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51903942-7fa0-410c-8f5f-a24ad41ad5b2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:18.919582 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 559/1118] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:18.924616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c02ae-3123-439f-b15f-1e8dc64859ba None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:18.924988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c02ae-3123-439f-b15f-1e8dc64859ba None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:18.925169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c02ae-3123-439f-b15f-1e8dc64859ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:18.941262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b23c02ae-3123-439f-b15f-1e8dc64859ba None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:18.942463 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b23c02ae-3123-439f-b15f-1e8dc64859ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:19.004085 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 560/1119] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:19.026858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51903942-7fa0-410c-8f5f-a24ad41ad5b2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:19.120503 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51903942-7fa0-410c-8f5f-a24ad41ad5b2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:19.152665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2c73-a475-48e6-9719-3e7bf640924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:19.153493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2c73-a475-48e6-9719-3e7bf640924f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:19.153806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2c73-a475-48e6-9719-3e7bf640924f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:19.154081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2c73-a475-48e6-9719-3e7bf640924f None admin] PATH_INFO: `/v3/roles/6437cf432fe44cc28aa54208759f1265` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:19.155515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a2c73-a475-48e6-9719-3e7bf640924f None admin] RBAC: Authorizing `identity:get_role(role_id=6437cf432fe44cc28aa54208759f1265)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:19.156875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a2c73-a475-48e6-9719-3e7bf640924f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:19.158222 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 560/1120] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:19 2022] GET /identity/v3/roles/6437cf432fe44cc28aa54208759f1265 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:19.163692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c02ae-3123-439f-b15f-1e8dc64859ba None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:19.253698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c02ae-3123-439f-b15f-1e8dc64859ba None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:19.285809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df93e4-66b5-46ba-81c9-676771745ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:19.286651 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df93e4-66b5-46ba-81c9-676771745ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:19.286927 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df93e4-66b5-46ba-81c9-676771745ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:19.287199 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df93e4-66b5-46ba-81c9-676771745ab0 None admin] PATH_INFO: `/v3/users/38d4e18c8d1e4adc9935ca4032204acd` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:19.288355 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df93e4-66b5-46ba-81c9-676771745ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=38d4e18c8d1e4adc9935ca4032204acd)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:19.289783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df93e4-66b5-46ba-81c9-676771745ab0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:19.291379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 561/1121] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:19 2022] GET /identity/v3/users/38d4e18c8d1e4adc9935ca4032204acd => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:19.296762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2c73-a475-48e6-9719-3e7bf640924f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:19.389366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2c73-a475-48e6-9719-3e7bf640924f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:19.421365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c69d8-c53f-4d5e-a0b4-14e97b86a4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:19.422261 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c69d8-c53f-4d5e-a0b4-14e97b86a4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:19.422543 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c69d8-c53f-4d5e-a0b4-14e97b86a4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:19.422814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c69d8-c53f-4d5e-a0b4-14e97b86a4c0 None admin] PATH_INFO: `/v3/projects/adc5d9effe9f4ada91f771c38da04019` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:19.423983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c69d8-c53f-4d5e-a0b4-14e97b86a4c0 None admin] RBAC: Authorizing `identity:get_project(project_id=adc5d9effe9f4ada91f771c38da04019)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:19.425408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c69d8-c53f-4d5e-a0b4-14e97b86a4c0 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:19.427106 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 561/1122] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:47:19 2022] GET /identity/v3/projects/adc5d9effe9f4ada91f771c38da04019 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:19.433397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df93e4-66b5-46ba-81c9-676771745ab0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:19.526761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df93e4-66b5-46ba-81c9-676771745ab0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:19.558445 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57160293-17de-4739-ab47-ac749cbcb033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:19.559305 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57160293-17de-4739-ab47-ac749cbcb033 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:19.559591 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57160293-17de-4739-ab47-ac749cbcb033 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:19.559861 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57160293-17de-4739-ab47-ac749cbcb033 None admin] PATH_INFO: `/v3/projects/adc5d9effe9f4ada91f771c38da04019/users/38d4e18c8d1e4adc9935ca4032204acd/roles/6437cf432fe44cc28aa54208759f1265` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:19.562173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57160293-17de-4739-ab47-ac749cbcb033 None admin] RBAC: Authorizing `identity:create_grant(project_id=adc5d9effe9f4ada91f771c38da04019, user_id=38d4e18c8d1e4adc9935ca4032204acd, role_id=6437cf432fe44cc28aa54208759f1265)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:19.563617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57160293-17de-4739-ab47-ac749cbcb033 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:19.633969 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 562/1123] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:47:19 2022] PUT /identity/v3/projects/adc5d9effe9f4ada91f771c38da04019/users/38d4e18c8d1e4adc9935ca4032204acd/roles/6437cf432fe44cc28aa54208759f1265 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:47:21.786677 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d06e8d-dd77-474b-b1d1-cdd7be65efe3 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:21.787243 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d06e8d-dd77-474b-b1d1-cdd7be65efe3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:21.787243 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d06e8d-dd77-474b-b1d1-cdd7be65efe3 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:21.788579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 562/1124] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:21.794386 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5595f-de89-4163-9075-1e7111402dd3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:21.794801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5595f-de89-4163-9075-1e7111402dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:21.794937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5595f-de89-4163-9075-1e7111402dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:21.810990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c4b5595f-de89-4163-9075-1e7111402dd3 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:21.812138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c4b5595f-de89-4163-9075-1e7111402dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:21.874368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 563/1125] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:21.897519 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d06e8d-dd77-474b-b1d1-cdd7be65efe3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:21.991512 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d06e8d-dd77-474b-b1d1-cdd7be65efe3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:22.022913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e65f3-a05c-4a8e-a2ed-1153608c1588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:22.023744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e65f3-a05c-4a8e-a2ed-1153608c1588 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:22.024031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e65f3-a05c-4a8e-a2ed-1153608c1588 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:22.024305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e65f3-a05c-4a8e-a2ed-1153608c1588 None admin] PATH_INFO: `/v3/roles/6437cf432fe44cc28aa54208759f1265` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:22.026354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e65f3-a05c-4a8e-a2ed-1153608c1588 None admin] RBAC: Authorizing `identity:get_role(role_id=6437cf432fe44cc28aa54208759f1265)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:22.027718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e65f3-a05c-4a8e-a2ed-1153608c1588 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:22.029039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 563/1126] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:21 2022] GET /identity/v3/roles/6437cf432fe44cc28aa54208759f1265 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:22.034600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5595f-de89-4163-9075-1e7111402dd3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:22.124532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5595f-de89-4163-9075-1e7111402dd3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:22.156598 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c007f-def7-4338-962f-045781d655f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:22.157432 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c007f-def7-4338-962f-045781d655f4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:22.157738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c007f-def7-4338-962f-045781d655f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:22.158013 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c007f-def7-4338-962f-045781d655f4 None admin] PATH_INFO: `/v3/users/38d4e18c8d1e4adc9935ca4032204acd` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:22.159168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c007f-def7-4338-962f-045781d655f4 None admin] RBAC: Authorizing `identity:get_user(user_id=38d4e18c8d1e4adc9935ca4032204acd)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:22.160579 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c007f-def7-4338-962f-045781d655f4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:22.162239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 564/1127] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:22 2022] GET /identity/v3/users/38d4e18c8d1e4adc9935ca4032204acd => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:22.167749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e65f3-a05c-4a8e-a2ed-1153608c1588 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:22.259275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e65f3-a05c-4a8e-a2ed-1153608c1588 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:22.291310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fcf3d-47f8-4adf-a238-583880ecb5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:22.291943 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fcf3d-47f8-4adf-a238-583880ecb5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:22.292227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fcf3d-47f8-4adf-a238-583880ecb5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:22.292502 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fcf3d-47f8-4adf-a238-583880ecb5c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:22.354096 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fcf3d-47f8-4adf-a238-583880ecb5c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:22.355528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fcf3d-47f8-4adf-a238-583880ecb5c9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:22.446080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 564/1128] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:47:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:47:22.452479 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c007f-def7-4338-962f-045781d655f4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:22.544406 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c007f-def7-4338-962f-045781d655f4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:22.576448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dab2e-84fb-474b-ba3a-6a225a5dc8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:22.577269 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dab2e-84fb-474b-ba3a-6a225a5dc8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:22.577632 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dab2e-84fb-474b-ba3a-6a225a5dc8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:22.577912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dab2e-84fb-474b-ba3a-6a225a5dc8d5 None admin] PATH_INFO: `/v3/projects/adc5d9effe9f4ada91f771c38da04019` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:22.579061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dab2e-84fb-474b-ba3a-6a225a5dc8d5 None admin] RBAC: Authorizing `identity:get_project(project_id=adc5d9effe9f4ada91f771c38da04019)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:22.580468 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dab2e-84fb-474b-ba3a-6a225a5dc8d5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:22.582127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 565/1129] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:47:22 2022] GET /identity/v3/projects/adc5d9effe9f4ada91f771c38da04019 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:22.587932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fcf3d-47f8-4adf-a238-583880ecb5c9 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:22.684529 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fcf3d-47f8-4adf-a238-583880ecb5c9 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:22.716163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db2ce8-b1ce-4a1f-9828-c9b02648ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:22.716744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db2ce8-b1ce-4a1f-9828-c9b02648ef48 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:22.717027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db2ce8-b1ce-4a1f-9828-c9b02648ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:22.717303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db2ce8-b1ce-4a1f-9828-c9b02648ef48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:22.718148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db2ce8-b1ce-4a1f-9828-c9b02648ef48 None admin] RBAC: Adding query filter params (role.id=6437cf432fe44cc28aa54208759f1265, scope.project.id=adc5d9effe9f4ada91f771c38da04019, user.id=38d4e18c8d1e4adc9935ca4032204acd) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:22.718459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db2ce8-b1ce-4a1f-9828-c9b02648ef48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:22.719867 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db2ce8-b1ce-4a1f-9828-c9b02648ef48 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:22.725364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 565/1130] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:47:22 2022] GET /identity/v3/role_assignments?user.id=38d4e18c8d1e4adc9935ca4032204acd&scope.project.id=adc5d9effe9f4ada91f771c38da04019&role.id=6437cf432fe44cc28aa54208759f1265 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:24.924823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedeb3c8-6bdc-441f-9ac2-de1903df166c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:24.925335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedeb3c8-6bdc-441f-9ac2-de1903df166c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:24.925444 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedeb3c8-6bdc-441f-9ac2-de1903df166c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:24.926778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 566/1131] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:24.932584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b6156-8ce8-4fbb-baf2-8e2f10ea7520 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:24.933020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b6156-8ce8-4fbb-baf2-8e2f10ea7520 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:24.933145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b6156-8ce8-4fbb-baf2-8e2f10ea7520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:24.949985 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-025b6156-8ce8-4fbb-baf2-8e2f10ea7520 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:24.951148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-025b6156-8ce8-4fbb-baf2-8e2f10ea7520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:25.012803 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 566/1132] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:25.035756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedeb3c8-6bdc-441f-9ac2-de1903df166c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:25.131074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedeb3c8-6bdc-441f-9ac2-de1903df166c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:25.162476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f325787-af3a-4f27-bfe7-3fa1dbf271d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:25.163236 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f325787-af3a-4f27-bfe7-3fa1dbf271d6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:25.163518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f325787-af3a-4f27-bfe7-3fa1dbf271d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:25.163790 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f325787-af3a-4f27-bfe7-3fa1dbf271d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:25.164941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f325787-af3a-4f27-bfe7-3fa1dbf271d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:25.166897 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f325787-af3a-4f27-bfe7-3fa1dbf271d6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:25.168460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 567/1133] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:47:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:25.174087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b6156-8ce8-4fbb-baf2-8e2f10ea7520 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:25.266568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b6156-8ce8-4fbb-baf2-8e2f10ea7520 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:25.298083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe05a0-4baf-44a3-adb5-0b03c7a40336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:25.298720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe05a0-4baf-44a3-adb5-0b03c7a40336 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:25.299003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe05a0-4baf-44a3-adb5-0b03c7a40336 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:25.299278 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe05a0-4baf-44a3-adb5-0b03c7a40336 None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:25.299974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe05a0-4baf-44a3-adb5-0b03c7a40336 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:25.301404 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe05a0-4baf-44a3-adb5-0b03c7a40336 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:25.409906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 567/1134] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 11 20:47:25 2022] POST /identity/v3/projects => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:47:27.627503 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9861924-1bb0-4e4d-a151-c71fb1a69940 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:27.628041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9861924-1bb0-4e4d-a151-c71fb1a69940 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:27.628041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9861924-1bb0-4e4d-a151-c71fb1a69940 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:27.629408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 568/1135] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:27.634716 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ff12b-65f6-4302-94ea-7c748c155198 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:27.635164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ff12b-65f6-4302-94ea-7c748c155198 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:27.635261 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ff12b-65f6-4302-94ea-7c748c155198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:27.652380 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e26ff12b-65f6-4302-94ea-7c748c155198 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:27.653586 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e26ff12b-65f6-4302-94ea-7c748c155198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:27.715498 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 568/1136] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:27.740451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9861924-1bb0-4e4d-a151-c71fb1a69940 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:27.835375 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9861924-1bb0-4e4d-a151-c71fb1a69940 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:27.867903 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aec911-496b-4b50-b931-6c6c68ebd0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:27.868710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aec911-496b-4b50-b931-6c6c68ebd0ef None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:27.868990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aec911-496b-4b50-b931-6c6c68ebd0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:27.869263 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aec911-496b-4b50-b931-6c6c68ebd0ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:27.870447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aec911-496b-4b50-b931-6c6c68ebd0ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:27.871870 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aec911-496b-4b50-b931-6c6c68ebd0ef None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:27.873466 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 569/1137] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:47:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:27.879216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ff12b-65f6-4302-94ea-7c748c155198 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:27.970850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ff12b-65f6-4302-94ea-7c748c155198 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:28.001633 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d15bb0-62c6-4a0a-aa53-6b5743c328b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:28.002289 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d15bb0-62c6-4a0a-aa53-6b5743c328b4 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:28.002573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d15bb0-62c6-4a0a-aa53-6b5743c328b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:28.002852 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d15bb0-62c6-4a0a-aa53-6b5743c328b4 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:28.003553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d15bb0-62c6-4a0a-aa53-6b5743c328b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:28.004977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d15bb0-62c6-4a0a-aa53-6b5743c328b4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:28.109013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 569/1138] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:47:27 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:47:30.323400 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add60c3a-b983-49f2-baec-6d6aad9e61b2 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:30.323916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add60c3a-b983-49f2-baec-6d6aad9e61b2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:30.324008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add60c3a-b983-49f2-baec-6d6aad9e61b2 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:30.325322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 570/1139] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:30.330558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c5ca1-c52f-46f7-acde-d8fca970d0df None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:30.330951 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c5ca1-c52f-46f7-acde-d8fca970d0df None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:30.331115 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c5ca1-c52f-46f7-acde-d8fca970d0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:30.347246 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d70c5ca1-c52f-46f7-acde-d8fca970d0df None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:30.348407 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d70c5ca1-c52f-46f7-acde-d8fca970d0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:30.409636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 570/1140] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:30.433649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add60c3a-b983-49f2-baec-6d6aad9e61b2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:30.528010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add60c3a-b983-49f2-baec-6d6aad9e61b2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:30.559664 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd07c28-f60a-47bb-b522-de9d8640ec78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:30.560426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07c28-f60a-47bb-b522-de9d8640ec78 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:30.560704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07c28-f60a-47bb-b522-de9d8640ec78 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:30.560975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd07c28-f60a-47bb-b522-de9d8640ec78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:30.570550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd07c28-f60a-47bb-b522-de9d8640ec78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-cbd07c28-f60a-47bb-b522-de9d8640ec78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:47:30.579078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:30.580303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:30.581272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:30.581272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:30.581272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:30.581272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:30.581272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:47:30.581272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:47:30.581272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:47:30.581272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:47:30.581272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:47:30.581272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:47:30.581272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:30.581272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:47:30.581272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 571/1141] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:47:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:30.586158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c5ca1-c52f-46f7-acde-d8fca970d0df None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:30.677909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c5ca1-c52f-46f7-acde-d8fca970d0df None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:30.708803 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f1ebe-f32b-4203-8129-136fa8a24ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:30.709453 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f1ebe-f32b-4203-8129-136fa8a24ffc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:30.709768 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f1ebe-f32b-4203-8129-136fa8a24ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:30.710047 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f1ebe-f32b-4203-8129-136fa8a24ffc None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:30.710782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f1ebe-f32b-4203-8129-136fa8a24ffc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:30.711091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f1ebe-f32b-4203-8129-136fa8a24ffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:30.712991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f1ebe-f32b-4203-8129-136fa8a24ffc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:30.720597 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 571/1142] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:47:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:30.726177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd07c28-f60a-47bb-b522-de9d8640ec78 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:30.820005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd07c28-f60a-47bb-b522-de9d8640ec78 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:30.912164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4440b9e-6820-41cb-a3d7-7666ba21230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:30.913022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4440b9e-6820-41cb-a3d7-7666ba21230c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:30.913301 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4440b9e-6820-41cb-a3d7-7666ba21230c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:30.913600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4440b9e-6820-41cb-a3d7-7666ba21230c None admin] PATH_INFO: `/v3/users/49c4dc5cdb0c4fe784d795529f20d698` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:30.926682 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4440b9e-6820-41cb-a3d7-7666ba21230c None admin] RBAC: Authorizing `identity:get_user(user_id=49c4dc5cdb0c4fe784d795529f20d698)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:30.928118 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4440b9e-6820-41cb-a3d7-7666ba21230c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:30.929753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 572/1143] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:30 2022] GET /identity/v3/users/49c4dc5cdb0c4fe784d795529f20d698 => generated 286 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:30.935421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f1ebe-f32b-4203-8129-136fa8a24ffc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:31.034880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f1ebe-f32b-4203-8129-136fa8a24ffc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:31.066906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148fca-247b-4f7b-b115-2f2fbc2fd6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:31.067537 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148fca-247b-4f7b-b115-2f2fbc2fd6ac None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:31.067817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148fca-247b-4f7b-b115-2f2fbc2fd6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:31.068095 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148fca-247b-4f7b-b115-2f2fbc2fd6ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:31.130161 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6148fca-247b-4f7b-b115-2f2fbc2fd6ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:31.131524 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6148fca-247b-4f7b-b115-2f2fbc2fd6ac None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:31.221804 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 572/1144] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:47:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:47:31.227596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4440b9e-6820-41cb-a3d7-7666ba21230c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:31.320199 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4440b9e-6820-41cb-a3d7-7666ba21230c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:31.352898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e535f1-6520-4d94-9cb2-f2a983d5fd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:31.353753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e535f1-6520-4d94-9cb2-f2a983d5fd3d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:31.354034 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e535f1-6520-4d94-9cb2-f2a983d5fd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:31.354306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e535f1-6520-4d94-9cb2-f2a983d5fd3d None admin] PATH_INFO: `/v3/projects/7bd38072f4a742be902589e1c96ffe68` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:31.355446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e535f1-6520-4d94-9cb2-f2a983d5fd3d None admin] RBAC: Authorizing `identity:get_project(project_id=7bd38072f4a742be902589e1c96ffe68)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:31.356857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e535f1-6520-4d94-9cb2-f2a983d5fd3d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:31.358524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 573/1145] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:47:31 2022] GET /identity/v3/projects/7bd38072f4a742be902589e1c96ffe68 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:31.364365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148fca-247b-4f7b-b115-2f2fbc2fd6ac None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:31.456143 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148fca-247b-4f7b-b115-2f2fbc2fd6ac None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:31.486675 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f2538-50e9-4fbf-bad3-344491cf5928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:31.487308 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f2538-50e9-4fbf-bad3-344491cf5928 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:31.487589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f2538-50e9-4fbf-bad3-344491cf5928 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:31.487864 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f2538-50e9-4fbf-bad3-344491cf5928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:31.488672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f2538-50e9-4fbf-bad3-344491cf5928 None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=7bd38072f4a742be902589e1c96ffe68, user.id=49c4dc5cdb0c4fe784d795529f20d698) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:31.488981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f2538-50e9-4fbf-bad3-344491cf5928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:31.490408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f2538-50e9-4fbf-bad3-344491cf5928 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:31.496003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 573/1146] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:47:31 2022] GET /identity/v3/role_assignments?user.id=49c4dc5cdb0c4fe784d795529f20d698&scope.project.id=7bd38072f4a742be902589e1c96ffe68&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:33.648953 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe243e-0ed5-479f-acdc-e2c6eaa5aabf None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:33.650027 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe243e-0ed5-479f-acdc-e2c6eaa5aabf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:33.650132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe243e-0ed5-479f-acdc-e2c6eaa5aabf None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:33.651404 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 574/1147] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:33.656472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668815c5-c615-45fe-9116-8094a61c0c93 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:33.656848 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668815c5-c615-45fe-9116-8094a61c0c93 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:33.657021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668815c5-c615-45fe-9116-8094a61c0c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:33.673653 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-668815c5-c615-45fe-9116-8094a61c0c93 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:33.674814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-668815c5-c615-45fe-9116-8094a61c0c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:33.735528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 574/1148] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:33.757062 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe243e-0ed5-479f-acdc-e2c6eaa5aabf None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:33.853639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe243e-0ed5-479f-acdc-e2c6eaa5aabf None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:33.884535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5928c-ebe4-4f33-9050-7776f3904086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:33.885305 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5928c-ebe4-4f33-9050-7776f3904086 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:33.885611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5928c-ebe4-4f33-9050-7776f3904086 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:33.885884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5928c-ebe4-4f33-9050-7776f3904086 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:33.895639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5928c-ebe4-4f33-9050-7776f3904086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-60d5928c-ebe4-4f33-9050-7776f3904086 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:47:33.903696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:33.904813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:33.905960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:33.905960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:33.905960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:33.905960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:33.905960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:47:33.905960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:47:33.905960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:47:33.905960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:47:33.905960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:47:33.905960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:47:33.905960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:33.905960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:47:33.905960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 575/1149] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:47:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:33.910672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668815c5-c615-45fe-9116-8094a61c0c93 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:34.001399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668815c5-c615-45fe-9116-8094a61c0c93 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:34.033287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83e218-191c-450a-a55f-15005b93f983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:34.033974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e218-191c-450a-a55f-15005b93f983 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:34.034256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e218-191c-450a-a55f-15005b93f983 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:34.034529 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e218-191c-450a-a55f-15005b93f983 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:34.035255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83e218-191c-450a-a55f-15005b93f983 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:34.035559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83e218-191c-450a-a55f-15005b93f983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:34.036912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83e218-191c-450a-a55f-15005b93f983 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:34.044976 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 575/1150] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:47:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:34.050585 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5928c-ebe4-4f33-9050-7776f3904086 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:34.144561 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5928c-ebe4-4f33-9050-7776f3904086 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:34.176448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a121531-f103-4588-8b16-2ef33deaa6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:34.177225 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a121531-f103-4588-8b16-2ef33deaa6ff None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:34.177503 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a121531-f103-4588-8b16-2ef33deaa6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:34.177804 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a121531-f103-4588-8b16-2ef33deaa6ff None admin] PATH_INFO: `/v3/users/49c4dc5cdb0c4fe784d795529f20d698` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:34.179048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a121531-f103-4588-8b16-2ef33deaa6ff None admin] RBAC: Authorizing `identity:get_user(user_id=49c4dc5cdb0c4fe784d795529f20d698)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:34.180465 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a121531-f103-4588-8b16-2ef33deaa6ff None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:34.182097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 576/1151] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:34 2022] GET /identity/v3/users/49c4dc5cdb0c4fe784d795529f20d698 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:34.187691 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83e218-191c-450a-a55f-15005b93f983 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:34.284043 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83e218-191c-450a-a55f-15005b93f983 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:34.315813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a976eec-ae07-4e24-82ab-62abf94c91b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:34.316668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a976eec-ae07-4e24-82ab-62abf94c91b8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:34.316950 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a976eec-ae07-4e24-82ab-62abf94c91b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:34.317225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a976eec-ae07-4e24-82ab-62abf94c91b8 None admin] PATH_INFO: `/v3/projects/7bd38072f4a742be902589e1c96ffe68` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:34.318417 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a976eec-ae07-4e24-82ab-62abf94c91b8 None admin] RBAC: Authorizing `identity:get_project(project_id=7bd38072f4a742be902589e1c96ffe68)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:34.319846 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a976eec-ae07-4e24-82ab-62abf94c91b8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:34.321602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 576/1152] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:47:34 2022] GET /identity/v3/projects/7bd38072f4a742be902589e1c96ffe68 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:34.327341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a121531-f103-4588-8b16-2ef33deaa6ff None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:34.420005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a121531-f103-4588-8b16-2ef33deaa6ff None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:34.450498 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c8b75-d972-40da-a3f4-db2fd70ae89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:34.451297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8b75-d972-40da-a3f4-db2fd70ae89d None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:34.451570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8b75-d972-40da-a3f4-db2fd70ae89d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:34.451838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8b75-d972-40da-a3f4-db2fd70ae89d None admin] PATH_INFO: `/v3/projects/7bd38072f4a742be902589e1c96ffe68/users/49c4dc5cdb0c4fe784d795529f20d698/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:34.453758 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c8b75-d972-40da-a3f4-db2fd70ae89d None admin] RBAC: Authorizing `identity:create_grant(project_id=7bd38072f4a742be902589e1c96ffe68, user_id=49c4dc5cdb0c4fe784d795529f20d698, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:34.455179 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c8b75-d972-40da-a3f4-db2fd70ae89d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:34.531057 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 577/1153] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:47:34 2022] PUT /identity/v3/projects/7bd38072f4a742be902589e1c96ffe68/users/49c4dc5cdb0c4fe784d795529f20d698/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:47:36.684413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418c0e-28e9-4e6a-bd6f-53f8a99385c2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:36.684972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418c0e-28e9-4e6a-bd6f-53f8a99385c2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:36.684972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3418c0e-28e9-4e6a-bd6f-53f8a99385c2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:36.686348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 577/1154] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:36.691679 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f19f-9570-463b-bc68-bf49c58c2b87 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:36.692102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f19f-9570-463b-bc68-bf49c58c2b87 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:36.692239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f19f-9570-463b-bc68-bf49c58c2b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:36.712162 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f149f19f-9570-463b-bc68-bf49c58c2b87 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:36.713428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f149f19f-9570-463b-bc68-bf49c58c2b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:36.777480 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 578/1155] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:36.800600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3418c0e-28e9-4e6a-bd6f-53f8a99385c2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:36.897831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3418c0e-28e9-4e6a-bd6f-53f8a99385c2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:36.929610 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ee8b0-58c0-4bd0-8d54-a16c04928653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:36.930385 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ee8b0-58c0-4bd0-8d54-a16c04928653 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:36.930665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ee8b0-58c0-4bd0-8d54-a16c04928653 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:36.930936 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ee8b0-58c0-4bd0-8d54-a16c04928653 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:36.940841 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ee8b0-58c0-4bd0-8d54-a16c04928653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b97ee8b0-58c0-4bd0-8d54-a16c04928653 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:47:36.948786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:36.949955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:36.951109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:36.951109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:36.951109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:36.951109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:36.951109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:47:36.951109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:47:36.951109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:47:36.951109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:47:36.951109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:47:36.951109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:47:36.951109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:36.951109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:36.951109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 578/1156] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:47:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:36.955879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149f19f-9570-463b-bc68-bf49c58c2b87 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:37.048952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149f19f-9570-463b-bc68-bf49c58c2b87 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:37.080725 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfcd48-cdd1-48cb-8073-e17778b8f5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:37.081377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfcd48-cdd1-48cb-8073-e17778b8f5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:37.081691 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfcd48-cdd1-48cb-8073-e17778b8f5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:37.081969 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfcd48-cdd1-48cb-8073-e17778b8f5b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:37.082701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfcd48-cdd1-48cb-8073-e17778b8f5b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:37.083010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfcd48-cdd1-48cb-8073-e17778b8f5b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:37.084363 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfcd48-cdd1-48cb-8073-e17778b8f5b8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:37.092683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 579/1157] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:47:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:37.098254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ee8b0-58c0-4bd0-8d54-a16c04928653 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:37.189308 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ee8b0-58c0-4bd0-8d54-a16c04928653 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:37.221072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811809a-1f34-4ca2-aabf-430256656c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:37.221878 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811809a-1f34-4ca2-aabf-430256656c13 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:37.222157 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811809a-1f34-4ca2-aabf-430256656c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:37.222428 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811809a-1f34-4ca2-aabf-430256656c13 None admin] PATH_INFO: `/v3/users/49c4dc5cdb0c4fe784d795529f20d698` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:37.223591 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811809a-1f34-4ca2-aabf-430256656c13 None admin] RBAC: Authorizing `identity:get_user(user_id=49c4dc5cdb0c4fe784d795529f20d698)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:37.225006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811809a-1f34-4ca2-aabf-430256656c13 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:37.226599 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 579/1158] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:37 2022] GET /identity/v3/users/49c4dc5cdb0c4fe784d795529f20d698 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:37.232162 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfcd48-cdd1-48cb-8073-e17778b8f5b8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:37.334011 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfcd48-cdd1-48cb-8073-e17778b8f5b8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:37.364957 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4c68c-e495-4967-b8ec-73223487f2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:37.365621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4c68c-e495-4967-b8ec-73223487f2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:37.365907 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4c68c-e495-4967-b8ec-73223487f2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:37.366186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4c68c-e495-4967-b8ec-73223487f2a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:37.429101 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4c68c-e495-4967-b8ec-73223487f2a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:37.431060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4c68c-e495-4967-b8ec-73223487f2a1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:37.521951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 580/1159] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:47:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:47:37.527710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811809a-1f34-4ca2-aabf-430256656c13 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:37.619032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811809a-1f34-4ca2-aabf-430256656c13 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:37.651199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527404e-ed52-4cb8-80e4-053688243493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:37.652041 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527404e-ed52-4cb8-80e4-053688243493 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:37.652324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527404e-ed52-4cb8-80e4-053688243493 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:37.652600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527404e-ed52-4cb8-80e4-053688243493 None admin] PATH_INFO: `/v3/projects/7bd38072f4a742be902589e1c96ffe68` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:37.653783 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527404e-ed52-4cb8-80e4-053688243493 None admin] RBAC: Authorizing `identity:get_project(project_id=7bd38072f4a742be902589e1c96ffe68)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:37.655206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527404e-ed52-4cb8-80e4-053688243493 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:37.656870 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 580/1160] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:47:37 2022] GET /identity/v3/projects/7bd38072f4a742be902589e1c96ffe68 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:37.662612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4c68c-e495-4967-b8ec-73223487f2a1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:37.755409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4c68c-e495-4967-b8ec-73223487f2a1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:37.786837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824b197-8195-4b69-9b7f-e3800277cc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:37.787478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824b197-8195-4b69-9b7f-e3800277cc55 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:37.787761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824b197-8195-4b69-9b7f-e3800277cc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:37.788038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824b197-8195-4b69-9b7f-e3800277cc55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:37.788849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824b197-8195-4b69-9b7f-e3800277cc55 None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=7bd38072f4a742be902589e1c96ffe68, user.id=49c4dc5cdb0c4fe784d795529f20d698) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:37.789161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824b197-8195-4b69-9b7f-e3800277cc55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:37.791146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824b197-8195-4b69-9b7f-e3800277cc55 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:37.796648 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 581/1161] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:47:37 2022] GET /identity/v3/role_assignments?user.id=49c4dc5cdb0c4fe784d795529f20d698&scope.project.id=7bd38072f4a742be902589e1c96ffe68&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:40.009220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1d307-084f-4d07-8934-ad567276a796 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:40.009762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1d307-084f-4d07-8934-ad567276a796 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:40.009848 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1d307-084f-4d07-8934-ad567276a796 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:40.011148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 581/1162] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:40.016281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d2842-68eb-4001-a0f6-8e36ee05fbed None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:40.016665 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d2842-68eb-4001-a0f6-8e36ee05fbed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:40.016846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d2842-68eb-4001-a0f6-8e36ee05fbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:40.034645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0d4d2842-68eb-4001-a0f6-8e36ee05fbed None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:40.035815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0d4d2842-68eb-4001-a0f6-8e36ee05fbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:40.098813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 582/1163] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:40.128999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1d307-084f-4d07-8934-ad567276a796 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:40.224661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1d307-084f-4d07-8934-ad567276a796 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:40.255510 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8f90a-c5d7-4cb0-a5ff-e8abbac0ba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:40.256146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8f90a-c5d7-4cb0-a5ff-e8abbac0ba02 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:40.256430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8f90a-c5d7-4cb0-a5ff-e8abbac0ba02 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:40.256708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8f90a-c5d7-4cb0-a5ff-e8abbac0ba02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:40.319556 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8f90a-c5d7-4cb0-a5ff-e8abbac0ba02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:40.321021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8f90a-c5d7-4cb0-a5ff-e8abbac0ba02 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:40.411561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 582/1164] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:47:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:47:40.417945 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d2842-68eb-4001-a0f6-8e36ee05fbed None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:40.508727 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d2842-68eb-4001-a0f6-8e36ee05fbed None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:40.541040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8db5d9-ad67-4508-aeaf-63838c6acd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:40.541852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db5d9-ad67-4508-aeaf-63838c6acd35 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:40.542133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db5d9-ad67-4508-aeaf-63838c6acd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:40.542406 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db5d9-ad67-4508-aeaf-63838c6acd35 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:40.548910 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8db5d9-ad67-4508-aeaf-63838c6acd35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:40.550358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8db5d9-ad67-4508-aeaf-63838c6acd35 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8b8db5d9-ad67-4508-aeaf-63838c6acd35 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:40.564086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:40.565287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:47:40.566259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 583/1165] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 11 20:47:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:40.571071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8f90a-c5d7-4cb0-a5ff-e8abbac0ba02 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:40.662404 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8f90a-c5d7-4cb0-a5ff-e8abbac0ba02 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:40.694561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd15fb-6ffc-4357-91ac-99e307747e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:40.695200 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd15fb-6ffc-4357-91ac-99e307747e38 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:40.695481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd15fb-6ffc-4357-91ac-99e307747e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:40.696236 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd15fb-6ffc-4357-91ac-99e307747e38 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:40.696948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd15fb-6ffc-4357-91ac-99e307747e38 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:40.697251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd15fb-6ffc-4357-91ac-99e307747e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:40.698632 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd15fb-6ffc-4357-91ac-99e307747e38 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:40.705354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 583/1166] 10.222.0.35 () {56 vars in 1115 bytes} [Wed May 11 20:47:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:42.859724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f37a7b-57c8-45d4-a374-0d69bcaa9960 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:42.860238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f37a7b-57c8-45d4-a374-0d69bcaa9960 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:42.860337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f37a7b-57c8-45d4-a374-0d69bcaa9960 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:42.861655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 584/1167] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:42.866850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ea91b-dc38-47cf-ab60-8796777d3cd6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:42.867272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ea91b-dc38-47cf-ab60-8796777d3cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:42.867408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ea91b-dc38-47cf-ab60-8796777d3cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:42.883511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-563ea91b-dc38-47cf-ab60-8796777d3cd6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:42.884679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-563ea91b-dc38-47cf-ab60-8796777d3cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:42.947038 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 584/1168] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:47:42.969492 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f37a7b-57c8-45d4-a374-0d69bcaa9960 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:43.063752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f37a7b-57c8-45d4-a374-0d69bcaa9960 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:43.096122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141aed38-af14-49e9-b91b-934a8e365645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:43.096701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aed38-af14-49e9-b91b-934a8e365645 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:43.096986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aed38-af14-49e9-b91b-934a8e365645 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:43.097262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141aed38-af14-49e9-b91b-934a8e365645 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:43.098026 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141aed38-af14-49e9-b91b-934a8e365645 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:43.099381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141aed38-af14-49e9-b91b-934a8e365645 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:43.177541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 585/1169] 10.222.0.35 () {60 vars in 1138 bytes} [Wed May 11 20:47:42 2022] POST /identity/v3/domains => generated 267 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:47:45.366865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5aab8-a85e-4e35-9ac0-d4979a06fbef None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:45.367417 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5aab8-a85e-4e35-9ac0-d4979a06fbef None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:45.367417 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5aab8-a85e-4e35-9ac0-d4979a06fbef None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:45.368762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 585/1170] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:45.373867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60961d9f-25ed-4ce0-860e-ea898c4862b3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:45.374285 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60961d9f-25ed-4ce0-860e-ea898c4862b3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:45.374434 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60961d9f-25ed-4ce0-860e-ea898c4862b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:45.391086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-60961d9f-25ed-4ce0-860e-ea898c4862b3 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:45.392248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-60961d9f-25ed-4ce0-860e-ea898c4862b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:45.454956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 586/1171] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:45.477801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5aab8-a85e-4e35-9ac0-d4979a06fbef None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:45.572067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5aab8-a85e-4e35-9ac0-d4979a06fbef None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:45.602905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54035974-5065-426e-8f1f-8555fc7d24d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:45.603744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54035974-5065-426e-8f1f-8555fc7d24d1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:45.604025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54035974-5065-426e-8f1f-8555fc7d24d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:45.604295 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54035974-5065-426e-8f1f-8555fc7d24d1 None admin] PATH_INFO: `/v3/domains/d1c135ae6c264383849cbe4d9a9e613a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:45.614006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54035974-5065-426e-8f1f-8555fc7d24d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d1c135ae6c264383849cbe4d9a9e613a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:45.615428 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54035974-5065-426e-8f1f-8555fc7d24d1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:45.617054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 586/1172] 10.222.0.35 () {56 vars in 1183 bytes} [Wed May 11 20:47:45 2022] GET /identity/v3/domains/d1c135ae6c264383849cbe4d9a9e613a => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:45.623162 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60961d9f-25ed-4ce0-860e-ea898c4862b3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:45.713701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60961d9f-25ed-4ce0-860e-ea898c4862b3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:45.744747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3d8e5-6920-4868-9119-817c735f645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:45.745409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d8e5-6920-4868-9119-817c735f645a None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:45.745721 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d8e5-6920-4868-9119-817c735f645a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:45.745994 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d8e5-6920-4868-9119-817c735f645a None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:45.746678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3d8e5-6920-4868-9119-817c735f645a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:45.748079 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3d8e5-6920-4868-9119-817c735f645a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:45.841070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 587/1173] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 11 20:47:45 2022] POST /identity/v3/projects => generated 361 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:47:48.078778 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca3ad-21fc-497f-8d4c-2b0fb8f473e4 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:48.079328 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca3ad-21fc-497f-8d4c-2b0fb8f473e4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:48.079328 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca3ad-21fc-497f-8d4c-2b0fb8f473e4 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:48.080680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 587/1174] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:48.085906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba5b1-1ff0-4792-8a43-69d6a116a035 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:48.086362 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba5b1-1ff0-4792-8a43-69d6a116a035 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:48.086470 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba5b1-1ff0-4792-8a43-69d6a116a035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:48.102741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a8fba5b1-1ff0-4792-8a43-69d6a116a035 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:48.103893 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a8fba5b1-1ff0-4792-8a43-69d6a116a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:48.167304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 588/1175] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:48.192336 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca3ad-21fc-497f-8d4c-2b0fb8f473e4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:48.287388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca3ad-21fc-497f-8d4c-2b0fb8f473e4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:48.319293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f79d1c-dfe4-431c-bde6-114cd2685b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:48.320130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f79d1c-dfe4-431c-bde6-114cd2685b3d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:48.320437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f79d1c-dfe4-431c-bde6-114cd2685b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:48.320711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f79d1c-dfe4-431c-bde6-114cd2685b3d None admin] PATH_INFO: `/v3/domains/d1c135ae6c264383849cbe4d9a9e613a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:48.321906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f79d1c-dfe4-431c-bde6-114cd2685b3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=d1c135ae6c264383849cbe4d9a9e613a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:48.323332 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f79d1c-dfe4-431c-bde6-114cd2685b3d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:48.324901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 588/1176] 10.222.0.35 () {56 vars in 1183 bytes} [Wed May 11 20:47:48 2022] GET /identity/v3/domains/d1c135ae6c264383849cbe4d9a9e613a => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:48.330480 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fba5b1-1ff0-4792-8a43-69d6a116a035 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:48.423165 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fba5b1-1ff0-4792-8a43-69d6a116a035 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:48.454756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e08d7-5afe-4e62-a864-12e49e751e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:48.455409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e08d7-5afe-4e62-a864-12e49e751e26 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:48.455694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e08d7-5afe-4e62-a864-12e49e751e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:48.455972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e08d7-5afe-4e62-a864-12e49e751e26 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:48.456669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e08d7-5afe-4e62-a864-12e49e751e26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:48.458130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e08d7-5afe-4e62-a864-12e49e751e26 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:48.545492 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 589/1177] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:47:48 2022] POST /identity/v3/users => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:47:50.773129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255c854-0e98-450c-8b51-902955218372 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:50.773746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255c854-0e98-450c-8b51-902955218372 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:50.773746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255c854-0e98-450c-8b51-902955218372 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:50.775069 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 589/1178] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:50.780718 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bcaac-99ee-4c38-b7c2-63ebaf0c66c5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:50.781161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bcaac-99ee-4c38-b7c2-63ebaf0c66c5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:50.781264 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bcaac-99ee-4c38-b7c2-63ebaf0c66c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:50.798078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b25bcaac-99ee-4c38-b7c2-63ebaf0c66c5 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:50.800596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b25bcaac-99ee-4c38-b7c2-63ebaf0c66c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:50.863373 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 590/1179] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:47:50.888981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255c854-0e98-450c-8b51-902955218372 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:50.983133 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255c854-0e98-450c-8b51-902955218372 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:51.014319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3225130-62bd-404d-94ad-db14be8c69b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:51.015098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225130-62bd-404d-94ad-db14be8c69b6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:51.015382 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225130-62bd-404d-94ad-db14be8c69b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:51.015658 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225130-62bd-404d-94ad-db14be8c69b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:51.026097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3225130-62bd-404d-94ad-db14be8c69b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-a3225130-62bd-404d-94ad-db14be8c69b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:47:51.033622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:51.034843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:51.036158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:51.036158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:51.036158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:51.036158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:51.036158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:47:51.036158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:47:51.036158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:47:51.036158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:47:51.036158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:47:51.036158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:47:51.036158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:51.036158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:51.036158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 590/1180] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:47:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:51.041238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bcaac-99ee-4c38-b7c2-63ebaf0c66c5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:51.132537 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bcaac-99ee-4c38-b7c2-63ebaf0c66c5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:51.165418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336049f2-efd7-483c-b9f3-a836d30c522a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:51.166139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336049f2-efd7-483c-b9f3-a836d30c522a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:51.166423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336049f2-efd7-483c-b9f3-a836d30c522a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:51.166699 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336049f2-efd7-483c-b9f3-a836d30c522a None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:51.167434 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336049f2-efd7-483c-b9f3-a836d30c522a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:51.167740 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336049f2-efd7-483c-b9f3-a836d30c522a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:51.169101 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336049f2-efd7-483c-b9f3-a836d30c522a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:51.176676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 591/1181] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:47:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:51.182169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3225130-62bd-404d-94ad-db14be8c69b6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:51.275978 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3225130-62bd-404d-94ad-db14be8c69b6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:51.306396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a74bb-d6e8-4cd0-9191-078de4707650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:51.307243 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a74bb-d6e8-4cd0-9191-078de4707650 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:51.307523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a74bb-d6e8-4cd0-9191-078de4707650 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:51.307793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a74bb-d6e8-4cd0-9191-078de4707650 None admin] PATH_INFO: `/v3/users/1fefb4152271478faaaa198ca06963b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:51.321006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a74bb-d6e8-4cd0-9191-078de4707650 None admin] RBAC: Authorizing `identity:get_user(user_id=1fefb4152271478faaaa198ca06963b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:51.322454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a74bb-d6e8-4cd0-9191-078de4707650 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:51.324041 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 591/1182] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:51 2022] GET /identity/v3/users/1fefb4152271478faaaa198ca06963b6 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:51.329571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336049f2-efd7-483c-b9f3-a836d30c522a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:51.423065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336049f2-efd7-483c-b9f3-a836d30c522a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:51.454242 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe54c3-f491-40a0-861a-362fb48e800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:51.454872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe54c3-f491-40a0-861a-362fb48e800e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:51.455168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe54c3-f491-40a0-861a-362fb48e800e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:51.455428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe54c3-f491-40a0-861a-362fb48e800e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:51.517515 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe54c3-f491-40a0-861a-362fb48e800e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:51.519245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe54c3-f491-40a0-861a-362fb48e800e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:51.609909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 592/1183] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:47:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:47:51.615520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a74bb-d6e8-4cd0-9191-078de4707650 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:51.708507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a74bb-d6e8-4cd0-9191-078de4707650 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:51.739322 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3928f-c824-4b3c-8197-4e3b417d4259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:51.740162 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3928f-c824-4b3c-8197-4e3b417d4259 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:51.740447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3928f-c824-4b3c-8197-4e3b417d4259 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:51.740720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3928f-c824-4b3c-8197-4e3b417d4259 None admin] PATH_INFO: `/v3/projects/c9ad5130348849ed89f08e95c691a5ee` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:51.741909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3928f-c824-4b3c-8197-4e3b417d4259 None admin] RBAC: Authorizing `identity:get_project(project_id=c9ad5130348849ed89f08e95c691a5ee)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:51.743824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3928f-c824-4b3c-8197-4e3b417d4259 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:51.745485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 592/1184] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:47:51 2022] GET /identity/v3/projects/c9ad5130348849ed89f08e95c691a5ee => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:51.751332 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe54c3-f491-40a0-861a-362fb48e800e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:51.844967 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe54c3-f491-40a0-861a-362fb48e800e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:51.876733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5521b38-f3c8-4811-bf81-19554e8b71b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:51.877312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5521b38-f3c8-4811-bf81-19554e8b71b6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:51.877616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5521b38-f3c8-4811-bf81-19554e8b71b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:51.877891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5521b38-f3c8-4811-bf81-19554e8b71b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:51.878698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5521b38-f3c8-4811-bf81-19554e8b71b6 None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=c9ad5130348849ed89f08e95c691a5ee, user.id=1fefb4152271478faaaa198ca06963b6) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:51.879003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5521b38-f3c8-4811-bf81-19554e8b71b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:51.880413 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5521b38-f3c8-4811-bf81-19554e8b71b6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:51.886134 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 593/1185] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:47:51 2022] GET /identity/v3/role_assignments?user.id=1fefb4152271478faaaa198ca06963b6&scope.project.id=c9ad5130348849ed89f08e95c691a5ee&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:47:54.041337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438647a-fd29-41f2-89a9-8d97e40c2d5f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:54.041911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438647a-fd29-41f2-89a9-8d97e40c2d5f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:54.041911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438647a-fd29-41f2-89a9-8d97e40c2d5f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:54.043275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 593/1186] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:54.048538 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0810e-0214-49dd-8aa8-bf2d4c21439f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:54.048906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0810e-0214-49dd-8aa8-bf2d4c21439f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:54.049101 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0810e-0214-49dd-8aa8-bf2d4c21439f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:54.065717 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cbb0810e-0214-49dd-8aa8-bf2d4c21439f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:54.066898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cbb0810e-0214-49dd-8aa8-bf2d4c21439f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:54.129486 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 594/1187] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:54.152086 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438647a-fd29-41f2-89a9-8d97e40c2d5f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:54.246580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438647a-fd29-41f2-89a9-8d97e40c2d5f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:54.277724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc3d33-3951-4717-9940-ebc0e762ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:54.278497 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc3d33-3951-4717-9940-ebc0e762ccc6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:54.278783 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc3d33-3951-4717-9940-ebc0e762ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:54.279061 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc3d33-3951-4717-9940-ebc0e762ccc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:54.288517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc3d33-3951-4717-9940-ebc0e762ccc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-09cc3d33-3951-4717-9940-ebc0e762ccc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:47:54.296559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:54.297782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:54.298655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:54.298655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:54.298655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:54.298655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:54.298655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:47:54.298655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:47:54.298655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:47:54.298655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:47:54.298655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:47:54.298655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:47:54.298655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:54.298655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:47:54.298655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 594/1188] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:47:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:54.303509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0810e-0214-49dd-8aa8-bf2d4c21439f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:54.394315 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0810e-0214-49dd-8aa8-bf2d4c21439f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:54.425419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c27e0-c4cc-42e2-b18f-b6f1c3077555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:54.426087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c27e0-c4cc-42e2-b18f-b6f1c3077555 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:54.426367 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c27e0-c4cc-42e2-b18f-b6f1c3077555 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:54.426638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c27e0-c4cc-42e2-b18f-b6f1c3077555 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:54.427366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c27e0-c4cc-42e2-b18f-b6f1c3077555 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:54.427669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c27e0-c4cc-42e2-b18f-b6f1c3077555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:54.429008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c27e0-c4cc-42e2-b18f-b6f1c3077555 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:54.437087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 595/1189] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:47:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:54.442628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc3d33-3951-4717-9940-ebc0e762ccc6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:54.533835 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc3d33-3951-4717-9940-ebc0e762ccc6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:54.565149 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaebbd-7ec0-4f02-8f07-1acae87db2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:54.566030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaebbd-7ec0-4f02-8f07-1acae87db2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:54.566309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaebbd-7ec0-4f02-8f07-1acae87db2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:54.566578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaebbd-7ec0-4f02-8f07-1acae87db2d1 None admin] PATH_INFO: `/v3/users/1fefb4152271478faaaa198ca06963b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:54.567735 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacaebbd-7ec0-4f02-8f07-1acae87db2d1 None admin] RBAC: Authorizing `identity:get_user(user_id=1fefb4152271478faaaa198ca06963b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:54.569155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacaebbd-7ec0-4f02-8f07-1acae87db2d1 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:54.570805 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 595/1190] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:54 2022] GET /identity/v3/users/1fefb4152271478faaaa198ca06963b6 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:54.576401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c27e0-c4cc-42e2-b18f-b6f1c3077555 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:54.668977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c27e0-c4cc-42e2-b18f-b6f1c3077555 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:54.699546 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedeedde-ede7-4173-a892-1f41e6c22ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:54.700480 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeedde-ede7-4173-a892-1f41e6c22ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:54.700756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeedde-ede7-4173-a892-1f41e6c22ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:54.701024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeedde-ede7-4173-a892-1f41e6c22ff5 None admin] PATH_INFO: `/v3/projects/c9ad5130348849ed89f08e95c691a5ee` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:54.702188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedeedde-ede7-4173-a892-1f41e6c22ff5 None admin] RBAC: Authorizing `identity:get_project(project_id=c9ad5130348849ed89f08e95c691a5ee)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:54.703600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedeedde-ede7-4173-a892-1f41e6c22ff5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:54.705235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 596/1191] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:47:54 2022] GET /identity/v3/projects/c9ad5130348849ed89f08e95c691a5ee => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:54.711527 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaebbd-7ec0-4f02-8f07-1acae87db2d1 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:54.804325 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaebbd-7ec0-4f02-8f07-1acae87db2d1 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:54.834991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a24ab3-6026-4e09-b9e2-9ada62491935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:54.836384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a24ab3-6026-4e09-b9e2-9ada62491935 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:54.836664 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a24ab3-6026-4e09-b9e2-9ada62491935 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:54.836937 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a24ab3-6026-4e09-b9e2-9ada62491935 None admin] PATH_INFO: `/v3/projects/c9ad5130348849ed89f08e95c691a5ee/users/1fefb4152271478faaaa198ca06963b6/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:54.838903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a24ab3-6026-4e09-b9e2-9ada62491935 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9ad5130348849ed89f08e95c691a5ee, user_id=1fefb4152271478faaaa198ca06963b6, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:54.840354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a24ab3-6026-4e09-b9e2-9ada62491935 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:54.939364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 596/1192] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:47:54 2022] PUT /identity/v3/projects/c9ad5130348849ed89f08e95c691a5ee/users/1fefb4152271478faaaa198ca06963b6/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:47:57.106711 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa390f-04d6-4e74-9378-52d152ae4e2c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:57.107223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa390f-04d6-4e74-9378-52d152ae4e2c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:57.107223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa390f-04d6-4e74-9378-52d152ae4e2c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:57.108563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 597/1193] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:47:57.113737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f70cb-d209-4b46-b2af-8a76242fc290 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:57.114120 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f70cb-d209-4b46-b2af-8a76242fc290 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:57.114303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f70cb-d209-4b46-b2af-8a76242fc290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:57.131008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-da3f70cb-d209-4b46-b2af-8a76242fc290 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:47:57.132184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-da3f70cb-d209-4b46-b2af-8a76242fc290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:47:57.194803 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 597/1194] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:47:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:47:57.217970 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa390f-04d6-4e74-9378-52d152ae4e2c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:57.314291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa390f-04d6-4e74-9378-52d152ae4e2c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:57.345446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e973f1c-4da7-457a-afc9-c460f406e748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:57.346246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e973f1c-4da7-457a-afc9-c460f406e748 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:57.346530 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e973f1c-4da7-457a-afc9-c460f406e748 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:57.346806 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e973f1c-4da7-457a-afc9-c460f406e748 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:57.356955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e973f1c-4da7-457a-afc9-c460f406e748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3e973f1c-4da7-457a-afc9-c460f406e748 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:47:57.364580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:47:57.365707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:47:57.367421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:47:57.367421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:47:57.367421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:47:57.367421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:47:57.367421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:47:57.367421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:47:57.367421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:47:57.367421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:47:57.367421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:47:57.367421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:47:57.367421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:47:57.367421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:47:57.367421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 598/1195] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:47:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:47:57.372051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f70cb-d209-4b46-b2af-8a76242fc290 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:57.462525 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f70cb-d209-4b46-b2af-8a76242fc290 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:57.494807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb802a24-a680-4e2b-be00-109ceb8027a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:57.495454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb802a24-a680-4e2b-be00-109ceb8027a7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:57.495733 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb802a24-a680-4e2b-be00-109ceb8027a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:57.496006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb802a24-a680-4e2b-be00-109ceb8027a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:57.496735 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb802a24-a680-4e2b-be00-109ceb8027a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:57.497041 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb802a24-a680-4e2b-be00-109ceb8027a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:57.498429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb802a24-a680-4e2b-be00-109ceb8027a7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:57.505926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 598/1196] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:47:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:57.511453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e973f1c-4da7-457a-afc9-c460f406e748 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:57.606665 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e973f1c-4da7-457a-afc9-c460f406e748 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:57.639194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624234e-9139-4b96-afda-b6e415c2b9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:57.639983 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624234e-9139-4b96-afda-b6e415c2b9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:57.640265 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624234e-9139-4b96-afda-b6e415c2b9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:57.640537 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624234e-9139-4b96-afda-b6e415c2b9d9 None admin] PATH_INFO: `/v3/users/1fefb4152271478faaaa198ca06963b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:57.641732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624234e-9139-4b96-afda-b6e415c2b9d9 None admin] RBAC: Authorizing `identity:get_user(user_id=1fefb4152271478faaaa198ca06963b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:57.643173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624234e-9139-4b96-afda-b6e415c2b9d9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:57.645044 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 599/1197] 10.222.0.35 () {56 vars in 1177 bytes} [Wed May 11 20:47:57 2022] GET /identity/v3/users/1fefb4152271478faaaa198ca06963b6 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:57.650831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb802a24-a680-4e2b-be00-109ceb8027a7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:57.744131 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb802a24-a680-4e2b-be00-109ceb8027a7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:57.775752 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47c30e-00c8-450c-a05c-ab8c8a4d42e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:57.776397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c30e-00c8-450c-a05c-ab8c8a4d42e6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:57.776681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c30e-00c8-450c-a05c-ab8c8a4d42e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:57.776958 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c30e-00c8-450c-a05c-ab8c8a4d42e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:57.840130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47c30e-00c8-450c-a05c-ab8c8a4d42e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:57.841619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47c30e-00c8-450c-a05c-ab8c8a4d42e6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:57.934019 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 599/1198] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:47:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:47:57.939854 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624234e-9139-4b96-afda-b6e415c2b9d9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:58.034546 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624234e-9139-4b96-afda-b6e415c2b9d9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:58.066507 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871f2c3-115a-4246-8e37-90ff6cb3a96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:58.067355 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871f2c3-115a-4246-8e37-90ff6cb3a96d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:58.067637 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871f2c3-115a-4246-8e37-90ff6cb3a96d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:58.067908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871f2c3-115a-4246-8e37-90ff6cb3a96d None admin] PATH_INFO: `/v3/projects/c9ad5130348849ed89f08e95c691a5ee` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:58.069078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871f2c3-115a-4246-8e37-90ff6cb3a96d None admin] RBAC: Authorizing `identity:get_project(project_id=c9ad5130348849ed89f08e95c691a5ee)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:58.070524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871f2c3-115a-4246-8e37-90ff6cb3a96d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:58.072213 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 600/1199] 10.222.0.35 () {56 vars in 1186 bytes} [Wed May 11 20:47:57 2022] GET /identity/v3/projects/c9ad5130348849ed89f08e95c691a5ee => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:47:58.078218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47c30e-00c8-450c-a05c-ab8c8a4d42e6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:47:58.169465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47c30e-00c8-450c-a05c-ab8c8a4d42e6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:47:58.200716 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d1889-f90a-4830-b4fb-67b113bc65fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:47:58.201293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d1889-f90a-4830-b4fb-67b113bc65fb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:47:58.201598 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d1889-f90a-4830-b4fb-67b113bc65fb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:47:58.201874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d1889-f90a-4830-b4fb-67b113bc65fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:47:58.202691 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d1889-f90a-4830-b4fb-67b113bc65fb None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=c9ad5130348849ed89f08e95c691a5ee, user.id=1fefb4152271478faaaa198ca06963b6) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:47:58.202999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d1889-f90a-4830-b4fb-67b113bc65fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:47:58.204411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d1889-f90a-4830-b4fb-67b113bc65fb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:47:58.209866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 600/1200] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:47:58 2022] GET /identity/v3/role_assignments?user.id=1fefb4152271478faaaa198ca06963b6&scope.project.id=c9ad5130348849ed89f08e95c691a5ee&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:15.094347 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc7bcb-0f53-42e5-bca4-1c8071eac850 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:15.094934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc7bcb-0f53-42e5-bca4-1c8071eac850 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:15.094934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc7bcb-0f53-42e5-bca4-1c8071eac850 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:15.096178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 601/1201] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:49:15.102088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fb365-081a-4375-b565-9d68db11c5b8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:15.102553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fb365-081a-4375-b565-9d68db11c5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:15.102652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fb365-081a-4375-b565-9d68db11c5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:15.119284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fe5fb365-081a-4375-b565-9d68db11c5b8 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:49:15.120501 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fe5fb365-081a-4375-b565-9d68db11c5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:49:15.184554 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 601/1202] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:49:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:49:15.209829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc7bcb-0f53-42e5-bca4-1c8071eac850 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:15.309086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc7bcb-0f53-42e5-bca4-1c8071eac850 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:15.343023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74d15f-e661-4d0c-8e2a-e128d78fd18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:15.343796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d15f-e661-4d0c-8e2a-e128d78fd18e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:15.344079 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d15f-e661-4d0c-8e2a-e128d78fd18e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:15.344401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d15f-e661-4d0c-8e2a-e128d78fd18e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:15.354490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74d15f-e661-4d0c-8e2a-e128d78fd18e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:15.361572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74d15f-e661-4d0c-8e2a-e128d78fd18e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5e74d15f-e661-4d0c-8e2a-e128d78fd18e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:49:15.372879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:15.374091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:15.375476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:49:15.375476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:49:15.375476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:15.375476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:15.375476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 602/1203] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:15.380271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fb365-081a-4375-b565-9d68db11c5b8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:15.474844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fb365-081a-4375-b565-9d68db11c5b8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:15.507879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478ff70-c182-4291-9bf4-e83d76573e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:15.508544 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478ff70-c182-4291-9bf4-e83d76573e22 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:15.508828 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478ff70-c182-4291-9bf4-e83d76573e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:15.509107 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478ff70-c182-4291-9bf4-e83d76573e22 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:15.509856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478ff70-c182-4291-9bf4-e83d76573e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:15.510168 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478ff70-c182-4291-9bf4-e83d76573e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:15.511558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478ff70-c182-4291-9bf4-e83d76573e22 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:15.522912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 602/1204] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:15.528592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74d15f-e661-4d0c-8e2a-e128d78fd18e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:15.625572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74d15f-e661-4d0c-8e2a-e128d78fd18e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:15.658814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee98811-c61f-4a1a-b0c7-f2aa6fba0940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:15.659476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee98811-c61f-4a1a-b0c7-f2aa6fba0940 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:15.659833 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee98811-c61f-4a1a-b0c7-f2aa6fba0940 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:15.660110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee98811-c61f-4a1a-b0c7-f2aa6fba0940 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:15.660794 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee98811-c61f-4a1a-b0c7-f2aa6fba0940 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:15.662269 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee98811-c61f-4a1a-b0c7-f2aa6fba0940 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:15.745058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 603/1205] 10.222.0.35 () {60 vars in 1132 bytes} [Wed May 11 20:49:15 2022] POST /identity/v3/users => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 20:49:17.949891 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0942d-d07f-4d60-b664-6fd929beb584 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:17.950443 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0942d-d07f-4d60-b664-6fd929beb584 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:17.950443 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0942d-d07f-4d60-b664-6fd929beb584 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:17.951813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 603/1206] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:49:17.957192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142b76-af01-4cab-98bc-27c31df507a0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:17.957652 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142b76-af01-4cab-98bc-27c31df507a0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:17.957780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142b76-af01-4cab-98bc-27c31df507a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:17.975685 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-20142b76-af01-4cab-98bc-27c31df507a0 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:49:17.976863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-20142b76-af01-4cab-98bc-27c31df507a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:49:18.041064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 604/1207] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:49:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:49:18.064408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0942d-d07f-4d60-b664-6fd929beb584 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:18.161655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0942d-d07f-4d60-b664-6fd929beb584 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:18.194311 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af388f6-867d-4d02-980d-e95810aff156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:18.195329 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af388f6-867d-4d02-980d-e95810aff156 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:18.195608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af388f6-867d-4d02-980d-e95810aff156 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:18.195876 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af388f6-867d-4d02-980d-e95810aff156 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:18.205661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af388f6-867d-4d02-980d-e95810aff156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-3af388f6-867d-4d02-980d-e95810aff156 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:49:18.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:18.216449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:18.217367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:18.217367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:18.217367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:18.217367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:18.217367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:49:18.217367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:49:18.217367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:49:18.217367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:49:18.217367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:49:18.217367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:49:18.217367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:49:18.217367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:18.217367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 604/1208] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:49:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:18.221574 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20142b76-af01-4cab-98bc-27c31df507a0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:18.316005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20142b76-af01-4cab-98bc-27c31df507a0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:18.350974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8d798-180f-445b-9fe5-cc409f31b0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:18.351629 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8d798-180f-445b-9fe5-cc409f31b0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:18.351909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8d798-180f-445b-9fe5-cc409f31b0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:18.352183 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8d798-180f-445b-9fe5-cc409f31b0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:18.352911 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8d798-180f-445b-9fe5-cc409f31b0f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:18.353217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8d798-180f-445b-9fe5-cc409f31b0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:18.354642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8d798-180f-445b-9fe5-cc409f31b0f1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:18.362208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 605/1209] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:49:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:18.368058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af388f6-867d-4d02-980d-e95810aff156 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:18.464656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af388f6-867d-4d02-980d-e95810aff156 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:18.496811 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc24f7-4b03-4454-8c0e-e82c77ceac0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:18.497618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc24f7-4b03-4454-8c0e-e82c77ceac0a None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:18.497906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc24f7-4b03-4454-8c0e-e82c77ceac0a None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:18.498184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc24f7-4b03-4454-8c0e-e82c77ceac0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:18.509062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc24f7-4b03-4454-8c0e-e82c77ceac0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:18.510531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc24f7-4b03-4454-8c0e-e82c77ceac0a None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-d7fc24f7-4b03-4454-8c0e-e82c77ceac0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:49:18.527571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:18.528674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:18.529847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:49:18.529847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:49:18.529847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:18.529847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:18.529847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 605/1210] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:18.534662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8d798-180f-445b-9fe5-cc409f31b0f1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:18.638330 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8d798-180f-445b-9fe5-cc409f31b0f1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:18.670765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac829ba5-f510-4366-bd75-6d59563ce0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:18.671422 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac829ba5-f510-4366-bd75-6d59563ce0eb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:18.671704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac829ba5-f510-4366-bd75-6d59563ce0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:18.671978 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac829ba5-f510-4366-bd75-6d59563ce0eb None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:18.672696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac829ba5-f510-4366-bd75-6d59563ce0eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:18.672995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac829ba5-f510-4366-bd75-6d59563ce0eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:18.674423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac829ba5-f510-4366-bd75-6d59563ce0eb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:18.686381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 606/1211] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:18.692322 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc24f7-4b03-4454-8c0e-e82c77ceac0a None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:18.790530 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc24f7-4b03-4454-8c0e-e82c77ceac0a None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:18.825515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96764c7-7359-4b07-bce1-c53197fa5c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:18.826353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96764c7-7359-4b07-bce1-c53197fa5c99 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:18.826683 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96764c7-7359-4b07-bce1-c53197fa5c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:18.826956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96764c7-7359-4b07-bce1-c53197fa5c99 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:18.834817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96764c7-7359-4b07-bce1-c53197fa5c99 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:18.836255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96764c7-7359-4b07-bce1-c53197fa5c99 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b96764c7-7359-4b07-bce1-c53197fa5c99 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:49:18.851048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:18.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:18.853219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:18.853219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:18.853219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:49:18.853219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:49:18.853219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:49:18.853219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:49:18.853219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:49:18.853219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:49:18.853219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 20:49:18.853219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:18.853219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 606/1212] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:18.858052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac829ba5-f510-4366-bd75-6d59563ce0eb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:18.955555 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac829ba5-f510-4366-bd75-6d59563ce0eb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:18.987855 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09008c8d-8103-48ca-abfb-4f896bab09bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:18.988527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09008c8d-8103-48ca-abfb-4f896bab09bd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:18.988802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09008c8d-8103-48ca-abfb-4f896bab09bd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:18.989075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09008c8d-8103-48ca-abfb-4f896bab09bd None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:18.989934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09008c8d-8103-48ca-abfb-4f896bab09bd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:18.990240 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09008c8d-8103-48ca-abfb-4f896bab09bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:18.991655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09008c8d-8103-48ca-abfb-4f896bab09bd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:19.008492 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 607/1213] 10.222.0.35 () {56 vars in 1143 bytes} [Wed May 11 20:49:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:19.014464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96764c7-7359-4b07-bce1-c53197fa5c99 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:19.109267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96764c7-7359-4b07-bce1-c53197fa5c99 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:19.141384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938622ca-ae6c-4545-b91b-ac148fda336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:19.142050 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938622ca-ae6c-4545-b91b-ac148fda336b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:19.142333 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938622ca-ae6c-4545-b91b-ac148fda336b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:19.142875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938622ca-ae6c-4545-b91b-ac148fda336b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:19.206025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938622ca-ae6c-4545-b91b-ac148fda336b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:19.207522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938622ca-ae6c-4545-b91b-ac148fda336b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:19.301998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 607/1214] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:49:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:49:19.308345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09008c8d-8103-48ca-abfb-4f896bab09bd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:19.401416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09008c8d-8103-48ca-abfb-4f896bab09bd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:19.433339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dad39-9ad4-44cb-b75c-87d7b8e8e0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:19.434148 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dad39-9ad4-44cb-b75c-87d7b8e8e0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:19.434420 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dad39-9ad4-44cb-b75c-87d7b8e8e0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:19.434694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dad39-9ad4-44cb-b75c-87d7b8e8e0b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:19.444899 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73dad39-9ad4-44cb-b75c-87d7b8e8e0b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:19.446386 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73dad39-9ad4-44cb-b75c-87d7b8e8e0b0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b73dad39-9ad4-44cb-b75c-87d7b8e8e0b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:49:19.463054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:19.469136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:19.470316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:49:19.470316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:49:19.470316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:19.470316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:19.470316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 608/1215] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:19.470677 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938622ca-ae6c-4545-b91b-ac148fda336b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:19.564209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938622ca-ae6c-4545-b91b-ac148fda336b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:19.597630 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f187b6f-70b5-4eff-b229-a0a35422bf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:19.598273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f187b6f-70b5-4eff-b229-a0a35422bf70 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:19.598555 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f187b6f-70b5-4eff-b229-a0a35422bf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:19.598830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f187b6f-70b5-4eff-b229-a0a35422bf70 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:19.600070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f187b6f-70b5-4eff-b229-a0a35422bf70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:19.600376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f187b6f-70b5-4eff-b229-a0a35422bf70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:19.601770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f187b6f-70b5-4eff-b229-a0a35422bf70 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:19.612398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 608/1216] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:19.618741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dad39-9ad4-44cb-b75c-87d7b8e8e0b0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:19.713127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dad39-9ad4-44cb-b75c-87d7b8e8e0b0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:19.745710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168b7b6-e514-42c5-87f1-3895fdda9822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:19.746485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b7b6-e514-42c5-87f1-3895fdda9822 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:19.746773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b7b6-e514-42c5-87f1-3895fdda9822 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:19.747048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168b7b6-e514-42c5-87f1-3895fdda9822 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:19.753424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168b7b6-e514-42c5-87f1-3895fdda9822 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:19.754892 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168b7b6-e514-42c5-87f1-3895fdda9822 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a168b7b6-e514-42c5-87f1-3895fdda9822 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:49:19.768333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:19.769443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:19.770755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:49:19.770755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:49:19.770755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:49:19.770755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:49:19.770755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:49:19.770755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:49:19.770755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:49:19.770755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:19.770755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 609/1217] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:49:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:19.775431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f187b6f-70b5-4eff-b229-a0a35422bf70 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:19.871518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f187b6f-70b5-4eff-b229-a0a35422bf70 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:19.902708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa4c91-18e8-4ae7-9725-9bc2222631ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:19.903362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4c91-18e8-4ae7-9725-9bc2222631ff None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:19.903647 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4c91-18e8-4ae7-9725-9bc2222631ff None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:19.903926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4c91-18e8-4ae7-9725-9bc2222631ff None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:19.904707 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa4c91-18e8-4ae7-9725-9bc2222631ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:19.905019 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa4c91-18e8-4ae7-9725-9bc2222631ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:19.906480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa4c91-18e8-4ae7-9725-9bc2222631ff None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:19.918360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 609/1218] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:49:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:19.924399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168b7b6-e514-42c5-87f1-3895fdda9822 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:20.020789 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168b7b6-e514-42c5-87f1-3895fdda9822 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:20.053708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfea452-8c52-41c2-b22d-694808c0c240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:20.054329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfea452-8c52-41c2-b22d-694808c0c240 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:20.054605 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfea452-8c52-41c2-b22d-694808c0c240 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:20.054874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfea452-8c52-41c2-b22d-694808c0c240 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:20.055711 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfea452-8c52-41c2-b22d-694808c0c240 None admin] RBAC: Adding query filter params (role.id=b18c84f91b764bea92cc22c80a49bcaa, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=59cb32d2807549699e37b27ca97d351c) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:20.056018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfea452-8c52-41c2-b22d-694808c0c240 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:20.057428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfea452-8c52-41c2-b22d-694808c0c240 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:20.062701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 610/1219] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:49:19 2022] GET /identity/v3/role_assignments?user.id=59cb32d2807549699e37b27ca97d351c&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=b18c84f91b764bea92cc22c80a49bcaa => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:22.204827 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ba4c-715c-4875-8763-fa7b62a2d317 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:22.205352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ba4c-715c-4875-8763-fa7b62a2d317 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:22.205352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6ba4c-715c-4875-8763-fa7b62a2d317 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:22.206702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 610/1220] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:49:22.212475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157069-fe34-45ca-9b52-e256b83228b5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:22.212964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157069-fe34-45ca-9b52-e256b83228b5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:22.213072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157069-fe34-45ca-9b52-e256b83228b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:22.229564 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-76157069-fe34-45ca-9b52-e256b83228b5 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:49:22.230738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-76157069-fe34-45ca-9b52-e256b83228b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:49:22.293874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 611/1221] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:49:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:49:22.316293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6ba4c-715c-4875-8763-fa7b62a2d317 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:22.411526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6ba4c-715c-4875-8763-fa7b62a2d317 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:22.442899 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e047f5-c05f-40a7-a713-2a5283f006e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:22.444256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e047f5-c05f-40a7-a713-2a5283f006e6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:22.444536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e047f5-c05f-40a7-a713-2a5283f006e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:22.444808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e047f5-c05f-40a7-a713-2a5283f006e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:22.454601 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e047f5-c05f-40a7-a713-2a5283f006e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-b6e047f5-c05f-40a7-a713-2a5283f006e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:49:22.462470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:22.463655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:22.464571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:22.464571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:22.464571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:22.464571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:22.464571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:49:22.464571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:49:22.464571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:49:22.464571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:49:22.464571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:49:22.464571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:49:22.464571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:49:22.464571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:22.464571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 611/1222] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:49:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:22.469660 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76157069-fe34-45ca-9b52-e256b83228b5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:22.564528 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76157069-fe34-45ca-9b52-e256b83228b5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:22.596429 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba150ce-d0d3-44ca-a013-b3923cb6b02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:22.597093 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba150ce-d0d3-44ca-a013-b3923cb6b02e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:22.597370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba150ce-d0d3-44ca-a013-b3923cb6b02e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:22.597675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba150ce-d0d3-44ca-a013-b3923cb6b02e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:22.602997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba150ce-d0d3-44ca-a013-b3923cb6b02e None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:22.602997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba150ce-d0d3-44ca-a013-b3923cb6b02e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:22.602997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba150ce-d0d3-44ca-a013-b3923cb6b02e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:22.608508 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 612/1223] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:49:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:22.614347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e047f5-c05f-40a7-a713-2a5283f006e6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:22.710117 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e047f5-c05f-40a7-a713-2a5283f006e6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:22.741764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b09cd6-c3a9-423b-9211-89fef1f27745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:22.742489 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b09cd6-c3a9-423b-9211-89fef1f27745 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:22.742769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b09cd6-c3a9-423b-9211-89fef1f27745 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:22.743041 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b09cd6-c3a9-423b-9211-89fef1f27745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:22.752893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b09cd6-c3a9-423b-9211-89fef1f27745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:22.754350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b09cd6-c3a9-423b-9211-89fef1f27745 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-06b09cd6-c3a9-423b-9211-89fef1f27745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:49:22.770743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:22.771806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:22.772970 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:49:22.772970 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:49:22.772970 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:22.772970 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:22.772970 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 612/1224] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:22.777724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba150ce-d0d3-44ca-a013-b3923cb6b02e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:22.873790 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba150ce-d0d3-44ca-a013-b3923cb6b02e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:22.905108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50558992-e517-4dd9-860f-423420d6ed03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:22.905782 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50558992-e517-4dd9-860f-423420d6ed03 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:22.906068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50558992-e517-4dd9-860f-423420d6ed03 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:22.906343 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50558992-e517-4dd9-860f-423420d6ed03 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:22.907048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50558992-e517-4dd9-860f-423420d6ed03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:22.907353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50558992-e517-4dd9-860f-423420d6ed03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:22.908700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50558992-e517-4dd9-860f-423420d6ed03 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:22.920240 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 613/1225] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:22.925875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b09cd6-c3a9-423b-9211-89fef1f27745 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:23.019820 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b09cd6-c3a9-423b-9211-89fef1f27745 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:23.051552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de96398-f7f0-442c-9a11-e5693554b030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:23.052363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de96398-f7f0-442c-9a11-e5693554b030 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:23.052643 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de96398-f7f0-442c-9a11-e5693554b030 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:23.052916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de96398-f7f0-442c-9a11-e5693554b030 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:23.060302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de96398-f7f0-442c-9a11-e5693554b030 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:23.068051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de96398-f7f0-442c-9a11-e5693554b030 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-5de96398-f7f0-442c-9a11-e5693554b030 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:49:23.075695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:23.076830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:23.080933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:23.080933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:23.080933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:49:23.080933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:49:23.080933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:49:23.080933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:49:23.080933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:49:23.080933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:49:23.080933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 20:49:23.080933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:23.080933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 613/1226] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:23.082756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50558992-e517-4dd9-860f-423420d6ed03 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:23.178020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50558992-e517-4dd9-860f-423420d6ed03 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:23.210497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959f253-02ea-48ea-8808-d51ca656c607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:23.211156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959f253-02ea-48ea-8808-d51ca656c607 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:23.211471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959f253-02ea-48ea-8808-d51ca656c607 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:23.211746 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959f253-02ea-48ea-8808-d51ca656c607 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:23.212575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959f253-02ea-48ea-8808-d51ca656c607 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:23.213099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959f253-02ea-48ea-8808-d51ca656c607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:23.214332 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959f253-02ea-48ea-8808-d51ca656c607 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:23.231403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 614/1227] 10.222.0.35 () {56 vars in 1143 bytes} [Wed May 11 20:49:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:23.237206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de96398-f7f0-442c-9a11-e5693554b030 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:23.332682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de96398-f7f0-442c-9a11-e5693554b030 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:23.364818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b76ec-e62d-4444-b1d7-94b70deb54f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:23.365622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b76ec-e62d-4444-b1d7-94b70deb54f6 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:23.365902 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b76ec-e62d-4444-b1d7-94b70deb54f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:23.366171 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b76ec-e62d-4444-b1d7-94b70deb54f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:23.376094 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b76ec-e62d-4444-b1d7-94b70deb54f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:23.377548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b76ec-e62d-4444-b1d7-94b70deb54f6 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-af7b76ec-e62d-4444-b1d7-94b70deb54f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:49:23.395029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:23.396721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:23.397923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:49:23.397923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:49:23.397923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:23.397923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:23.397923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 614/1228] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:23.402468 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959f253-02ea-48ea-8808-d51ca656c607 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:23.497180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959f253-02ea-48ea-8808-d51ca656c607 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:23.530325 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe19ae-076d-45d9-9fb8-b7014982c12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:23.531306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe19ae-076d-45d9-9fb8-b7014982c12d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:23.531306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe19ae-076d-45d9-9fb8-b7014982c12d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:23.531518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe19ae-076d-45d9-9fb8-b7014982c12d None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:23.532229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe19ae-076d-45d9-9fb8-b7014982c12d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:23.532537 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe19ae-076d-45d9-9fb8-b7014982c12d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:23.533925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe19ae-076d-45d9-9fb8-b7014982c12d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:23.544646 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 615/1229] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:23.550263 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b76ec-e62d-4444-b1d7-94b70deb54f6 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:23.646772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b76ec-e62d-4444-b1d7-94b70deb54f6 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:23.677181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494304e4-e526-4491-99b6-238c8c638b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:23.678012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494304e4-e526-4491-99b6-238c8c638b71 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:23.678294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494304e4-e526-4491-99b6-238c8c638b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:23.678568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494304e4-e526-4491-99b6-238c8c638b71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:23.684869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494304e4-e526-4491-99b6-238c8c638b71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:23.686324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494304e4-e526-4491-99b6-238c8c638b71 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-494304e4-e526-4491-99b6-238c8c638b71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:49:23.700416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:23.701606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:23.702612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:49:23.702612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:49:23.702612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:49:23.702612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:49:23.702612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:49:23.702612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:49:23.702612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:49:23.702612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:23.702612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 615/1230] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:49:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:23.707387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe19ae-076d-45d9-9fb8-b7014982c12d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:23.801633 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe19ae-076d-45d9-9fb8-b7014982c12d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:23.834316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f2ccf-d5b3-45a5-8124-b6db2b2da977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:23.834970 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f2ccf-d5b3-45a5-8124-b6db2b2da977 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:23.835257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f2ccf-d5b3-45a5-8124-b6db2b2da977 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:23.835534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f2ccf-d5b3-45a5-8124-b6db2b2da977 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:23.836338 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f2ccf-d5b3-45a5-8124-b6db2b2da977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:23.836650 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f2ccf-d5b3-45a5-8124-b6db2b2da977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:23.838111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f2ccf-d5b3-45a5-8124-b6db2b2da977 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:23.849955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 616/1231] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:49:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:23.856002 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494304e4-e526-4491-99b6-238c8c638b71 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:23.951424 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494304e4-e526-4491-99b6-238c8c638b71 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:23.982885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88a000-5e13-4c7c-b4b5-09d07cc52a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:23.983788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a000-5e13-4c7c-b4b5-09d07cc52a39 None admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:23.984070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a000-5e13-4c7c-b4b5-09d07cc52a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:23.984344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a000-5e13-4c7c-b4b5-09d07cc52a39 None admin] PATH_INFO: `/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/59cb32d2807549699e37b27ca97d351c/roles/b18c84f91b764bea92cc22c80a49bcaa` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:23.998370 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88a000-5e13-4c7c-b4b5-09d07cc52a39 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c03e5fec995436aa5424d2be2e268aa, user_id=59cb32d2807549699e37b27ca97d351c, role_id=b18c84f91b764bea92cc22c80a49bcaa)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:24.003082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88a000-5e13-4c7c-b4b5-09d07cc52a39 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:24.110444 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 616/1232] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:49:23 2022] PUT /identity/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/59cb32d2807549699e37b27ca97d351c/roles/b18c84f91b764bea92cc22c80a49bcaa => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:49:26.270761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9df133-972e-463f-9335-3cd0669d954c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:26.271781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9df133-972e-463f-9335-3cd0669d954c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:26.271781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9df133-972e-463f-9335-3cd0669d954c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:26.273172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 617/1233] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:49:26.278301 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdf889-b582-4671-9859-e819ee9ce56b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:26.278683 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdf889-b582-4671-9859-e819ee9ce56b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:26.278849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdf889-b582-4671-9859-e819ee9ce56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:26.296629 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bffdf889-b582-4671-9859-e819ee9ce56b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:49:26.297829 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bffdf889-b582-4671-9859-e819ee9ce56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:49:26.360744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 617/1234] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:49:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:49:26.383997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9df133-972e-463f-9335-3cd0669d954c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:26.480400 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9df133-972e-463f-9335-3cd0669d954c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:26.512015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab750cd-05a2-49ba-bfca-91ce832781f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:26.512783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab750cd-05a2-49ba-bfca-91ce832781f1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:26.513070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab750cd-05a2-49ba-bfca-91ce832781f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:26.513344 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab750cd-05a2-49ba-bfca-91ce832781f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:26.523961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab750cd-05a2-49ba-bfca-91ce832781f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2ab750cd-05a2-49ba-bfca-91ce832781f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:49:26.531584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:26.532761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:26.538822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:26.538822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:26.538822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:26.538822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:26.538822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:49:26.538822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:49:26.538822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:49:26.538822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:49:26.538822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:49:26.538822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:49:26.538822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 11 20:49:26.538822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:26.538822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 618/1235] 10.222.0.35 () {56 vars in 1102 bytes} [Wed May 11 20:49:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:26.539766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdf889-b582-4671-9859-e819ee9ce56b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:26.631669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdf889-b582-4671-9859-e819ee9ce56b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:26.663580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ed113-33b6-4d64-806e-28e98f20a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:26.664238 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ed113-33b6-4d64-806e-28e98f20a184 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:26.664519 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ed113-33b6-4d64-806e-28e98f20a184 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:26.664791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ed113-33b6-4d64-806e-28e98f20a184 None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:26.665521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ed113-33b6-4d64-806e-28e98f20a184 None admin] RBAC: Adding query filter params (name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:26.665847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ed113-33b6-4d64-806e-28e98f20a184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:26.667203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ed113-33b6-4d64-806e-28e98f20a184 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:26.674762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 618/1236] 10.222.0.35 () {56 vars in 1103 bytes} [Wed May 11 20:49:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:26.680508 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab750cd-05a2-49ba-bfca-91ce832781f1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:26.776732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab750cd-05a2-49ba-bfca-91ce832781f1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:26.808440 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73cab6-1307-4900-8a44-ab5190520bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:26.809245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73cab6-1307-4900-8a44-ab5190520bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:26.809558 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73cab6-1307-4900-8a44-ab5190520bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:26.809837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73cab6-1307-4900-8a44-ab5190520bd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:26.821029 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73cab6-1307-4900-8a44-ab5190520bd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:26.831337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73cab6-1307-4900-8a44-ab5190520bd2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5d73cab6-1307-4900-8a44-ab5190520bd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:49:26.839673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:26.840705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:26.841835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:49:26.841835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:49:26.841835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:26.841835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:26.841835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 619/1237] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:26.846825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ed113-33b6-4d64-806e-28e98f20a184 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:26.940587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ed113-33b6-4d64-806e-28e98f20a184 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:26.971851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a94ad0-8aa5-4f15-87e2-58029b528563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:26.972503 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a94ad0-8aa5-4f15-87e2-58029b528563 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:26.972790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a94ad0-8aa5-4f15-87e2-58029b528563 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:26.973062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a94ad0-8aa5-4f15-87e2-58029b528563 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:26.973804 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a94ad0-8aa5-4f15-87e2-58029b528563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:26.974109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a94ad0-8aa5-4f15-87e2-58029b528563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:26.975597 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a94ad0-8aa5-4f15-87e2-58029b528563 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:26.986686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 619/1238] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:26.992969 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73cab6-1307-4900-8a44-ab5190520bd2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:27.087653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73cab6-1307-4900-8a44-ab5190520bd2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:27.119625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff4d95-2d98-4b56-8c96-d88de64ba204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:27.120402 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff4d95-2d98-4b56-8c96-d88de64ba204 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:27.120683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff4d95-2d98-4b56-8c96-d88de64ba204 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:27.120955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff4d95-2d98-4b56-8c96-d88de64ba204 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:27.128828 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff4d95-2d98-4b56-8c96-d88de64ba204 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:27.130289 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff4d95-2d98-4b56-8c96-d88de64ba204 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-43ff4d95-2d98-4b56-8c96-d88de64ba204 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:49:27.144273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:27.145388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:27.146483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:27.146483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:27.146483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:49:27.146483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:49:27.146483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:49:27.146483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:49:27.146483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:49:27.146483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:49:27.146483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 20:49:27.146483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:27.146483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 620/1239] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:27.151131 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a94ad0-8aa5-4f15-87e2-58029b528563 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:27.245757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a94ad0-8aa5-4f15-87e2-58029b528563 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:27.278305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90d223-5ab5-49fa-ae9d-5b355705fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:27.278974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d223-5ab5-49fa-ae9d-5b355705fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:27.279256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d223-5ab5-49fa-ae9d-5b355705fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:27.279533 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90d223-5ab5-49fa-ae9d-5b355705fbf2 None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:27.280496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90d223-5ab5-49fa-ae9d-5b355705fbf2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:27.280808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90d223-5ab5-49fa-ae9d-5b355705fbf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:27.282361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90d223-5ab5-49fa-ae9d-5b355705fbf2 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:27.299242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 620/1240] 10.222.0.35 () {56 vars in 1143 bytes} [Wed May 11 20:49:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:27.305517 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff4d95-2d98-4b56-8c96-d88de64ba204 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:27.399933 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff4d95-2d98-4b56-8c96-d88de64ba204 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:27.432247 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e59ad-b267-48b6-b8f4-c353b32f9418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:27.437010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e59ad-b267-48b6-b8f4-c353b32f9418 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:27.437010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e59ad-b267-48b6-b8f4-c353b32f9418 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:27.437010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e59ad-b267-48b6-b8f4-c353b32f9418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:27.496380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e59ad-b267-48b6-b8f4-c353b32f9418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:27.497844 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e59ad-b267-48b6-b8f4-c353b32f9418 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:27.589221 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 621/1241] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:49:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:49:27.594817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90d223-5ab5-49fa-ae9d-5b355705fbf2 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:27.688486 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90d223-5ab5-49fa-ae9d-5b355705fbf2 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:27.720667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79f344-e665-4dc3-b4fd-4d6ec1793fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:27.721447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f344-e665-4dc3-b4fd-4d6ec1793fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:27.721755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f344-e665-4dc3-b4fd-4d6ec1793fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:27.722029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79f344-e665-4dc3-b4fd-4d6ec1793fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:27.732490 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79f344-e665-4dc3-b4fd-4d6ec1793fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:27.734082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79f344-e665-4dc3-b4fd-4d6ec1793fd8 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-2c79f344-e665-4dc3-b4fd-4d6ec1793fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:49:27.751924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:27.753082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:27.754274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:49:27.754274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:49:27.754274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:27.754274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:27.754274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 621/1242] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:27.759257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e59ad-b267-48b6-b8f4-c353b32f9418 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:27.856857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e59ad-b267-48b6-b8f4-c353b32f9418 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:27.889358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514555c8-35cf-4725-ba22-f33f7c63598c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:27.890083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514555c8-35cf-4725-ba22-f33f7c63598c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:27.890368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514555c8-35cf-4725-ba22-f33f7c63598c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:27.893947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514555c8-35cf-4725-ba22-f33f7c63598c None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:27.893947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514555c8-35cf-4725-ba22-f33f7c63598c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:27.893947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514555c8-35cf-4725-ba22-f33f7c63598c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:27.893947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514555c8-35cf-4725-ba22-f33f7c63598c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:27.904715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 622/1243] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:27.910297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79f344-e665-4dc3-b4fd-4d6ec1793fd8 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:28.004543 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79f344-e665-4dc3-b4fd-4d6ec1793fd8 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:28.037777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f4107-1e4a-4db3-a23f-82340da3bfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:28.038540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f4107-1e4a-4db3-a23f-82340da3bfbc None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:28.038821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f4107-1e4a-4db3-a23f-82340da3bfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:28.039096 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f4107-1e4a-4db3-a23f-82340da3bfbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:28.045474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f4107-1e4a-4db3-a23f-82340da3bfbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:28.046931 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f4107-1e4a-4db3-a23f-82340da3bfbc None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-666f4107-1e4a-4db3-a23f-82340da3bfbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:49:28.060251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:28.061403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:28.062565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:49:28.062565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:49:28.062565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:49:28.062565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:49:28.062565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:49:28.062565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:49:28.062565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:49:28.062565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:28.062565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 622/1244] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:49:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:28.067291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514555c8-35cf-4725-ba22-f33f7c63598c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:28.163858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514555c8-35cf-4725-ba22-f33f7c63598c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:28.195581 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047ef61-7da1-47cd-a128-7cf17caba742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:28.196224 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ef61-7da1-47cd-a128-7cf17caba742 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:28.196505 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ef61-7da1-47cd-a128-7cf17caba742 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:28.196775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ef61-7da1-47cd-a128-7cf17caba742 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:28.197559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047ef61-7da1-47cd-a128-7cf17caba742 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:28.197868 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047ef61-7da1-47cd-a128-7cf17caba742 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:28.199276 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047ef61-7da1-47cd-a128-7cf17caba742 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:28.211292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 623/1245] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:49:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:49:28.217292 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f4107-1e4a-4db3-a23f-82340da3bfbc None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:28.311488 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f4107-1e4a-4db3-a23f-82340da3bfbc None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:28.342956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a944b-93e4-499b-bdac-f283d3645f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:28.343604 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a944b-93e4-499b-bdac-f283d3645f32 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:28.343901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a944b-93e4-499b-bdac-f283d3645f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:28.344166 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a944b-93e4-499b-bdac-f283d3645f32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:28.344982 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a944b-93e4-499b-bdac-f283d3645f32 None admin] RBAC: Adding query filter params (role.id=b18c84f91b764bea92cc22c80a49bcaa, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=59cb32d2807549699e37b27ca97d351c) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:28.345297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a944b-93e4-499b-bdac-f283d3645f32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:28.346746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a944b-93e4-499b-bdac-f283d3645f32 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:28.352328 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 623/1246] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:49:28 2022] GET /identity/v3/role_assignments?user.id=59cb32d2807549699e37b27ca97d351c&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=b18c84f91b764bea92cc22c80a49bcaa => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:30.584074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb733e-53cb-48e9-85b0-0cd098290ab4 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:30.584633 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb733e-53cb-48e9-85b0-0cd098290ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:30.584740 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb733e-53cb-48e9-85b0-0cd098290ab4 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:30.586048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 624/1247] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:49:30.591246 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2f910-8d34-4877-b8f5-487b4fb71481 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:30.597680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2f910-8d34-4877-b8f5-487b4fb71481 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:30.597680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2f910-8d34-4877-b8f5-487b4fb71481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:30.608118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-53d2f910-8d34-4877-b8f5-487b4fb71481 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:49:30.609275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-53d2f910-8d34-4877-b8f5-487b4fb71481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:49:30.671471 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 624/1248] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:49:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:49:30.695857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb733e-53cb-48e9-85b0-0cd098290ab4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:30.792485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb733e-53cb-48e9-85b0-0cd098290ab4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:30.825807 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fafe8-163c-426e-924f-402d351b5a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:30.826590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fafe8-163c-426e-924f-402d351b5a56 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:30.826872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fafe8-163c-426e-924f-402d351b5a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:30.827147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fafe8-163c-426e-924f-402d351b5a56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:30.837039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fafe8-163c-426e-924f-402d351b5a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f64fafe8-163c-426e-924f-402d351b5a56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:49:30.844552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:30.852449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:30.853590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:30.853590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:30.853590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:30.853590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:30.853590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:49:30.853590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:49:30.853590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:49:30.853590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:49:30.853590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:49:30.853590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:49:30.853590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:49:30.853590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:30.853590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 625/1249] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:49:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:30.854500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2f910-8d34-4877-b8f5-487b4fb71481 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:30.948153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2f910-8d34-4877-b8f5-487b4fb71481 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:30.980481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdecc5-94ed-4dc8-8ec7-83bbfa2751cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:30.981242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdecc5-94ed-4dc8-8ec7-83bbfa2751cb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:30.981556 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdecc5-94ed-4dc8-8ec7-83bbfa2751cb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:30.981837 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdecc5-94ed-4dc8-8ec7-83bbfa2751cb None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:30.982574 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdecc5-94ed-4dc8-8ec7-83bbfa2751cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:30.982879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdecc5-94ed-4dc8-8ec7-83bbfa2751cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:30.984245 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdecc5-94ed-4dc8-8ec7-83bbfa2751cb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:30.992677 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 625/1250] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:49:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:30.998372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fafe8-163c-426e-924f-402d351b5a56 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:31.092478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fafe8-163c-426e-924f-402d351b5a56 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:31.125128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17c2c1-3860-4eee-a242-95431bc90190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:31.125927 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17c2c1-3860-4eee-a242-95431bc90190 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:31.126215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17c2c1-3860-4eee-a242-95431bc90190 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:31.126488 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17c2c1-3860-4eee-a242-95431bc90190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:31.136624 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17c2c1-3860-4eee-a242-95431bc90190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:31.138112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17c2c1-3860-4eee-a242-95431bc90190 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5c17c2c1-3860-4eee-a242-95431bc90190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:49:31.154638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:31.155879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:31.157031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:49:31.157031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:49:31.157031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:31.157031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:31.157031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 626/1251] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:31.162303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdecc5-94ed-4dc8-8ec7-83bbfa2751cb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:31.256854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdecc5-94ed-4dc8-8ec7-83bbfa2751cb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:31.289578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fe9cd-10f1-49b2-8219-2f2598029099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:31.290283 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fe9cd-10f1-49b2-8219-2f2598029099 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:31.290559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fe9cd-10f1-49b2-8219-2f2598029099 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:31.290831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fe9cd-10f1-49b2-8219-2f2598029099 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:31.291540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fe9cd-10f1-49b2-8219-2f2598029099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:31.291847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fe9cd-10f1-49b2-8219-2f2598029099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:31.293233 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fe9cd-10f1-49b2-8219-2f2598029099 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:31.304565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 626/1252] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:31.310987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17c2c1-3860-4eee-a242-95431bc90190 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:31.405230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17c2c1-3860-4eee-a242-95431bc90190 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:31.437303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735271c-518a-47c0-a97c-5c7f968b1374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:31.438173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735271c-518a-47c0-a97c-5c7f968b1374 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:31.438456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735271c-518a-47c0-a97c-5c7f968b1374 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:31.438732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735271c-518a-47c0-a97c-5c7f968b1374 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:31.446268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735271c-518a-47c0-a97c-5c7f968b1374 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:31.447709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735271c-518a-47c0-a97c-5c7f968b1374 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5735271c-518a-47c0-a97c-5c7f968b1374 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:49:31.462281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:31.463452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:31.464751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:31.464751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:31.464751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:49:31.464751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:49:31.464751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:49:31.464751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:49:31.464751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:49:31.464751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:49:31.464751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 20:49:31.464751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:31.464751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 627/1253] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:31.469226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fe9cd-10f1-49b2-8219-2f2598029099 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:31.565790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fe9cd-10f1-49b2-8219-2f2598029099 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:31.597455 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc377d2-5ed4-4853-9d35-ebbc715b180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:31.598157 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc377d2-5ed4-4853-9d35-ebbc715b180b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:31.600424 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc377d2-5ed4-4853-9d35-ebbc715b180b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:31.600424 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc377d2-5ed4-4853-9d35-ebbc715b180b None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:31.600424 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc377d2-5ed4-4853-9d35-ebbc715b180b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:31.600424 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc377d2-5ed4-4853-9d35-ebbc715b180b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:31.601857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc377d2-5ed4-4853-9d35-ebbc715b180b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:31.617935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 627/1254] 10.222.0.35 () {56 vars in 1143 bytes} [Wed May 11 20:49:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:31.623719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735271c-518a-47c0-a97c-5c7f968b1374 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:31.719117 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735271c-518a-47c0-a97c-5c7f968b1374 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:31.750139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdec3e3-2315-428a-baa1-8fbafd33082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:31.750771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec3e3-2315-428a-baa1-8fbafd33082c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:31.751052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec3e3-2315-428a-baa1-8fbafd33082c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:31.751327 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec3e3-2315-428a-baa1-8fbafd33082c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:31.814715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdec3e3-2315-428a-baa1-8fbafd33082c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:31.816218 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdec3e3-2315-428a-baa1-8fbafd33082c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:31.911379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 628/1255] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:49:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 11 20:49:31.917135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc377d2-5ed4-4853-9d35-ebbc715b180b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:32.011770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc377d2-5ed4-4853-9d35-ebbc715b180b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:32.043623 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40a64d-8d92-45f6-b9b6-b6b043033355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:32.044409 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40a64d-8d92-45f6-b9b6-b6b043033355 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:32.044696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40a64d-8d92-45f6-b9b6-b6b043033355 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:32.044974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40a64d-8d92-45f6-b9b6-b6b043033355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:32.055051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40a64d-8d92-45f6-b9b6-b6b043033355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:32.056562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40a64d-8d92-45f6-b9b6-b6b043033355 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-cd40a64d-8d92-45f6-b9b6-b6b043033355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:49:32.074183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:32.075415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:32.076389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:49:32.076389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:49:32.076389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:32.076389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:32.076389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 628/1256] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:32.081266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdec3e3-2315-428a-baa1-8fbafd33082c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:32.173872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdec3e3-2315-428a-baa1-8fbafd33082c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:32.205872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f23eb-e8f8-4526-be02-0763350e24cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:32.206525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f23eb-e8f8-4526-be02-0763350e24cb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:32.206798 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f23eb-e8f8-4526-be02-0763350e24cb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:32.207071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f23eb-e8f8-4526-be02-0763350e24cb None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:32.207771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f23eb-e8f8-4526-be02-0763350e24cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:32.208097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f23eb-e8f8-4526-be02-0763350e24cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:32.209460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f23eb-e8f8-4526-be02-0763350e24cb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:32.220133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 629/1257] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:32.231111 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40a64d-8d92-45f6-b9b6-b6b043033355 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:32.320131 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40a64d-8d92-45f6-b9b6-b6b043033355 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:32.352601 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3912e75-58bd-4fab-bc9c-958498cc09b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:32.353401 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3912e75-58bd-4fab-bc9c-958498cc09b7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:32.353718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3912e75-58bd-4fab-bc9c-958498cc09b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:32.353994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3912e75-58bd-4fab-bc9c-958498cc09b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:32.360317 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3912e75-58bd-4fab-bc9c-958498cc09b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:32.361779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3912e75-58bd-4fab-bc9c-958498cc09b7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e3912e75-58bd-4fab-bc9c-958498cc09b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:49:32.375592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:32.381164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:32.382349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:49:32.382349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:49:32.382349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:49:32.382349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:49:32.382349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:49:32.382349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:49:32.382349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:49:32.382349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:32.382349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 629/1258] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:49:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:32.382958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f23eb-e8f8-4526-be02-0763350e24cb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:32.477257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f23eb-e8f8-4526-be02-0763350e24cb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:32.508485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd413f84-0fb5-4d3f-b48f-85e626e72929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:32.509126 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd413f84-0fb5-4d3f-b48f-85e626e72929 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:32.509405 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd413f84-0fb5-4d3f-b48f-85e626e72929 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:32.509705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd413f84-0fb5-4d3f-b48f-85e626e72929 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:32.510478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd413f84-0fb5-4d3f-b48f-85e626e72929 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:32.510783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd413f84-0fb5-4d3f-b48f-85e626e72929 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:32.512204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd413f84-0fb5-4d3f-b48f-85e626e72929 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:32.523773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 630/1259] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:49:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 20:49:32.530844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3912e75-58bd-4fab-bc9c-958498cc09b7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:32.625616 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3912e75-58bd-4fab-bc9c-958498cc09b7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:32.656870 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af404819-73fe-484f-a613-2055e21ceaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:32.657511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af404819-73fe-484f-a613-2055e21ceaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:32.657824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af404819-73fe-484f-a613-2055e21ceaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:32.658104 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af404819-73fe-484f-a613-2055e21ceaf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:32.658926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af404819-73fe-484f-a613-2055e21ceaf9 None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=59cb32d2807549699e37b27ca97d351c) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:32.659245 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af404819-73fe-484f-a613-2055e21ceaf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:32.660669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af404819-73fe-484f-a613-2055e21ceaf9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:32.666379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 630/1260] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:49:32 2022] GET /identity/v3/role_assignments?user.id=59cb32d2807549699e37b27ca97d351c&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:34.824233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf39d1-bd07-4f8c-8d64-a6806a967b69 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:34.824766 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf39d1-bd07-4f8c-8d64-a6806a967b69 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:34.824766 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf39d1-bd07-4f8c-8d64-a6806a967b69 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:34.826215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 631/1261] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:49:34.831579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2033f55-86d5-4f51-a0e7-74fd5af0fa0a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:34.831973 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2033f55-86d5-4f51-a0e7-74fd5af0fa0a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:34.832140 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2033f55-86d5-4f51-a0e7-74fd5af0fa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:34.849393 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c2033f55-86d5-4f51-a0e7-74fd5af0fa0a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:49:34.850605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c2033f55-86d5-4f51-a0e7-74fd5af0fa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:49:34.915265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 631/1262] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:49:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 11 20:49:34.937170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf39d1-bd07-4f8c-8d64-a6806a967b69 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:35.037100 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf39d1-bd07-4f8c-8d64-a6806a967b69 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:35.070458 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9afc61-fa65-41e0-8002-a1ddded90dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:35.071243 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9afc61-fa65-41e0-8002-a1ddded90dcf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:35.071529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9afc61-fa65-41e0-8002-a1ddded90dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:35.071809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9afc61-fa65-41e0-8002-a1ddded90dcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:35.083827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9afc61-fa65-41e0-8002-a1ddded90dcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-eb9afc61-fa65-41e0-8002-a1ddded90dcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:49:35.089352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:35.090541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:35.095143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:35.095143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:35.095143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:35.095143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:35.095143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:49:35.095143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:49:35.095143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:49:35.095143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:49:35.095143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:49:35.095143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:49:35.095143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:49:35.095143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:35.095143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 632/1263] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:35.096471 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2033f55-86d5-4f51-a0e7-74fd5af0fa0a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:35.193405 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2033f55-86d5-4f51-a0e7-74fd5af0fa0a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:35.224599 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe756c-cb77-4f32-be41-3f30f2096d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:35.225248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe756c-cb77-4f32-be41-3f30f2096d4b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:35.225541 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe756c-cb77-4f32-be41-3f30f2096d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:35.225833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe756c-cb77-4f32-be41-3f30f2096d4b None admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:35.226596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe756c-cb77-4f32-be41-3f30f2096d4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:35.226933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe756c-cb77-4f32-be41-3f30f2096d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:35.228269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe756c-cb77-4f32-be41-3f30f2096d4b None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:35.235825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 632/1264] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:49:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:35.242126 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9afc61-fa65-41e0-8002-a1ddded90dcf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:35.336572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9afc61-fa65-41e0-8002-a1ddded90dcf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:35.368137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984fc36-ba73-4cd4-b985-b77e9d5b29c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:35.369187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984fc36-ba73-4cd4-b985-b77e9d5b29c1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:35.369187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984fc36-ba73-4cd4-b985-b77e9d5b29c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:35.369506 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984fc36-ba73-4cd4-b985-b77e9d5b29c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:35.379446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984fc36-ba73-4cd4-b985-b77e9d5b29c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:35.380909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984fc36-ba73-4cd4-b985-b77e9d5b29c1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3984fc36-ba73-4cd4-b985-b77e9d5b29c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:49:35.398007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:35.399132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:35.400286 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:49:35.400286 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:49:35.400286 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:35.400286 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:35.400286 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 633/1265] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:35.405118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe756c-cb77-4f32-be41-3f30f2096d4b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:35.498921 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe756c-cb77-4f32-be41-3f30f2096d4b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:35.530155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e6de6-8059-48f1-8bdf-09caa7c00c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:35.530813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e6de6-8059-48f1-8bdf-09caa7c00c26 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:35.531097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e6de6-8059-48f1-8bdf-09caa7c00c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:35.531411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e6de6-8059-48f1-8bdf-09caa7c00c26 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:35.532132 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e6de6-8059-48f1-8bdf-09caa7c00c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:35.532431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e6de6-8059-48f1-8bdf-09caa7c00c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:35.533847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e6de6-8059-48f1-8bdf-09caa7c00c26 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:35.545617 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 633/1266] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:35.551294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984fc36-ba73-4cd4-b985-b77e9d5b29c1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:35.647454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984fc36-ba73-4cd4-b985-b77e9d5b29c1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:35.680246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b825586-bef8-4031-9c25-fe39a63ab752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:35.681035 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b825586-bef8-4031-9c25-fe39a63ab752 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:35.681320 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b825586-bef8-4031-9c25-fe39a63ab752 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:35.681627 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b825586-bef8-4031-9c25-fe39a63ab752 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:35.689695 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b825586-bef8-4031-9c25-fe39a63ab752 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:35.691193 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b825586-bef8-4031-9c25-fe39a63ab752 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3b825586-bef8-4031-9c25-fe39a63ab752 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:49:35.705143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:35.706308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:35.707478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:35.707478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:35.707478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:49:35.707478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:49:35.707478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:49:35.707478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:49:35.707478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:49:35.707478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:49:35.707478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 20:49:35.707478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:35.707478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 634/1267] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:35.712187 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e6de6-8059-48f1-8bdf-09caa7c00c26 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:35.809639 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e6de6-8059-48f1-8bdf-09caa7c00c26 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:35.842920 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02ef43-4882-4cb1-91be-afa6543aa19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:35.843593 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02ef43-4882-4cb1-91be-afa6543aa19f None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:35.843896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02ef43-4882-4cb1-91be-afa6543aa19f None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:35.844173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02ef43-4882-4cb1-91be-afa6543aa19f None admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:35.844981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02ef43-4882-4cb1-91be-afa6543aa19f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:35.845290 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02ef43-4882-4cb1-91be-afa6543aa19f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:35.846757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02ef43-4882-4cb1-91be-afa6543aa19f None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:35.864075 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 634/1268] 10.222.0.35 () {56 vars in 1143 bytes} [Wed May 11 20:49:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:35.869901 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b825586-bef8-4031-9c25-fe39a63ab752 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:35.966256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b825586-bef8-4031-9c25-fe39a63ab752 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:35.998353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee59ecc-8a5d-4dcc-9794-dcec2c5febd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:35.999172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee59ecc-8a5d-4dcc-9794-dcec2c5febd7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:35.999453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee59ecc-8a5d-4dcc-9794-dcec2c5febd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:35.999731 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee59ecc-8a5d-4dcc-9794-dcec2c5febd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:36.009894 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee59ecc-8a5d-4dcc-9794-dcec2c5febd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:36.011334 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee59ecc-8a5d-4dcc-9794-dcec2c5febd7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2ee59ecc-8a5d-4dcc-9794-dcec2c5febd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:49:36.028524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:36.029617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:36.030591 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:49:36.030591 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:49:36.030591 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:36.030591 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:36.030591 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 635/1269] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:36.035472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02ef43-4882-4cb1-91be-afa6543aa19f None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:36.132104 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02ef43-4882-4cb1-91be-afa6543aa19f None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:36.164976 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d0baa-5ea7-423f-aef2-dda2e47ddff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:36.165664 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d0baa-5ea7-423f-aef2-dda2e47ddff7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:36.165945 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d0baa-5ea7-423f-aef2-dda2e47ddff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:36.166217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d0baa-5ea7-423f-aef2-dda2e47ddff7 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:36.166923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d0baa-5ea7-423f-aef2-dda2e47ddff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:36.167226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d0baa-5ea7-423f-aef2-dda2e47ddff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:36.168587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d0baa-5ea7-423f-aef2-dda2e47ddff7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:36.179428 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 635/1270] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:36.185219 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee59ecc-8a5d-4dcc-9794-dcec2c5febd7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:36.282064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee59ecc-8a5d-4dcc-9794-dcec2c5febd7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:36.312715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc47dd7-ef8a-4e87-b799-e6d42c78f6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:36.313490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc47dd7-ef8a-4e87-b799-e6d42c78f6ba None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:36.313795 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc47dd7-ef8a-4e87-b799-e6d42c78f6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:36.314067 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc47dd7-ef8a-4e87-b799-e6d42c78f6ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:36.320903 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc47dd7-ef8a-4e87-b799-e6d42c78f6ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:36.322370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc47dd7-ef8a-4e87-b799-e6d42c78f6ba None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3dc47dd7-ef8a-4e87-b799-e6d42c78f6ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:49:36.336914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:36.338084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:36.339272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:49:36.339272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:49:36.339272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:49:36.339272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:49:36.339272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:49:36.339272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:49:36.339272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:49:36.339272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:36.339272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 636/1271] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:49:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:36.344211 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d0baa-5ea7-423f-aef2-dda2e47ddff7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:36.440817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d0baa-5ea7-423f-aef2-dda2e47ddff7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:36.472490 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f05f6c-e7b0-425e-adf8-aa2090fca72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:36.473139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f05f6c-e7b0-425e-adf8-aa2090fca72d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:36.473445 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f05f6c-e7b0-425e-adf8-aa2090fca72d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:36.473802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f05f6c-e7b0-425e-adf8-aa2090fca72d None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:36.478186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f05f6c-e7b0-425e-adf8-aa2090fca72d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:36.478186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f05f6c-e7b0-425e-adf8-aa2090fca72d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:36.478186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f05f6c-e7b0-425e-adf8-aa2090fca72d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:36.488380 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 636/1272] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:36.495018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc47dd7-ef8a-4e87-b799-e6d42c78f6ba None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:36.590576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc47dd7-ef8a-4e87-b799-e6d42c78f6ba None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:36.623155 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefd13a-446b-4636-9909-806e49c08141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:36.624030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefd13a-446b-4636-9909-806e49c08141 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:36.624315 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefd13a-446b-4636-9909-806e49c08141 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:36.624593 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefd13a-446b-4636-9909-806e49c08141 None admin] PATH_INFO: `/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/59cb32d2807549699e37b27ca97d351c/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:36.626660 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefd13a-446b-4636-9909-806e49c08141 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c03e5fec995436aa5424d2be2e268aa, user_id=59cb32d2807549699e37b27ca97d351c, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:36.628089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefd13a-446b-4636-9909-806e49c08141 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:36.742652 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 637/1273] 10.222.0.35 () {58 vars in 1439 bytes} [Wed May 11 20:49:36 2022] PUT /identity/v3/projects/7c03e5fec995436aa5424d2be2e268aa/users/59cb32d2807549699e37b27ca97d351c/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 20:49:38.928636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ae4a2-7103-4bad-a6cc-1a991aa1a237 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:38.929194 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ae4a2-7103-4bad-a6cc-1a991aa1a237 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:38.929194 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ae4a2-7103-4bad-a6cc-1a991aa1a237 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:38.930690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 637/1274] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:49:38.935848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cba0c9-3afa-4ad0-a9fe-998e89e8a23e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:38.936280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cba0c9-3afa-4ad0-a9fe-998e89e8a23e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:38.936432 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cba0c9-3afa-4ad0-a9fe-998e89e8a23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:38.952554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a3cba0c9-3afa-4ad0-a9fe-998e89e8a23e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:49:38.953774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a3cba0c9-3afa-4ad0-a9fe-998e89e8a23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:49:39.017174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 638/1275] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:49:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:49:39.041754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ae4a2-7103-4bad-a6cc-1a991aa1a237 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:39.142613 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ae4a2-7103-4bad-a6cc-1a991aa1a237 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:39.175069 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a233d-9aec-426c-a92a-86fc240c1b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:39.175858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a233d-9aec-426c-a92a-86fc240c1b7b None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:39.176141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a233d-9aec-426c-a92a-86fc240c1b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:39.176417 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a233d-9aec-426c-a92a-86fc240c1b7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:39.186153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a233d-9aec-426c-a92a-86fc240c1b7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c91a233d-9aec-426c-a92a-86fc240c1b7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(role_id) May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 11 20:49:39.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:39.195296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:39.196156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:39.196156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:39.196156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:39.196156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:39.196156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 11 20:49:39.196156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 11 20:49:39.196156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 11 20:49:39.196156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 11 20:49:39.196156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 11 20:49:39.196156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 11 20:49:39.196156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 11 20:49:39.196156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:39.196156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 638/1276] 10.222.0.35 () {56 vars in 1096 bytes} [Wed May 11 20:49:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:39.201435 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cba0c9-3afa-4ad0-a9fe-998e89e8a23e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:39.295620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cba0c9-3afa-4ad0-a9fe-998e89e8a23e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:39.329696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b36506-5f98-4e05-a95b-698ac288fefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:39.330358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36506-5f98-4e05-a95b-698ac288fefd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:39.330639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36506-5f98-4e05-a95b-698ac288fefd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:39.330912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36506-5f98-4e05-a95b-698ac288fefd None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:39.331739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b36506-5f98-4e05-a95b-698ac288fefd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:39.332089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b36506-5f98-4e05-a95b-698ac288fefd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:39.334108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b36506-5f98-4e05-a95b-698ac288fefd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:39.342841 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 639/1277] 10.222.0.35 () {56 vars in 1099 bytes} [Wed May 11 20:49:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:39.348511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a233d-9aec-426c-a92a-86fc240c1b7b None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:39.442870 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a233d-9aec-426c-a92a-86fc240c1b7b None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:39.474641 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448e060-7897-47f0-a9f8-bbb5d79bbc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:39.475419 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448e060-7897-47f0-a9f8-bbb5d79bbc77 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:39.475699 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448e060-7897-47f0-a9f8-bbb5d79bbc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:39.475972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448e060-7897-47f0-a9f8-bbb5d79bbc77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:39.485911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448e060-7897-47f0-a9f8-bbb5d79bbc77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:39.487360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448e060-7897-47f0-a9f8-bbb5d79bbc77 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-c448e060-7897-47f0-a9f8-bbb5d79bbc77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:49:39.504138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:39.505807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:39.506754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:49:39.506754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:49:39.506754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:39.506754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:39.506754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 639/1278] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:39.511719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b36506-5f98-4e05-a95b-698ac288fefd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:39.607427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b36506-5f98-4e05-a95b-698ac288fefd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:39.640154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a60b4-3ab8-4c3c-ae0d-071d8e979045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:39.640808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a60b4-3ab8-4c3c-ae0d-071d8e979045 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:39.641101 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a60b4-3ab8-4c3c-ae0d-071d8e979045 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:39.641399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a60b4-3ab8-4c3c-ae0d-071d8e979045 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:39.642186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a60b4-3ab8-4c3c-ae0d-071d8e979045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:39.642777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a60b4-3ab8-4c3c-ae0d-071d8e979045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:39.644161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a60b4-3ab8-4c3c-ae0d-071d8e979045 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:39.657449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 640/1279] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:39.663305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448e060-7897-47f0-a9f8-bbb5d79bbc77 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:39.759267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448e060-7897-47f0-a9f8-bbb5d79bbc77 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:39.790572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010eaf0-7d3c-4841-88c7-56f4b15bcd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:39.791356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010eaf0-7d3c-4841-88c7-56f4b15bcd21 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:39.791639 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010eaf0-7d3c-4841-88c7-56f4b15bcd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:39.791914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010eaf0-7d3c-4841-88c7-56f4b15bcd21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:39.798986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010eaf0-7d3c-4841-88c7-56f4b15bcd21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:39.800423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010eaf0-7d3c-4841-88c7-56f4b15bcd21 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-e010eaf0-7d3c-4841-88c7-56f4b15bcd21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_user(user_id) May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 11 20:49:39.815067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:39.819303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:39.820287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:39.820287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:39.820287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 11 20:49:39.820287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 11 20:49:39.820287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 11 20:49:39.820287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 11 20:49:39.820287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 11 20:49:39.820287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 11 20:49:39.820287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 11 20:49:39.820287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:39.820287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 640/1280] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:39.822874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a60b4-3ab8-4c3c-ae0d-071d8e979045 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:39.919038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a60b4-3ab8-4c3c-ae0d-071d8e979045 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:39.952300 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d20e5-3a78-462f-890a-cf688d2df6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:39.952968 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d20e5-3a78-462f-890a-cf688d2df6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:39.953253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d20e5-3a78-462f-890a-cf688d2df6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:39.953558 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d20e5-3a78-462f-890a-cf688d2df6c1 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:39.954478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d20e5-3a78-462f-890a-cf688d2df6c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:39.954790 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d20e5-3a78-462f-890a-cf688d2df6c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:39.956214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d20e5-3a78-462f-890a-cf688d2df6c1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:39.972547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 641/1281] 10.222.0.35 () {56 vars in 1143 bytes} [Wed May 11 20:49:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:39.978842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010eaf0-7d3c-4841-88c7-56f4b15bcd21 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:40.073939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010eaf0-7d3c-4841-88c7-56f4b15bcd21 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:40.105442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafd645-d3f6-4886-ab1b-b9f52a0e2feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:40.106154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafd645-d3f6-4886-ab1b-b9f52a0e2feb None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:40.106443 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafd645-d3f6-4886-ab1b-b9f52a0e2feb None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:40.106710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafd645-d3f6-4886-ab1b-b9f52a0e2feb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:40.169265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafd645-d3f6-4886-ab1b-b9f52a0e2feb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:40.170746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafd645-d3f6-4886-ab1b-b9f52a0e2feb None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:40.262402 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 641/1282] 10.222.0.35 () {58 vars in 1282 bytes} [Wed May 11 20:49:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 11 20:49:40.268712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d20e5-3a78-462f-890a-cf688d2df6c1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:40.362750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d20e5-3a78-462f-890a-cf688d2df6c1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:40.394048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a01021-ddae-42e4-ac3b-206697b635fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:40.394820 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a01021-ddae-42e4-ac3b-206697b635fc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:40.395624 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a01021-ddae-42e4-ac3b-206697b635fc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:40.395897 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a01021-ddae-42e4-ac3b-206697b635fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:40.405463 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a01021-ddae-42e4-ac3b-206697b635fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:40.406928 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a01021-ddae-42e4-ac3b-206697b635fc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-80a01021-ddae-42e4-ac3b-206697b635fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 11 20:49:40.424849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:40.425975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:40.427012 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 11 20:49:40.427012 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 11 20:49:40.427012 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 11 20:49:40.427012 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:40.427012 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 642/1283] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:49:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:40.431788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafd645-d3f6-4886-ab1b-b9f52a0e2feb None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:40.525082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafd645-d3f6-4886-ab1b-b9f52a0e2feb None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:40.557055 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48d069-47f4-4e39-b385-baa75038c253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:40.557732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48d069-47f4-4e39-b385-baa75038c253 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:40.558012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48d069-47f4-4e39-b385-baa75038c253 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:40.558285 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48d069-47f4-4e39-b385-baa75038c253 None admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:40.558994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48d069-47f4-4e39-b385-baa75038c253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:40.559297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48d069-47f4-4e39-b385-baa75038c253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:40.560715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48d069-47f4-4e39-b385-baa75038c253 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:40.571464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 642/1284] 10.222.0.35 () {56 vars in 1109 bytes} [Wed May 11 20:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:40.577101 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a01021-ddae-42e4-ac3b-206697b635fc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:40.672879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a01021-ddae-42e4-ac3b-206697b635fc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:40.704678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54aa0d-9c83-4c97-96fc-63371aee616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:40.705448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54aa0d-9c83-4c97-96fc-63371aee616e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:40.705759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54aa0d-9c83-4c97-96fc-63371aee616e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:40.706034 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54aa0d-9c83-4c97-96fc-63371aee616e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:40.712628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54aa0d-9c83-4c97-96fc-63371aee616e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:40.714141 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54aa0d-9c83-4c97-96fc-63371aee616e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9d54aa0d-9c83-4c97-96fc-63371aee616e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) May 11 20:49:40.727875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:40.729016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:40.730198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 11 20:49:40.730198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 11 20:49:40.730198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 11 20:49:40.730198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 11 20:49:40.730198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 11 20:49:40.730198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 11 20:49:40.730198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 11 20:49:40.730198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application May 11 20:49:40.730198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 643/1285] 10.222.0.35 () {56 vars in 1111 bytes} [Wed May 11 20:49:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:40.734974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48d069-47f4-4e39-b385-baa75038c253 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:40.830490 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48d069-47f4-4e39-b385-baa75038c253 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:40.862421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde74b40-7862-4fd4-9496-9f362d4bb34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:40.863078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde74b40-7862-4fd4-9496-9f362d4bb34d None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:40.863353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde74b40-7862-4fd4-9496-9f362d4bb34d None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:40.863626 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde74b40-7862-4fd4-9496-9f362d4bb34d None admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:40.865022 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde74b40-7862-4fd4-9496-9f362d4bb34d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:40.865329 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde74b40-7862-4fd4-9496-9f362d4bb34d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:40.866794 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde74b40-7862-4fd4-9496-9f362d4bb34d None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:40.878229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 643/1286] 10.222.0.35 () {56 vars in 1148 bytes} [Wed May 11 20:49:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:40.884426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54aa0d-9c83-4c97-96fc-63371aee616e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:40.980131 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54aa0d-9c83-4c97-96fc-63371aee616e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:41.012146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96661b6-e6df-496d-93b3-cac6b2ef6fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:41.012787 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96661b6-e6df-496d-93b3-cac6b2ef6fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:41.013071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96661b6-e6df-496d-93b3-cac6b2ef6fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:41.013344 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96661b6-e6df-496d-93b3-cac6b2ef6fe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:41.014189 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96661b6-e6df-496d-93b3-cac6b2ef6fe9 None admin] RBAC: Adding query filter params (role.id=f72042e895ea41aeb4e1db9c3ad05128, scope.project.id=7c03e5fec995436aa5424d2be2e268aa, user.id=59cb32d2807549699e37b27ca97d351c) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:41.014499 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96661b6-e6df-496d-93b3-cac6b2ef6fe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:41.015926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96661b6-e6df-496d-93b3-cac6b2ef6fe9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:41.022288 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 644/1287] 10.222.0.35 () {56 vars in 1374 bytes} [Wed May 11 20:49:40 2022] GET /identity/v3/role_assignments?user.id=59cb32d2807549699e37b27ca97d351c&scope.project.id=7c03e5fec995436aa5424d2be2e268aa&role.id=f72042e895ea41aeb4e1db9c3ad05128 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:43.224259 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c9bf-9ca0-40b7-b840-f6c1eb67a374 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:43.224806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c9bf-9ca0-40b7-b840-f6c1eb67a374 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:43.224806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c9bf-9ca0-40b7-b840-f6c1eb67a374 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:43.226150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 644/1288] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:49:43.231724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f263d-d1d7-48a8-8d7d-c31032c5a856 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:43.232235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f263d-d1d7-48a8-8d7d-c31032c5a856 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:43.232336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f263d-d1d7-48a8-8d7d-c31032c5a856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:43.249849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-525f263d-d1d7-48a8-8d7d-c31032c5a856 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:49:43.251108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-525f263d-d1d7-48a8-8d7d-c31032c5a856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:49:43.321172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 645/1289] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:49:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:49:43.343386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255c9bf-9ca0-40b7-b840-f6c1eb67a374 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:43.447666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255c9bf-9ca0-40b7-b840-f6c1eb67a374 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:43.480262 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b571b-c01b-4b02-9609-94cf1d3b2fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:43.480983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b571b-c01b-4b02-9609-94cf1d3b2fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:43.481270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b571b-c01b-4b02-9609-94cf1d3b2fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:43.481578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b571b-c01b-4b02-9609-94cf1d3b2fe7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:43.482236 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b571b-c01b-4b02-9609-94cf1d3b2fe7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:43.483610 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b571b-c01b-4b02-9609-94cf1d3b2fe7 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-989b571b-c01b-4b02-9609-94cf1d3b2fe7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:43.495756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:43.501628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:43.502886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 645/1290] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 11 20:49:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:43.503942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f263d-d1d7-48a8-8d7d-c31032c5a856 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:43.597580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f263d-d1d7-48a8-8d7d-c31032c5a856 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:43.630748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34931992-e5f6-466d-9854-0d5a9cd47156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:43.631402 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34931992-e5f6-466d-9854-0d5a9cd47156 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:43.631685 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34931992-e5f6-466d-9854-0d5a9cd47156 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:43.631962 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34931992-e5f6-466d-9854-0d5a9cd47156 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:43.632663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34931992-e5f6-466d-9854-0d5a9cd47156 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:43.632972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34931992-e5f6-466d-9854-0d5a9cd47156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:43.634497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34931992-e5f6-466d-9854-0d5a9cd47156 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:43.639114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 646/1291] 10.222.0.35 () {56 vars in 1116 bytes} [Wed May 11 20:49:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:43.645229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b571b-c01b-4b02-9609-94cf1d3b2fe7 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:43.742132 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b571b-c01b-4b02-9609-94cf1d3b2fe7 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:43.775034 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d97c6-3025-48dc-83b9-56a2e19590f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:43.775692 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d97c6-3025-48dc-83b9-56a2e19590f9 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:43.776014 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d97c6-3025-48dc-83b9-56a2e19590f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:43.776293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d97c6-3025-48dc-83b9-56a2e19590f9 None admin] PATH_INFO: `/v3/services` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:43.777035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d97c6-3025-48dc-83b9-56a2e19590f9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:43.777338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d97c6-3025-48dc-83b9-56a2e19590f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:43.778735 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d97c6-3025-48dc-83b9-56a2e19590f9 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:43.783032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 646/1292] 10.222.0.35 () {56 vars in 1116 bytes} [Wed May 11 20:49:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:46.008471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b921a-b1c1-40ef-982d-3499ed8d4e44 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:46.009054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b921a-b1c1-40ef-982d-3499ed8d4e44 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:46.009054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b921a-b1c1-40ef-982d-3499ed8d4e44 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:46.010425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 647/1293] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:49:46.015770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ae444-8cca-47ce-ab02-08ba944dcdb7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:46.016199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ae444-8cca-47ce-ab02-08ba944dcdb7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:46.016329 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ae444-8cca-47ce-ab02-08ba944dcdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:46.033736 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-593ae444-8cca-47ce-ab02-08ba944dcdb7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:49:46.034890 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-593ae444-8cca-47ce-ab02-08ba944dcdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:49:46.100982 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 647/1294] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:49:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:49:46.123484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b921a-b1c1-40ef-982d-3499ed8d4e44 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:46.221331 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b921a-b1c1-40ef-982d-3499ed8d4e44 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:46.254272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8a3a5-da65-4009-9d0d-16042049076a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:46.254957 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8a3a5-da65-4009-9d0d-16042049076a None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:46.255230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8a3a5-da65-4009-9d0d-16042049076a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:46.255505 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8a3a5-da65-4009-9d0d-16042049076a None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:46.256220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8a3a5-da65-4009-9d0d-16042049076a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:46.257595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8a3a5-da65-4009-9d0d-16042049076a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:46.358898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 648/1295] 10.222.0.35 () {60 vars in 1141 bytes} [Wed May 11 20:49:46 2022] POST /identity/v3/services => generated 246 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 20:49:48.590585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccff22e-2d61-4ea4-b2f7-fdec76284b42 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:48.591145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccff22e-2d61-4ea4-b2f7-fdec76284b42 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:48.591145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccff22e-2d61-4ea4-b2f7-fdec76284b42 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:48.592525 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 648/1296] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:49:48.597848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9378-b8e4-4b85-a582-1dd136f07cc5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:48.598285 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9378-b8e4-4b85-a582-1dd136f07cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:48.598413 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9378-b8e4-4b85-a582-1dd136f07cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:48.614920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-844d9378-b8e4-4b85-a582-1dd136f07cc5 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:49:48.616133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-844d9378-b8e4-4b85-a582-1dd136f07cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:49:48.685749 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 649/1297] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:49:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:49:48.709314 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccff22e-2d61-4ea4-b2f7-fdec76284b42 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:48.804994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccff22e-2d61-4ea4-b2f7-fdec76284b42 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:48.837204 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fa37f-56e9-4c88-a6f9-9596a6b14043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:48.838026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fa37f-56e9-4c88-a6f9-9596a6b14043 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:48.838308 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fa37f-56e9-4c88-a6f9-9596a6b14043 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:48.838582 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fa37f-56e9-4c88-a6f9-9596a6b14043 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:48.839230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fa37f-56e9-4c88-a6f9-9596a6b14043 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:48.840796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fa37f-56e9-4c88-a6f9-9596a6b14043 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-299fa37f-56e9-4c88-a6f9-9596a6b14043 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:48.853833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:48.855145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:48.856324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 649/1298] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 11 20:49:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:48.861099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d9378-b8e4-4b85-a582-1dd136f07cc5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:48.955306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d9378-b8e4-4b85-a582-1dd136f07cc5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:48.987477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928099ec-be11-418d-8ab4-172155ba1f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:48.988131 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928099ec-be11-418d-8ab4-172155ba1f08 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:48.989000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928099ec-be11-418d-8ab4-172155ba1f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:48.989284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928099ec-be11-418d-8ab4-172155ba1f08 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:48.990021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928099ec-be11-418d-8ab4-172155ba1f08 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:48.990330 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928099ec-be11-418d-8ab4-172155ba1f08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:48.991752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928099ec-be11-418d-8ab4-172155ba1f08 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:48.996702 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 650/1299] 10.222.0.35 () {56 vars in 1116 bytes} [Wed May 11 20:49:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:49.002711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fa37f-56e9-4c88-a6f9-9596a6b14043 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:49.098535 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fa37f-56e9-4c88-a6f9-9596a6b14043 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:49.130440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96c26a-f3c6-4487-855c-798e4231d70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:49.131100 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96c26a-f3c6-4487-855c-798e4231d70e None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:49.131381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96c26a-f3c6-4487-855c-798e4231d70e None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:49.131657 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96c26a-f3c6-4487-855c-798e4231d70e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:49.132440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96c26a-f3c6-4487-855c-798e4231d70e None admin] RBAC: Adding query filter params (interface=public, service_id=3c82c7a5e1bf4304b7fdfdedcf47f2fe, region_id=RegionOne) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:49.132752 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96c26a-f3c6-4487-855c-798e4231d70e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:49.134152 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96c26a-f3c6-4487-855c-798e4231d70e None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:49.139179 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 650/1300] 10.222.0.35 () {56 vars in 1251 bytes} [Wed May 11 20:49:49 2022] GET /identity/v3/endpoints?service_id=3c82c7a5e1bf4304b7fdfdedcf47f2fe&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:49.145006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928099ec-be11-418d-8ab4-172155ba1f08 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:49.241192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928099ec-be11-418d-8ab4-172155ba1f08 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:49.273829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf9690-0c46-49bf-87e3-ecf642675d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:49.274476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf9690-0c46-49bf-87e3-ecf642675d70 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:49.274756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf9690-0c46-49bf-87e3-ecf642675d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:49.275029 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf9690-0c46-49bf-87e3-ecf642675d70 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:49.275699 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf9690-0c46-49bf-87e3-ecf642675d70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:49.277065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf9690-0c46-49bf-87e3-ecf642675d70 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:49.283562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 651/1301] 10.222.0.35 () {56 vars in 1087 bytes} [Wed May 11 20:49:49 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 20:49:51.478618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d5062-f0db-4b37-9fc8-4ecf005bbe92 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:51.479158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d5062-f0db-4b37-9fc8-4ecf005bbe92 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:51.479158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d5062-f0db-4b37-9fc8-4ecf005bbe92 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:51.480528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 651/1302] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:49:51.485817 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337532c1-a90d-4e4c-b23b-4d16d2302720 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:51.486235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337532c1-a90d-4e4c-b23b-4d16d2302720 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:51.486380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337532c1-a90d-4e4c-b23b-4d16d2302720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:51.503177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-337532c1-a90d-4e4c-b23b-4d16d2302720 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:49:51.504969 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-337532c1-a90d-4e4c-b23b-4d16d2302720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:49:51.568726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 652/1303] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:49:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 11 20:49:51.591289 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d5062-f0db-4b37-9fc8-4ecf005bbe92 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:51.690146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d5062-f0db-4b37-9fc8-4ecf005bbe92 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:51.721989 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cb24f-bbba-4143-88fc-50c99c4f70b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:51.722799 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cb24f-bbba-4143-88fc-50c99c4f70b4 None admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:51.723080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cb24f-bbba-4143-88fc-50c99c4f70b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:51.723350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cb24f-bbba-4143-88fc-50c99c4f70b4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:51.723995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490cb24f-bbba-4143-88fc-50c99c4f70b4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:51.725360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490cb24f-bbba-4143-88fc-50c99c4f70b4 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application [None req-490cb24f-bbba-4143-88fc-50c99c4f70b4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application Traceback (most recent call last): May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 11 20:49:51.737307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._get_service(service_id) May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 11 20:49:51.739602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.get_or_create( May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application with Lock( May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self._enter() May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application return self.creator() May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application created_value = creator( May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: ERROR keystone.server.flask.application May 11 20:49:51.741669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 652/1304] 10.222.0.35 () {56 vars in 1117 bytes} [Wed May 11 20:49:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 11 20:49:51.746888 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337532c1-a90d-4e4c-b23b-4d16d2302720 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:51.842599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337532c1-a90d-4e4c-b23b-4d16d2302720 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:51.874490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11aeb0-47c1-4e6b-a8fc-29a9d7094d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:51.875138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11aeb0-47c1-4e6b-a8fc-29a9d7094d2d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:51.875419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11aeb0-47c1-4e6b-a8fc-29a9d7094d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:51.875692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11aeb0-47c1-4e6b-a8fc-29a9d7094d2d None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:51.876384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11aeb0-47c1-4e6b-a8fc-29a9d7094d2d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 20:49:51.876687 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11aeb0-47c1-4e6b-a8fc-29a9d7094d2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:51.878071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11aeb0-47c1-4e6b-a8fc-29a9d7094d2d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:51.883395 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 653/1305] 10.222.0.35 () {56 vars in 1116 bytes} [Wed May 11 20:49:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 20:49:51.889115 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cb24f-bbba-4143-88fc-50c99c4f70b4 None admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:49:51.985435 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cb24f-bbba-4143-88fc-50c99c4f70b4 None admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:49:52.016980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041952d0-7a19-40f4-933f-4dcb34425514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:49:52.017859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041952d0-7a19-40f4-933f-4dcb34425514 None admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:49:52.018143 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041952d0-7a19-40f4-933f-4dcb34425514 None admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:49:52.018420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041952d0-7a19-40f4-933f-4dcb34425514 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:49:52.019156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041952d0-7a19-40f4-933f-4dcb34425514 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:49:52.021231 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041952d0-7a19-40f4-933f-4dcb34425514 None admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:49:52.132350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 653/1306] 10.222.0.35 () {60 vars in 1144 bytes} [Wed May 11 20:49:51 2022] POST /identity/v3/endpoints => generated 331 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 20:56:12.962682 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6148fc-a92d-4539-9437-1822c8f22dda None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:12.963607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6148fc-a92d-4539-9437-1822c8f22dda None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:12.964044 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6148fc-a92d-4539-9437-1822c8f22dda None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:12.972009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814079-f6cf-472f-9e59-af80e9570e63 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:12.972850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814079-f6cf-472f-9e59-af80e9570e63 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:12.973284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83814079-f6cf-472f-9e59-af80e9570e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:12.977084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 654/1307] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:56:12 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:13.051426 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-83814079-f6cf-472f-9e59-af80e9570e63 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:13.052925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-83814079-f6cf-472f-9e59-af80e9570e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:13.169735 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 654/1308] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:13.225403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e6844-1e4a-43c9-9549-9eed719768b2 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:13.226885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e6844-1e4a-43c9-9549-9eed719768b2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:13.228507 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e6844-1e4a-43c9-9549-9eed719768b2 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:13.230954 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 655/1309] 10.222.0.35 () {54 vars in 964 bytes} [Wed May 11 20:56:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:13.247781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e12d9-57d6-44b8-a468-e248c7eaf90b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:13.248058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e12d9-57d6-44b8-a468-e248c7eaf90b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:13.248334 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e12d9-57d6-44b8-a468-e248c7eaf90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:13.371355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-998e12d9-57d6-44b8-a468-e248c7eaf90b None None] MFA Rules not processed for user `8aa998f15cd543338cd0fc8b5a501066`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:13.372731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-998e12d9-57d6-44b8-a468-e248c7eaf90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:13.481743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 655/1310] 10.222.0.35 () {58 vars in 1061 bytes} [Wed May 11 20:56:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:13.483722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e6844-1e4a-43c9-9549-9eed719768b2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:56:13.485480 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a33e6844-1e4a-43c9-9549-9eed719768b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:13.694829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e6844-1e4a-43c9-9549-9eed719768b2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:56:13.777042 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286d406-0566-4689-8e85-1ca1e2091925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:56:13.777783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286d406-0566-4689-8e85-1ca1e2091925 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:13.778287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286d406-0566-4689-8e85-1ca1e2091925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:13.778579 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286d406-0566-4689-8e85-1ca1e2091925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:13.780259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2286d406-0566-4689-8e85-1ca1e2091925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:13.920042 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286d406-0566-4689-8e85-1ca1e2091925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:56:13.921491 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2286d406-0566-4689-8e85-1ca1e2091925 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:56:13.942107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 656/1311] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:56:16.494115 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04264f-c3f5-4728-a6fc-af39be1d256e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:16.494666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04264f-c3f5-4728-a6fc-af39be1d256e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:16.494666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04264f-c3f5-4728-a6fc-af39be1d256e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:16.496204 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 656/1312] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:16.501546 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eda461-8ae7-4645-83d2-3102afc1ee3a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:16.502003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eda461-8ae7-4645-83d2-3102afc1ee3a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:16.502143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eda461-8ae7-4645-83d2-3102afc1ee3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:16.594401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-43eda461-8ae7-4645-83d2-3102afc1ee3a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:16.596248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-43eda461-8ae7-4645-83d2-3102afc1ee3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:16.689800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 657/1313] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:16.727710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04264f-c3f5-4728-a6fc-af39be1d256e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:56:16.729338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7e04264f-c3f5-4728-a6fc-af39be1d256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:16.830610 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04264f-c3f5-4728-a6fc-af39be1d256e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:56:16.903784 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a704d-03a2-4dfc-a30d-26824c2d8a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:56:16.904365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a704d-03a2-4dfc-a30d-26824c2d8a0d service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:16.904648 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a704d-03a2-4dfc-a30d-26824c2d8a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:16.904923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a704d-03a2-4dfc-a30d-26824c2d8a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:16.906612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-728a704d-03a2-4dfc-a30d-26824c2d8a0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:17.010393 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a704d-03a2-4dfc-a30d-26824c2d8a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:56:17.011797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a704d-03a2-4dfc-a30d-26824c2d8a0d service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:56:17.030442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 657/1314] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:56:19.840797 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca8d7-11be-451e-a5b2-5c2a9e411a8d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:19.841368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca8d7-11be-451e-a5b2-5c2a9e411a8d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:19.841368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ca8d7-11be-451e-a5b2-5c2a9e411a8d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:19.842767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 658/1315] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:19.848080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf77153-e3db-4fb4-92ff-cc30d9665581 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:19.848504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf77153-e3db-4fb4-92ff-cc30d9665581 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:19.848638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf77153-e3db-4fb4-92ff-cc30d9665581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:19.910104 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3bf77153-e3db-4fb4-92ff-cc30d9665581 None None] MFA Rules not processed for user `9abf29d44f1a4c1ca2c6ad2350032bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:19.911307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3bf77153-e3db-4fb4-92ff-cc30d9665581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:20.002547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 658/1316] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:56:19 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:20.041600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ca8d7-11be-451e-a5b2-5c2a9e411a8d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:56:20.043116 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fd7ca8d7-11be-451e-a5b2-5c2a9e411a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:20.141210 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ca8d7-11be-451e-a5b2-5c2a9e411a8d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:56:20.210196 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db85a9-df4d-41b1-94fa-7835842940d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:56:20.210831 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db85a9-df4d-41b1-94fa-7835842940d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:20.211113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db85a9-df4d-41b1-94fa-7835842940d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:20.211384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db85a9-df4d-41b1-94fa-7835842940d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:20.212992 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c6db85a9-df4d-41b1-94fa-7835842940d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:20.316914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db85a9-df4d-41b1-94fa-7835842940d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:56:20.318350 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db85a9-df4d-41b1-94fa-7835842940d6 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:56:20.335983 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 659/1317] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:56:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:56:23.265054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62de10-2f53-420b-8e26-75fd0c7e534e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:23.265603 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62de10-2f53-420b-8e26-75fd0c7e534e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:23.265603 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62de10-2f53-420b-8e26-75fd0c7e534e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:23.266933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 659/1318] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:23.272163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ef835-ec37-40ea-90a7-2eabb1013f89 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:23.272796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ef835-ec37-40ea-90a7-2eabb1013f89 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:23.272979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ef835-ec37-40ea-90a7-2eabb1013f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:23.333931 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2f6ef835-ec37-40ea-90a7-2eabb1013f89 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:23.335129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2f6ef835-ec37-40ea-90a7-2eabb1013f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:23.426141 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 660/1319] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:23.464062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62de10-2f53-420b-8e26-75fd0c7e534e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:56:23.466565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ad62de10-2f53-420b-8e26-75fd0c7e534e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:23.563669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62de10-2f53-420b-8e26-75fd0c7e534e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:56:23.639119 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd345cf1-8605-42a0-b34f-9df46f2b4022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:56:23.639765 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd345cf1-8605-42a0-b34f-9df46f2b4022 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:23.640045 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd345cf1-8605-42a0-b34f-9df46f2b4022 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:23.640316 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd345cf1-8605-42a0-b34f-9df46f2b4022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:23.642010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cd345cf1-8605-42a0-b34f-9df46f2b4022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:23.746980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd345cf1-8605-42a0-b34f-9df46f2b4022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:56:23.748407 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd345cf1-8605-42a0-b34f-9df46f2b4022 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:56:23.766270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 660/1320] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:56:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:56:26.989741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55624dd-1573-46fb-9963-1c3ad97d437c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:26.990276 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55624dd-1573-46fb-9963-1c3ad97d437c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:26.990276 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55624dd-1573-46fb-9963-1c3ad97d437c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:26.991669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 661/1321] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:26.996864 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb8d1-55e6-47e5-9049-8c3a74a0550e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:26.997280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb8d1-55e6-47e5-9049-8c3a74a0550e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:26.997436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb8d1-55e6-47e5-9049-8c3a74a0550e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:27.060596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-955cb8d1-55e6-47e5-9049-8c3a74a0550e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:27.061830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-955cb8d1-55e6-47e5-9049-8c3a74a0550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:27.155847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 661/1322] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:27.191211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55624dd-1573-46fb-9963-1c3ad97d437c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:56:27.192796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f55624dd-1573-46fb-9963-1c3ad97d437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:27.292587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55624dd-1573-46fb-9963-1c3ad97d437c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:56:27.365273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8a97e-6897-4568-aa2a-28344ab6f351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:56:27.365958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8a97e-6897-4568-aa2a-28344ab6f351 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:27.366151 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8a97e-6897-4568-aa2a-28344ab6f351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:27.366419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8a97e-6897-4568-aa2a-28344ab6f351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:27.368074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d7b8a97e-6897-4568-aa2a-28344ab6f351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:27.473452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8a97e-6897-4568-aa2a-28344ab6f351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:56:27.474922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8a97e-6897-4568-aa2a-28344ab6f351 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:56:27.494328 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 662/1323] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:56:29.761904 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2df394-0b7f-42e1-a3dd-49d8bd5a6c9a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:29.762510 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2df394-0b7f-42e1-a3dd-49d8bd5a6c9a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:29.762510 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2df394-0b7f-42e1-a3dd-49d8bd5a6c9a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:29.763877 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 662/1324] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:29.769195 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45835be-b26b-4b08-aeff-467ba2066397 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:29.769664 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45835be-b26b-4b08-aeff-467ba2066397 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:29.769775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45835be-b26b-4b08-aeff-467ba2066397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:29.834989 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e45835be-b26b-4b08-aeff-467ba2066397 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:29.836212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e45835be-b26b-4b08-aeff-467ba2066397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:29.935519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 663/1325] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:29.971874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2df394-0b7f-42e1-a3dd-49d8bd5a6c9a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:56:29.973403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ed2df394-0b7f-42e1-a3dd-49d8bd5a6c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:30.073386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2df394-0b7f-42e1-a3dd-49d8bd5a6c9a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:56:30.144123 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b674b-fade-4b34-a037-a292ae054296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:56:30.144776 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b674b-fade-4b34-a037-a292ae054296 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:30.145066 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b674b-fade-4b34-a037-a292ae054296 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:30.145338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b674b-fade-4b34-a037-a292ae054296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:30.146994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fa8b674b-fade-4b34-a037-a292ae054296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:30.250096 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b674b-fade-4b34-a037-a292ae054296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:56:30.251570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b674b-fade-4b34-a037-a292ae054296 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:56:30.269492 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 663/1326] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:56:32.558311 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f3993-faa2-470b-92d3-a72d01641c5c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:32.558901 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f3993-faa2-470b-92d3-a72d01641c5c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:32.558901 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f3993-faa2-470b-92d3-a72d01641c5c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:32.560388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 664/1327] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:32.566139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575260-acbb-406a-bf6c-8d58643eed7c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:32.566558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575260-acbb-406a-bf6c-8d58643eed7c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:32.566731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575260-acbb-406a-bf6c-8d58643eed7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:32.631079 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-74575260-acbb-406a-bf6c-8d58643eed7c None None] MFA Rules not processed for user `9abf29d44f1a4c1ca2c6ad2350032bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:32.632286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-74575260-acbb-406a-bf6c-8d58643eed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:32.724797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 664/1328] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:56:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:32.761728 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f3993-faa2-470b-92d3-a72d01641c5c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:56:32.763284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ba7f3993-faa2-470b-92d3-a72d01641c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:32.866678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f3993-faa2-470b-92d3-a72d01641c5c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:56:32.937825 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5e068-1c55-4c93-b8ed-005fd3129600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:56:32.938476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5e068-1c55-4c93-b8ed-005fd3129600 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:32.938753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5e068-1c55-4c93-b8ed-005fd3129600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:32.939631 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5e068-1c55-4c93-b8ed-005fd3129600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:32.941268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c7b5e068-1c55-4c93-b8ed-005fd3129600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:33.050524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5e068-1c55-4c93-b8ed-005fd3129600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:56:33.051996 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5e068-1c55-4c93-b8ed-005fd3129600 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:56:33.070206 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 665/1329] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:56:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:56:35.781657 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83b40-ad81-4bf7-82fa-a8582c84b7d6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:35.782152 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83b40-ad81-4bf7-82fa-a8582c84b7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:35.782250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c83b40-ad81-4bf7-82fa-a8582c84b7d6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:35.783627 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 665/1330] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:35.788920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f6d47-9ac2-4355-9e71-cd74abe15564 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:35.789321 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f6d47-9ac2-4355-9e71-cd74abe15564 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:35.789467 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f6d47-9ac2-4355-9e71-cd74abe15564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:35.855694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a94f6d47-9ac2-4355-9e71-cd74abe15564 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:35.856901 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a94f6d47-9ac2-4355-9e71-cd74abe15564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:35.948627 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 666/1331] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:35.984184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c83b40-ad81-4bf7-82fa-a8582c84b7d6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:56:35.985853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-53c83b40-ad81-4bf7-82fa-a8582c84b7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:36.086309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c83b40-ad81-4bf7-82fa-a8582c84b7d6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:56:36.162145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb8e85-185c-4c30-a597-4b0ca9738921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:56:36.162820 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb8e85-185c-4c30-a597-4b0ca9738921 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:36.163107 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb8e85-185c-4c30-a597-4b0ca9738921 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:36.163387 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb8e85-185c-4c30-a597-4b0ca9738921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:36.165087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9ecb8e85-185c-4c30-a597-4b0ca9738921 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:36.273872 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb8e85-185c-4c30-a597-4b0ca9738921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:56:36.275331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb8e85-185c-4c30-a597-4b0ca9738921 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:56:36.293777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 666/1332] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:56:38.564559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a5e4f-f1f8-4088-9b9f-427d9526bf91 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:38.565078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a5e4f-f1f8-4088-9b9f-427d9526bf91 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:38.565201 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a5e4f-f1f8-4088-9b9f-427d9526bf91 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:38.566561 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 667/1333] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:38.571735 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9dd55-52bd-4052-985e-8458bfe473b8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:38.572170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9dd55-52bd-4052-985e-8458bfe473b8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:38.572290 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e9dd55-52bd-4052-985e-8458bfe473b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:38.634025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-32e9dd55-52bd-4052-985e-8458bfe473b8 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:38.635215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-32e9dd55-52bd-4052-985e-8458bfe473b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:38.726485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 667/1334] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:38.779024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89e78d-15cd-47c3-b829-8b55ca9f93d6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:38.779308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89e78d-15cd-47c3-b829-8b55ca9f93d6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:38.779581 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89e78d-15cd-47c3-b829-8b55ca9f93d6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:38.780938 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 668/1335] 10.222.0.35 () {54 vars in 964 bytes} [Wed May 11 20:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:38.786974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eebea0-4886-464e-8e62-7cc7869a5faa None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:38.787261 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eebea0-4886-464e-8e62-7cc7869a5faa None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:38.787536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eebea0-4886-464e-8e62-7cc7869a5faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:38.858547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f8eebea0-4886-464e-8e62-7cc7869a5faa None None] MFA Rules not processed for user `8aa998f15cd543338cd0fc8b5a501066`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:38.859751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f8eebea0-4886-464e-8e62-7cc7869a5faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:38.932176 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 668/1336] 10.222.0.35 () {58 vars in 1061 bytes} [Wed May 11 20:56:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:38.941198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89e78d-15cd-47c3-b829-8b55ca9f93d6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:56:38.942755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3e89e78d-15cd-47c3-b829-8b55ca9f93d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:39.042321 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89e78d-15cd-47c3-b829-8b55ca9f93d6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:56:39.114308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c91ab-acca-4525-96aa-3f65d36c4f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:56:39.114962 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c91ab-acca-4525-96aa-3f65d36c4f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:39.115248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c91ab-acca-4525-96aa-3f65d36c4f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:39.115522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c91ab-acca-4525-96aa-3f65d36c4f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:39.117212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1e7c91ab-acca-4525-96aa-3f65d36c4f1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:39.224342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c91ab-acca-4525-96aa-3f65d36c4f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:56:39.225809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c91ab-acca-4525-96aa-3f65d36c4f1c service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:56:39.243119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 669/1337] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:56:42.546464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fc5d9-4f61-401d-b2e5-33720ca7e810 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:42.546988 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fc5d9-4f61-401d-b2e5-33720ca7e810 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:42.547101 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fc5d9-4f61-401d-b2e5-33720ca7e810 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:42.548401 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 669/1338] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:42.553731 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7636047-d0e3-41ef-86b4-94dd0c597726 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:42.554120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7636047-d0e3-41ef-86b4-94dd0c597726 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:42.554297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7636047-d0e3-41ef-86b4-94dd0c597726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:42.616132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b7636047-d0e3-41ef-86b4-94dd0c597726 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:42.617342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b7636047-d0e3-41ef-86b4-94dd0c597726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:42.710401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 670/1339] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:56:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:42.745611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fc5d9-4f61-401d-b2e5-33720ca7e810 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:56:42.747120 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ba0fc5d9-4f61-401d-b2e5-33720ca7e810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:42.845681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fc5d9-4f61-401d-b2e5-33720ca7e810 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:56:42.914248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3438e11-9ed0-489e-a75c-bda95c255e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:56:42.914890 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3438e11-9ed0-489e-a75c-bda95c255e0b service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:42.915173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3438e11-9ed0-489e-a75c-bda95c255e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:42.915447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3438e11-9ed0-489e-a75c-bda95c255e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:42.917059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a3438e11-9ed0-489e-a75c-bda95c255e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:43.023135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3438e11-9ed0-489e-a75c-bda95c255e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:56:43.024581 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3438e11-9ed0-489e-a75c-bda95c255e0b service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:56:43.043136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 670/1340] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:56:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:56:47.595476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91b140-0363-4b63-800e-d502a4dd05e1 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:47.595975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91b140-0363-4b63-800e-d502a4dd05e1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:47.596099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91b140-0363-4b63-800e-d502a4dd05e1 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:47.597387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 671/1341] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:47.602725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e8ed3-206c-42da-882c-bce82e68b4fd None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:47.603144 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e8ed3-206c-42da-882c-bce82e68b4fd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:47.603291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e8ed3-206c-42da-882c-bce82e68b4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:47.671900 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0b0e8ed3-206c-42da-882c-bce82e68b4fd None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:47.673764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0b0e8ed3-206c-42da-882c-bce82e68b4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:47.772513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 671/1342] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:47.811997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91b140-0363-4b63-800e-d502a4dd05e1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:56:47.814252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1f91b140-0363-4b63-800e-d502a4dd05e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:47.906756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91b140-0363-4b63-800e-d502a4dd05e1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:56:47.910777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15b865-c8e8-4d38-a140-903deefc4c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:56:47.911412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15b865-c8e8-4d38-a140-903deefc4c30 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:47.911698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15b865-c8e8-4d38-a140-903deefc4c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:47.911975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15b865-c8e8-4d38-a140-903deefc4c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:47.920555 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15b865-c8e8-4d38-a140-903deefc4c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:56:47.922092 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15b865-c8e8-4d38-a140-903deefc4c30 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:56:47.931926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 672/1343] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:56:51.094090 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574dd24-d70a-4c58-bfa1-8b20cfd8381f None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:51.094663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574dd24-d70a-4c58-bfa1-8b20cfd8381f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:51.094663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574dd24-d70a-4c58-bfa1-8b20cfd8381f None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:51.096044 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 672/1344] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:51.101390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f54b60-2a3e-467f-a654-9c200b937003 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:51.101826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f54b60-2a3e-467f-a654-9c200b937003 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:51.101988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f54b60-2a3e-467f-a654-9c200b937003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:51.129996 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-01f54b60-2a3e-467f-a654-9c200b937003 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:51.131208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-01f54b60-2a3e-467f-a654-9c200b937003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:51.205035 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 673/1345] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:56:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:51.241552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574dd24-d70a-4c58-bfa1-8b20cfd8381f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:56:51.252727 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574dd24-d70a-4c58-bfa1-8b20cfd8381f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:56:51.256232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddefeba-a2a6-43cc-ba10-b38d8bcd97df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:56:51.256876 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddefeba-a2a6-43cc-ba10-b38d8bcd97df service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:51.257161 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddefeba-a2a6-43cc-ba10-b38d8bcd97df service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:51.257440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddefeba-a2a6-43cc-ba10-b38d8bcd97df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:51.266335 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddefeba-a2a6-43cc-ba10-b38d8bcd97df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:56:51.267882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddefeba-a2a6-43cc-ba10-b38d8bcd97df service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:56:51.277815 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 673/1346] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:56:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:56:55.892666 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4e915-ce1c-43e8-ad4c-d2aab979468d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:55.893220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4e915-ce1c-43e8-ad4c-d2aab979468d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:55.893220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4e915-ce1c-43e8-ad4c-d2aab979468d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:55.894611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 674/1347] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:56:55.900146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3314f-ddc5-40e7-87fa-a9c6ef71735e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:55.900554 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3314f-ddc5-40e7-87fa-a9c6ef71735e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:55.900715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3314f-ddc5-40e7-87fa-a9c6ef71735e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:55.918081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-13d3314f-ddc5-40e7-87fa-a9c6ef71735e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:56:55.919212 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-13d3314f-ddc5-40e7-87fa-a9c6ef71735e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:56:55.927200 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 674/1348] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:56:55.965099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4e915-ce1c-43e8-ad4c-d2aab979468d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:56:55.975435 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4e915-ce1c-43e8-ad4c-d2aab979468d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:56:55.978873 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be9928-77f2-4e6f-919f-030cf1756d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:56:55.979504 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be9928-77f2-4e6f-919f-030cf1756d97 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:56:55.979786 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be9928-77f2-4e6f-919f-030cf1756d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:56:55.980058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be9928-77f2-4e6f-919f-030cf1756d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:56:55.988945 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be9928-77f2-4e6f-919f-030cf1756d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:56:55.990398 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be9928-77f2-4e6f-919f-030cf1756d97 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:56:55.999892 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 675/1349] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:57:01.232594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a8ced-1a0e-4eac-8d2d-a05ccb56f8e6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:01.233520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a8ced-1a0e-4eac-8d2d-a05ccb56f8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:01.233983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a8ced-1a0e-4eac-8d2d-a05ccb56f8e6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:01.236302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 675/1350] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 11 20:57:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:01.241644 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bbf98-00a9-4993-aa87-1f6f89d574b8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:01.242091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bbf98-00a9-4993-aa87-1f6f89d574b8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:01.242210 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bbf98-00a9-4993-aa87-1f6f89d574b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:01.311189 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-163bbf98-00a9-4993-aa87-1f6f89d574b8 None None] MFA Rules not processed for user `59cb32d2807549699e37b27ca97d351c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:01.313161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-163bbf98-00a9-4993-aa87-1f6f89d574b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:01.404958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 676/1351] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 11 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 20:57:05.955547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79574bdb-cf4a-4c83-9f22-d07d97f68be2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:05.956577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79574bdb-cf4a-4c83-9f22-d07d97f68be2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:05.956952 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79574bdb-cf4a-4c83-9f22-d07d97f68be2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:05.958557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 676/1352] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 11 20:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:05.963918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218654e-b96b-4649-b089-503696838642 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:05.964339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218654e-b96b-4649-b089-503696838642 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:05.964665 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218654e-b96b-4649-b089-503696838642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:05.983761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9218654e-b96b-4649-b089-503696838642 None None] MFA Rules not processed for user `59cb32d2807549699e37b27ca97d351c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:05.984981 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9218654e-b96b-4649-b089-503696838642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:05.993573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 677/1353] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 11 20:57:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:07.420398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ba962-1a52-402f-969b-44a9a7ea6de0 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:07.420956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ba962-1a52-402f-969b-44a9a7ea6de0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:07.420956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ba962-1a52-402f-969b-44a9a7ea6de0 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:07.423203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 677/1354] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 11 20:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:07.428351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05449cb6-334f-4332-b7f5-6d73773552c2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:07.428777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05449cb6-334f-4332-b7f5-6d73773552c2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:07.428889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05449cb6-334f-4332-b7f5-6d73773552c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:07.447642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-05449cb6-334f-4332-b7f5-6d73773552c2 None None] MFA Rules not processed for user `59cb32d2807549699e37b27ca97d351c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:07.448824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-05449cb6-334f-4332-b7f5-6d73773552c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:07.457704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 678/1355] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 11 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 20:57:11.053181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c2ef9-1dfa-44cc-bd9f-31dcee50e2a9 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:11.053789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c2ef9-1dfa-44cc-bd9f-31dcee50e2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:11.053789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c2ef9-1dfa-44cc-bd9f-31dcee50e2a9 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:11.055105 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 678/1356] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:57:11.060291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96432-3d9c-4ef0-8109-160efb5e4f62 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:11.060706 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96432-3d9c-4ef0-8109-160efb5e4f62 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:11.060850 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96432-3d9c-4ef0-8109-160efb5e4f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:11.078186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3ed96432-3d9c-4ef0-8109-160efb5e4f62 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:11.079373 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ed96432-3d9c-4ef0-8109-160efb5e4f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:11.087123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 679/1357] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:11.135240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba5c78-591d-43dd-b79f-f3e7f568b421 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:11.135638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba5c78-591d-43dd-b79f-f3e7f568b421 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:11.136015 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba5c78-591d-43dd-b79f-f3e7f568b421 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:11.137466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 679/1358] 10.222.0.35 () {54 vars in 961 bytes} [Wed May 11 20:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:11.142793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317309f6-1b8d-4647-b3d0-753a31c7e513 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:11.143214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317309f6-1b8d-4647-b3d0-753a31c7e513 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:11.143511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317309f6-1b8d-4647-b3d0-753a31c7e513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:11.192285 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-317309f6-1b8d-4647-b3d0-753a31c7e513 None None] MFA Rules not processed for user `f400b94d3fbc40bdace4860fe83a0891`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:11.193642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-317309f6-1b8d-4647-b3d0-753a31c7e513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:11.273738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 680/1359] 10.222.0.35 () {58 vars in 1058 bytes} [Wed May 11 20:57:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:11.282101 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba5c78-591d-43dd-b79f-f3e7f568b421 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:11.296445 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba5c78-591d-43dd-b79f-f3e7f568b421 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:11.302063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb234859-8364-4bfc-996d-02133ac04cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:11.302834 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb234859-8364-4bfc-996d-02133ac04cac service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:11.303266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb234859-8364-4bfc-996d-02133ac04cac service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:11.303595 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb234859-8364-4bfc-996d-02133ac04cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:11.312045 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb234859-8364-4bfc-996d-02133ac04cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:11.315151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb234859-8364-4bfc-996d-02133ac04cac service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:11.324821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 680/1360] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:57:13.763641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1896c7c-6d9b-4f8f-9dbd-865eeaf8d23a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:13.764551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1896c7c-6d9b-4f8f-9dbd-865eeaf8d23a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:13.764872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1896c7c-6d9b-4f8f-9dbd-865eeaf8d23a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:13.766379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 681/1361] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:13.771577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becec85-8c9a-4542-8d1b-b0c3a8a0db9d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:13.772000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becec85-8c9a-4542-8d1b-b0c3a8a0db9d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:13.772116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becec85-8c9a-4542-8d1b-b0c3a8a0db9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:13.790028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1becec85-8c9a-4542-8d1b-b0c3a8a0db9d None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:13.791208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1becec85-8c9a-4542-8d1b-b0c3a8a0db9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:13.799509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 681/1362] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:13.844252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1896c7c-6d9b-4f8f-9dbd-865eeaf8d23a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:13.858407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1896c7c-6d9b-4f8f-9dbd-865eeaf8d23a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:13.863927 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444ab6b-df7f-42ce-9938-d70312dbf850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:13.864563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444ab6b-df7f-42ce-9938-d70312dbf850 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:13.864846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444ab6b-df7f-42ce-9938-d70312dbf850 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:13.865121 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444ab6b-df7f-42ce-9938-d70312dbf850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:13.873146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444ab6b-df7f-42ce-9938-d70312dbf850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:13.875291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444ab6b-df7f-42ce-9938-d70312dbf850 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:13.884331 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 682/1363] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:57:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:57:16.545128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263832f8-98f1-41f7-92f5-422680869c07 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:16.545979 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263832f8-98f1-41f7-92f5-422680869c07 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:16.546752 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263832f8-98f1-41f7-92f5-422680869c07 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:16.548150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 682/1364] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:16.553914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2ffce-cb4b-4215-9d8b-fa025e2bf099 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:16.554396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2ffce-cb4b-4215-9d8b-fa025e2bf099 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:16.554970 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2ffce-cb4b-4215-9d8b-fa025e2bf099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:16.573016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c7a2ffce-cb4b-4215-9d8b-fa025e2bf099 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:16.574267 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c7a2ffce-cb4b-4215-9d8b-fa025e2bf099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:16.582250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 683/1365] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:16.628682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eecca-4861-4e35-bb6c-edc920bf2f87 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:16.628971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eecca-4861-4e35-bb6c-edc920bf2f87 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:16.629248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6eecca-4861-4e35-bb6c-edc920bf2f87 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:16.630646 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 683/1366] 10.222.0.35 () {54 vars in 961 bytes} [Wed May 11 20:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:16.636055 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85145008-eb9c-4fca-b129-ebdb133d34dd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:16.636349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85145008-eb9c-4fca-b129-ebdb133d34dd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:16.636645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85145008-eb9c-4fca-b129-ebdb133d34dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:16.654662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-85145008-eb9c-4fca-b129-ebdb133d34dd None None] MFA Rules not processed for user `f400b94d3fbc40bdace4860fe83a0891`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:16.655862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-85145008-eb9c-4fca-b129-ebdb133d34dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:16.664853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 684/1367] 10.222.0.35 () {58 vars in 1058 bytes} [Wed May 11 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 20:57:16.672926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eecca-4861-4e35-bb6c-edc920bf2f87 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:16.687981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6eecca-4861-4e35-bb6c-edc920bf2f87 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:16.693383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cccac-3e8c-4395-83c5-ffb23d19daf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:16.694102 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cccac-3e8c-4395-83c5-ffb23d19daf5 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:16.694381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cccac-3e8c-4395-83c5-ffb23d19daf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:16.694655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cccac-3e8c-4395-83c5-ffb23d19daf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:16.702481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cccac-3e8c-4395-83c5-ffb23d19daf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:16.704043 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cccac-3e8c-4395-83c5-ffb23d19daf5 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:16.714814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 684/1368] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:57:19.207504 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e93fe-9695-4b65-bf33-1cf205c75431 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:19.208078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e93fe-9695-4b65-bf33-1cf205c75431 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:19.208078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e93fe-9695-4b65-bf33-1cf205c75431 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:19.209408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 685/1369] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:19.215196 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b298e39-9236-4844-bc4e-8e1ae8f25eed None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:19.215720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b298e39-9236-4844-bc4e-8e1ae8f25eed None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:19.215828 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b298e39-9236-4844-bc4e-8e1ae8f25eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:19.224214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b01895-07ea-4105-8c63-38e7fba9898c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:19.224810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b01895-07ea-4105-8c63-38e7fba9898c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:19.225246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b01895-07ea-4105-8c63-38e7fba9898c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:19.226770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 686/1370] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:19.232615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23a4ed-78d7-4f61-9df6-a89302257114 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:19.232947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23a4ed-78d7-4f61-9df6-a89302257114 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:19.233173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23a4ed-78d7-4f61-9df6-a89302257114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:19.235844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8b298e39-9236-4844-bc4e-8e1ae8f25eed None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:19.237255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8b298e39-9236-4844-bc4e-8e1ae8f25eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:19.246317 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 685/1371] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:19.252454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3e23a4ed-78d7-4f61-9df6-a89302257114 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:19.253755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3e23a4ed-78d7-4f61-9df6-a89302257114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:19.262719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 687/1372] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 20:57:19.292554 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b298e39-9236-4844-bc4e-8e1ae8f25eed None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:19.306118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b298e39-9236-4844-bc4e-8e1ae8f25eed None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:19.312959 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794dccf-b7fc-40de-9c2a-7d9b23c22076 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:19.313751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794dccf-b7fc-40de-9c2a-7d9b23c22076 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:19.314144 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794dccf-b7fc-40de-9c2a-7d9b23c22076 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:19.314527 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794dccf-b7fc-40de-9c2a-7d9b23c22076 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:19.323932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794dccf-b7fc-40de-9c2a-7d9b23c22076 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:19.325843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794dccf-b7fc-40de-9c2a-7d9b23c22076 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:19.337574 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 686/1373] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:57:19.578401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09580edd-ab38-4a75-a468-08fead2bdb03 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:19.578401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09580edd-ab38-4a75-a468-08fead2bdb03 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:19.578401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09580edd-ab38-4a75-a468-08fead2bdb03 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:19.579868 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 688/1374] 10.222.0.35 () {54 vars in 963 bytes} [Wed May 11 20:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:19.584134 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ebaba-c86d-4dd2-8174-a80bc987b5fc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:19.584448 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ebaba-c86d-4dd2-8174-a80bc987b5fc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:19.584706 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ebaba-c86d-4dd2-8174-a80bc987b5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:19.641857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-764ebaba-c86d-4dd2-8174-a80bc987b5fc None None] MFA Rules not processed for user `3888fb083b0149bd92054cffa88c51e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:19.643193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-764ebaba-c86d-4dd2-8174-a80bc987b5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:19.710670 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 687/1375] 10.222.0.35 () {58 vars in 1060 bytes} [Wed May 11 20:57:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:19.718330 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09580edd-ab38-4a75-a468-08fead2bdb03 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:19.729000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09580edd-ab38-4a75-a468-08fead2bdb03 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:19.732760 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720df70b-1607-4600-acfc-c450da06eea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:19.734097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720df70b-1607-4600-acfc-c450da06eea2 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:19.734459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720df70b-1607-4600-acfc-c450da06eea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:19.734806 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720df70b-1607-4600-acfc-c450da06eea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:19.743989 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720df70b-1607-4600-acfc-c450da06eea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:19.745576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720df70b-1607-4600-acfc-c450da06eea2 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:19.755924 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 689/1376] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:57:21.735501 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5daac-c6c6-44e7-90cd-dd6d7827cfef None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:21.736059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5daac-c6c6-44e7-90cd-dd6d7827cfef None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:21.736059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5daac-c6c6-44e7-90cd-dd6d7827cfef None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:21.737466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 688/1377] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:21.742819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db265-3fb0-4f7f-bee9-3179ccd44fa4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:21.743249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db265-3fb0-4f7f-bee9-3179ccd44fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:21.743364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db265-3fb0-4f7f-bee9-3179ccd44fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:21.761514 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e58db265-3fb0-4f7f-bee9-3179ccd44fa4 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:21.762485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e58db265-3fb0-4f7f-bee9-3179ccd44fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:21.770986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 690/1378] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:21.814863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5daac-c6c6-44e7-90cd-dd6d7827cfef None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:21.829211 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5daac-c6c6-44e7-90cd-dd6d7827cfef None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:21.836602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f090600-0908-4cd9-9daf-45454307e860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:21.837258 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f090600-0908-4cd9-9daf-45454307e860 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:21.837592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f090600-0908-4cd9-9daf-45454307e860 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:21.837879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f090600-0908-4cd9-9daf-45454307e860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:21.847279 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f090600-0908-4cd9-9daf-45454307e860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:21.848881 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f090600-0908-4cd9-9daf-45454307e860 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:21.858429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 689/1379] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:57:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:57:24.246834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fd893-48ea-49c1-9e75-cb13fbf1ccd7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:24.247375 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fd893-48ea-49c1-9e75-cb13fbf1ccd7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:24.247375 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fd893-48ea-49c1-9e75-cb13fbf1ccd7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:24.248820 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 691/1380] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 20:57:24.254565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac9b6a-dccd-4f42-8c13-938372085eb0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:24.254962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac9b6a-dccd-4f42-8c13-938372085eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:24.255136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac9b6a-dccd-4f42-8c13-938372085eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:24.272547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d3ac9b6a-dccd-4f42-8c13-938372085eb0 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:24.274015 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d3ac9b6a-dccd-4f42-8c13-938372085eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:24.281975 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 690/1381] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 20:57:24.325274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fd893-48ea-49c1-9e75-cb13fbf1ccd7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:24.339407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fd893-48ea-49c1-9e75-cb13fbf1ccd7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:24.345399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4514db-380d-4f59-a70f-03a198779674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:24.346071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4514db-380d-4f59-a70f-03a198779674 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:24.346360 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4514db-380d-4f59-a70f-03a198779674 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:24.346639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4514db-380d-4f59-a70f-03a198779674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:24.354874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4514db-380d-4f59-a70f-03a198779674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:24.356467 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4514db-380d-4f59-a70f-03a198779674 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:24.367367 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 692/1382] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:57:26.744201 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9bf4a-1649-46ef-b8c3-837abb9a49d7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:26.744768 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9bf4a-1649-46ef-b8c3-837abb9a49d7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:26.744768 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9bf4a-1649-46ef-b8c3-837abb9a49d7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:26.746118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 691/1383] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:26.751837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a26c6-e9e7-497c-8cf1-4e29e5a660a7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:26.752264 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a26c6-e9e7-497c-8cf1-4e29e5a660a7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:26.752381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a26c6-e9e7-497c-8cf1-4e29e5a660a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:26.770439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fe8a26c6-e9e7-497c-8cf1-4e29e5a660a7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:26.771827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fe8a26c6-e9e7-497c-8cf1-4e29e5a660a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:26.779883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 693/1384] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 20:57:26.820173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9bf4a-1649-46ef-b8c3-837abb9a49d7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:26.836491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9bf4a-1649-46ef-b8c3-837abb9a49d7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:26.842596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7aef16-7f2d-416c-889e-1b12658ca267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:26.843658 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7aef16-7f2d-416c-889e-1b12658ca267 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:26.844139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7aef16-7f2d-416c-889e-1b12658ca267 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:26.845365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7aef16-7f2d-416c-889e-1b12658ca267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:26.854048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7aef16-7f2d-416c-889e-1b12658ca267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:26.855631 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7aef16-7f2d-416c-889e-1b12658ca267 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:26.865914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 692/1385] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:57:29.099468 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d9360-9495-443c-9abf-e4d51ae057fd None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:29.099976 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d9360-9495-443c-9abf-e4d51ae057fd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:29.099976 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d9360-9495-443c-9abf-e4d51ae057fd None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:29.101339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 694/1386] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:29.106669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bef28-24e9-44f7-8fa5-8e2fcccac77b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:29.107248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bef28-24e9-44f7-8fa5-8e2fcccac77b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:29.107248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bef28-24e9-44f7-8fa5-8e2fcccac77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:29.126246 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6a4bef28-24e9-44f7-8fa5-8e2fcccac77b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:29.127354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6a4bef28-24e9-44f7-8fa5-8e2fcccac77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:29.135027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 693/1387] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:29.178346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d9360-9495-443c-9abf-e4d51ae057fd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:29.192888 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d9360-9495-443c-9abf-e4d51ae057fd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:29.198446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b124b-a18e-4d2e-8c9b-5997a3787346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:29.199033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b124b-a18e-4d2e-8c9b-5997a3787346 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:29.199314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b124b-a18e-4d2e-8c9b-5997a3787346 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:29.199588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b124b-a18e-4d2e-8c9b-5997a3787346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:29.208061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b124b-a18e-4d2e-8c9b-5997a3787346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:29.209611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b124b-a18e-4d2e-8c9b-5997a3787346 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:29.218925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 695/1388] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:57:32.192599 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc533-e08b-435b-9893-800672ed8ba5 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:32.193181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc533-e08b-435b-9893-800672ed8ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:32.193379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fc533-e08b-435b-9893-800672ed8ba5 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:32.195266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 694/1389] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:32.202733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330a1d3-63bb-462d-8fe8-e66ba54fd016 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:32.203208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330a1d3-63bb-462d-8fe8-e66ba54fd016 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:32.203527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330a1d3-63bb-462d-8fe8-e66ba54fd016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:32.226156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7330a1d3-63bb-462d-8fe8-e66ba54fd016 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:32.227737 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7330a1d3-63bb-462d-8fe8-e66ba54fd016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:32.237847 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 696/1390] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:32.292353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fc533-e08b-435b-9893-800672ed8ba5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:32.306488 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fc533-e08b-435b-9893-800672ed8ba5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:32.311842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fb8e7-ec75-4e5d-99b8-aa3ac228033d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:32.312484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fb8e7-ec75-4e5d-99b8-aa3ac228033d service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:32.312767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fb8e7-ec75-4e5d-99b8-aa3ac228033d service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:32.313045 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fb8e7-ec75-4e5d-99b8-aa3ac228033d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:32.321109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fb8e7-ec75-4e5d-99b8-aa3ac228033d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:32.322861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fb8e7-ec75-4e5d-99b8-aa3ac228033d service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:32.332902 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 695/1391] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:57:34.747752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea46ce-6982-4d91-9d12-f442ef287b81 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:34.748360 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea46ce-6982-4d91-9d12-f442ef287b81 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:34.748360 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea46ce-6982-4d91-9d12-f442ef287b81 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:34.750301 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 697/1392] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:34.755491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9ac0c-37a5-4977-b598-05f2a0e68e95 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:34.755951 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9ac0c-37a5-4977-b598-05f2a0e68e95 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:34.756062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9ac0c-37a5-4977-b598-05f2a0e68e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:34.773781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9be9ac0c-37a5-4977-b598-05f2a0e68e95 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:34.774973 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9be9ac0c-37a5-4977-b598-05f2a0e68e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:34.782795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 696/1393] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:34.826661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea46ce-6982-4d91-9d12-f442ef287b81 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:34.840797 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea46ce-6982-4d91-9d12-f442ef287b81 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:34.847217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a25ea-1014-49a4-b53e-2b351b419e2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:34.847861 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a25ea-1014-49a4-b53e-2b351b419e2e service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:34.848151 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a25ea-1014-49a4-b53e-2b351b419e2e service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:34.848475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a25ea-1014-49a4-b53e-2b351b419e2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:34.856681 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a25ea-1014-49a4-b53e-2b351b419e2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:34.858892 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a25ea-1014-49a4-b53e-2b351b419e2e service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:34.868520 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 698/1394] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 20:57:35.578363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77190eff-0085-4e33-99db-2d56f35380c7 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:35.578650 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77190eff-0085-4e33-99db-2d56f35380c7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:35.578927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77190eff-0085-4e33-99db-2d56f35380c7 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:35.580293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 697/1395] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:35.585432 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9476815-a478-47e7-a136-8fecbad78cdd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:35.585759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9476815-a478-47e7-a136-8fecbad78cdd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:35.586038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9476815-a478-47e7-a136-8fecbad78cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:35.603839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b9476815-a478-47e7-a136-8fecbad78cdd None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:35.605041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b9476815-a478-47e7-a136-8fecbad78cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:35.613603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 699/1396] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:35.669087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f8f24-4117-4442-b343-e7abe156b7dd None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:35.669478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f8f24-4117-4442-b343-e7abe156b7dd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:35.669870 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f8f24-4117-4442-b343-e7abe156b7dd None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:35.671959 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 698/1397] 10.222.0.35 () {54 vars in 962 bytes} [Wed May 11 20:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:35.677164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd10bf6-b83a-402c-9a4a-aaceb55088f4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:35.677753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd10bf6-b83a-402c-9a4a-aaceb55088f4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:35.678108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd10bf6-b83a-402c-9a4a-aaceb55088f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:35.726239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8bd10bf6-b83a-402c-9a4a-aaceb55088f4 None None] MFA Rules not processed for user `4ce12ee27315460793dfedd294eb3c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:35.727434 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8bd10bf6-b83a-402c-9a4a-aaceb55088f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:35.787337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 700/1398] 10.222.0.35 () {58 vars in 1059 bytes} [Wed May 11 20:57:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:35.794775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f8f24-4117-4442-b343-e7abe156b7dd None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:35.806012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f8f24-4117-4442-b343-e7abe156b7dd None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:35.809704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8006d85-d06f-4bd3-9512-d33fdda8ec09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce12ee27315460793dfedd294eb3c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:35.810342 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8006d85-d06f-4bd3-9512-d33fdda8ec09 service glance] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:35.810625 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8006d85-d06f-4bd3-9512-d33fdda8ec09 service glance] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:35.810905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8006d85-d06f-4bd3-9512-d33fdda8ec09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:35.819878 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8006d85-d06f-4bd3-9512-d33fdda8ec09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:35.821330 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8006d85-d06f-4bd3-9512-d33fdda8ec09 service glance] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:35.831343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 699/1399] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:57:36.403136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eff75-12fa-44a8-bd53-798b60624402 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:36.403424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eff75-12fa-44a8-bd53-798b60624402 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:36.403700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eff75-12fa-44a8-bd53-798b60624402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:36.451130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0e5eff75-12fa-44a8-bd53-798b60624402 None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:36.452979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0e5eff75-12fa-44a8-bd53-798b60624402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:36.512975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 701/1400] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 20:57:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:36.554411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692ca14-d6bb-4c48-a1eb-5bc1bcd19c9b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:36.554780 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692ca14-d6bb-4c48-a1eb-5bc1bcd19c9b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:36.555128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692ca14-d6bb-4c48-a1eb-5bc1bcd19c9b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:36.556667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 700/1401] 10.222.0.35 () {54 vars in 942 bytes} [Wed May 11 20:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:36.563766 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fed34-b8ee-4df5-b2ae-fdbed89eae7a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:36.564100 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fed34-b8ee-4df5-b2ae-fdbed89eae7a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:36.564428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752fed34-b8ee-4df5-b2ae-fdbed89eae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:36.611468 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-752fed34-b8ee-4df5-b2ae-fdbed89eae7a None None] MFA Rules not processed for user `85cb784bf9984abc9977c665a6db1656`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:36.612673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-752fed34-b8ee-4df5-b2ae-fdbed89eae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:36.681720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 702/1402] 10.222.0.35 () {58 vars in 1039 bytes} [Wed May 11 20:57:36 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 20:57:36.691363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692ca14-d6bb-4c48-a1eb-5bc1bcd19c9b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:36.705146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692ca14-d6bb-4c48-a1eb-5bc1bcd19c9b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:36.709988 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679c897-3116-4c32-8745-098305f9c3b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:36.710621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679c897-3116-4c32-8745-098305f9c3b5 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:36.710902 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679c897-3116-4c32-8745-098305f9c3b5 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:36.711173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679c897-3116-4c32-8745-098305f9c3b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:36.718962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679c897-3116-4c32-8745-098305f9c3b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:36.720541 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679c897-3116-4c32-8745-098305f9c3b5 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:36.728328 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 701/1403] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 20:57:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 20:57:37.222671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bc07c-6cd3-41db-a6cc-ebbe8f1b6d9f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:37.223646 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bc07c-6cd3-41db-a6cc-ebbe8f1b6d9f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:37.223924 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bc07c-6cd3-41db-a6cc-ebbe8f1b6d9f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:37.225328 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 703/1404] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:37.235136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d47e9-bd6a-46c8-9bce-88c8583f62aa None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:37.235694 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d47e9-bd6a-46c8-9bce-88c8583f62aa None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:37.236051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d47e9-bd6a-46c8-9bce-88c8583f62aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:37.254624 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-db4d47e9-bd6a-46c8-9bce-88c8583f62aa None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:37.256072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-db4d47e9-bd6a-46c8-9bce-88c8583f62aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:37.266674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 702/1405] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:37.308467 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bc07c-6cd3-41db-a6cc-ebbe8f1b6d9f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:37.323052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bc07c-6cd3-41db-a6cc-ebbe8f1b6d9f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:37.328603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cb54e-5f99-4c16-815d-d4b35cbcc3df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:37.329315 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cb54e-5f99-4c16-815d-d4b35cbcc3df service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:37.329709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cb54e-5f99-4c16-815d-d4b35cbcc3df service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:37.330098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cb54e-5f99-4c16-815d-d4b35cbcc3df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:37.340901 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cb54e-5f99-4c16-815d-d4b35cbcc3df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:37.344767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cb54e-5f99-4c16-815d-d4b35cbcc3df service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:37.354027 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 704/1406] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:57:39.825119 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b1447-c515-4b1d-aeea-2a20ca42d2ae None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:39.825710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b1447-c515-4b1d-aeea-2a20ca42d2ae None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:39.825710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b1447-c515-4b1d-aeea-2a20ca42d2ae None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:39.827104 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 703/1407] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:57:39.832370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a29c9-0eba-4692-8e9e-81a6f7935523 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:39.832795 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a29c9-0eba-4692-8e9e-81a6f7935523 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:39.832949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a29c9-0eba-4692-8e9e-81a6f7935523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:39.850941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b60a29c9-0eba-4692-8e9e-81a6f7935523 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:57:39.852153 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b60a29c9-0eba-4692-8e9e-81a6f7935523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:57:39.865940 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 705/1408] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:57:39.908063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b1447-c515-4b1d-aeea-2a20ca42d2ae None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:57:39.923690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b1447-c515-4b1d-aeea-2a20ca42d2ae None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:57:39.929484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6c272-57f0-41e1-adfd-e36824dda1da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:57:39.930204 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c272-57f0-41e1-adfd-e36824dda1da service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:57:39.930493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c272-57f0-41e1-adfd-e36824dda1da service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:57:39.930766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c272-57f0-41e1-adfd-e36824dda1da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:57:39.939759 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6c272-57f0-41e1-adfd-e36824dda1da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:57:39.941350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6c272-57f0-41e1-adfd-e36824dda1da service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:57:39.951083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 704/1409] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:01.377890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864450e7-be82-4065-a666-84a2029791cc None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:01.378534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864450e7-be82-4065-a666-84a2029791cc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:01.378534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864450e7-be82-4065-a666-84a2029791cc None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:01.379807 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 706/1410] 10.222.0.35 () {54 vars in 918 bytes} [Wed May 11 20:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:01.384912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf504a-a04b-4b19-b5d8-18d2829a8d44 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:01.385362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf504a-a04b-4b19-b5d8-18d2829a8d44 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:01.385467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf504a-a04b-4b19-b5d8-18d2829a8d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:01.403855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2daf504a-a04b-4b19-b5d8-18d2829a8d44 None None] MFA Rules not processed for user `59cb32d2807549699e37b27ca97d351c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:01.405031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2daf504a-a04b-4b19-b5d8-18d2829a8d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:01.413324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 705/1411] 10.222.0.35 () {58 vars in 1015 bytes} [Wed May 11 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:01.427686 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359938f-3c96-4281-9c37-a1daaf44d3a2 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:01.427978 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359938f-3c96-4281-9c37-a1daaf44d3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:01.428260 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359938f-3c96-4281-9c37-a1daaf44d3a2 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:01.429692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 707/1412] 10.222.0.35 () {54 vars in 918 bytes} [Wed May 11 20:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:01.434120 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b4170-489d-4a30-b3a2-204ecb3b3463 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:01.434408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b4170-489d-4a30-b3a2-204ecb3b3463 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:01.434688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b4170-489d-4a30-b3a2-204ecb3b3463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:01.452298 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d64b4170-489d-4a30-b3a2-204ecb3b3463 None None] MFA Rules not processed for user `f400b94d3fbc40bdace4860fe83a0891`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:01.453450 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d64b4170-489d-4a30-b3a2-204ecb3b3463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:01.462271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 706/1413] 10.222.0.35 () {58 vars in 1015 bytes} [Wed May 11 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:04.153029 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605257-f89b-4013-a4e9-511f434c5a7c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:04.153583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605257-f89b-4013-a4e9-511f434c5a7c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:04.153583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6605257-f89b-4013-a4e9-511f434c5a7c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:04.154966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 20:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:04.160326 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688719fc-ff20-4975-9388-d9e068ff8f70 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:04.160758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688719fc-ff20-4975-9388-d9e068ff8f70 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:04.160896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688719fc-ff20-4975-9388-d9e068ff8f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:04.178066 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-688719fc-ff20-4975-9388-d9e068ff8f70 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:04.179276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-688719fc-ff20-4975-9388-d9e068ff8f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:04.187470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 20:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:04.228376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6605257-f89b-4013-a4e9-511f434c5a7c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:04.242591 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6605257-f89b-4013-a4e9-511f434c5a7c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:04.247883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce239e-aeff-4ffd-b605-1cdccf2c1447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:04.249040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce239e-aeff-4ffd-b605-1cdccf2c1447 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:04.249345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce239e-aeff-4ffd-b605-1cdccf2c1447 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:04.249662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce239e-aeff-4ffd-b605-1cdccf2c1447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:04.257465 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce239e-aeff-4ffd-b605-1cdccf2c1447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:04.259088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce239e-aeff-4ffd-b605-1cdccf2c1447 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:04.269056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 709/1416] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:05.268663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a9963-13b2-48b2-8d10-10f1ffa2db75 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:05.269228 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a9963-13b2-48b2-8d10-10f1ffa2db75 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:05.269228 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a9963-13b2-48b2-8d10-10f1ffa2db75 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:05.270593 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 20:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:05.275680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffea35c-4c02-4162-ae6a-9eb8e6fe3a5c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:05.276085 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffea35c-4c02-4162-ae6a-9eb8e6fe3a5c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:05.276246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffea35c-4c02-4162-ae6a-9eb8e6fe3a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:05.293674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4ffea35c-4c02-4162-ae6a-9eb8e6fe3a5c None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:05.294889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4ffea35c-4c02-4162-ae6a-9eb8e6fe3a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:05.303125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 20:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:05.464986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a9963-13b2-48b2-8d10-10f1ffa2db75 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:05.478705 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a9963-13b2-48b2-8d10-10f1ffa2db75 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:05.484592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79a1bc-3666-4d6f-b9ad-c3c6063f6265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:05.485217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79a1bc-3666-4d6f-b9ad-c3c6063f6265 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:05.485497 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79a1bc-3666-4d6f-b9ad-c3c6063f6265 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:05.485802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79a1bc-3666-4d6f-b9ad-c3c6063f6265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:05.493664 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79a1bc-3666-4d6f-b9ad-c3c6063f6265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:05.495251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79a1bc-3666-4d6f-b9ad-c3c6063f6265 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:05.504965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 709/1419] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:06.439052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30659-92a2-4dfe-8f95-0a853c51cac2 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:06.439631 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30659-92a2-4dfe-8f95-0a853c51cac2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:06.439631 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30659-92a2-4dfe-8f95-0a853c51cac2 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:06.441005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 20:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:06.445832 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b15e1-9740-48f2-a826-81e0018d5c2e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:06.446268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b15e1-9740-48f2-a826-81e0018d5c2e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:06.446400 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b15e1-9740-48f2-a826-81e0018d5c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:06.464416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-aa2b15e1-9740-48f2-a826-81e0018d5c2e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:06.465632 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-aa2b15e1-9740-48f2-a826-81e0018d5c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:06.473319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 20:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:06.628176 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df30659-92a2-4dfe-8f95-0a853c51cac2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:06.642646 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df30659-92a2-4dfe-8f95-0a853c51cac2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:06.648177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dede6e-3932-472c-9fcc-83bb924d5121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:06.648834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dede6e-3932-472c-9fcc-83bb924d5121 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:06.649118 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dede6e-3932-472c-9fcc-83bb924d5121 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:06.649396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dede6e-3932-472c-9fcc-83bb924d5121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:06.657205 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dede6e-3932-472c-9fcc-83bb924d5121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:06.658826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dede6e-3932-472c-9fcc-83bb924d5121 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:06.667874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 712/1422] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:07.582359 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247102-03d4-45c8-b5a8-c3e8fb64dede None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:07.582924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247102-03d4-45c8-b5a8-c3e8fb64dede None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:07.583154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69247102-03d4-45c8-b5a8-c3e8fb64dede None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:07.584542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 20:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:07.589382 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375690-e3fe-41f9-b54e-b31af8cf85e1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:07.589816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375690-e3fe-41f9-b54e-b31af8cf85e1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:07.589965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375690-e3fe-41f9-b54e-b31af8cf85e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:07.608065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-10375690-e3fe-41f9-b54e-b31af8cf85e1 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:07.609268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-10375690-e3fe-41f9-b54e-b31af8cf85e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:07.616978 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 20:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:07.763406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69247102-03d4-45c8-b5a8-c3e8fb64dede None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:07.778432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69247102-03d4-45c8-b5a8-c3e8fb64dede None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:07.784381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc416a48-9838-4b8b-a099-28a5df4f59a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:07.785014 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc416a48-9838-4b8b-a099-28a5df4f59a2 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:07.785296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc416a48-9838-4b8b-a099-28a5df4f59a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:07.785599 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc416a48-9838-4b8b-a099-28a5df4f59a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:07.793673 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc416a48-9838-4b8b-a099-28a5df4f59a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:07.795299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc416a48-9838-4b8b-a099-28a5df4f59a2 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:07.807213 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 712/1425] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:08.728437 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223ec7a-7842-4d7b-b7b4-ae117710b63f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:08.728951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223ec7a-7842-4d7b-b7b4-ae117710b63f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:08.728951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223ec7a-7842-4d7b-b7b4-ae117710b63f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:08.730333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 20:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:08.735919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873466db-cafa-4ce7-aac0-14d47d2a2825 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:08.736306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873466db-cafa-4ce7-aac0-14d47d2a2825 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:08.736478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873466db-cafa-4ce7-aac0-14d47d2a2825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:08.753806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-873466db-cafa-4ce7-aac0-14d47d2a2825 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:08.755002 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-873466db-cafa-4ce7-aac0-14d47d2a2825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:08.762576 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 20:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:08.911756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223ec7a-7842-4d7b-b7b4-ae117710b63f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:08.926175 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223ec7a-7842-4d7b-b7b4-ae117710b63f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:08.931554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627ad82-a0a3-42cc-bcc6-1d31be2c65f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:08.932245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627ad82-a0a3-42cc-bcc6-1d31be2c65f4 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:08.932534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627ad82-a0a3-42cc-bcc6-1d31be2c65f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:08.932814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627ad82-a0a3-42cc-bcc6-1d31be2c65f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:08.940928 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627ad82-a0a3-42cc-bcc6-1d31be2c65f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:08.942554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627ad82-a0a3-42cc-bcc6-1d31be2c65f4 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:08.952133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 715/1428] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:09.915673 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61803d-cf4c-442a-ab60-aeee4bddf4b8 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:09.916227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61803d-cf4c-442a-ab60-aeee4bddf4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:09.916227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61803d-cf4c-442a-ab60-aeee4bddf4b8 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:09.917706 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 20:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:09.923119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b308-95ad-4410-a244-f6dc2474ab92 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:09.923581 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b308-95ad-4410-a244-f6dc2474ab92 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:09.923691 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b308-95ad-4410-a244-f6dc2474ab92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:09.941718 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4d76b308-95ad-4410-a244-f6dc2474ab92 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:09.942912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4d76b308-95ad-4410-a244-f6dc2474ab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:09.950633 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 20:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 20:58:10.100212 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61803d-cf4c-442a-ab60-aeee4bddf4b8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:10.114681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61803d-cf4c-442a-ab60-aeee4bddf4b8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:10.119905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e387d8-4969-4bee-abca-4aebaa2d0513 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:10.120531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e387d8-4969-4bee-abca-4aebaa2d0513 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:10.120825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e387d8-4969-4bee-abca-4aebaa2d0513 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:10.121083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e387d8-4969-4bee-abca-4aebaa2d0513 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:10.128848 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e387d8-4969-4bee-abca-4aebaa2d0513 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:10.130453 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e387d8-4969-4bee-abca-4aebaa2d0513 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:10.139441 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 715/1431] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:11.091212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27adc7-4798-4734-a3dc-34a63a83729d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:11.091777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27adc7-4798-4734-a3dc-34a63a83729d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:11.091872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27adc7-4798-4734-a3dc-34a63a83729d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:11.093199 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 20:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:11.098305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7458ce1-a65f-430a-a847-a6a059f8e995 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:11.098713 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7458ce1-a65f-430a-a847-a6a059f8e995 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:11.098825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7458ce1-a65f-430a-a847-a6a059f8e995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:11.116122 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e7458ce1-a65f-430a-a847-a6a059f8e995 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:11.117302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e7458ce1-a65f-430a-a847-a6a059f8e995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:11.125443 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 20:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:11.274968 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27adc7-4798-4734-a3dc-34a63a83729d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:11.288843 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27adc7-4798-4734-a3dc-34a63a83729d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:11.294177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca108a-e272-4ee1-bbd0-cd8f479dff5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:11.294802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca108a-e272-4ee1-bbd0-cd8f479dff5d service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:11.295576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca108a-e272-4ee1-bbd0-cd8f479dff5d service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:11.295853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca108a-e272-4ee1-bbd0-cd8f479dff5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:11.303610 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca108a-e272-4ee1-bbd0-cd8f479dff5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:11.305189 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca108a-e272-4ee1-bbd0-cd8f479dff5d service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:11.314877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 718/1434] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:12.228922 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117eef6-ce8f-4e84-bc1c-958d9d8bf41c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:12.229469 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117eef6-ce8f-4e84-bc1c-958d9d8bf41c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:12.229469 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117eef6-ce8f-4e84-bc1c-958d9d8bf41c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:12.230861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 20:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:12.236279 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df417da-4d8d-43ee-8c8a-7b403439f344 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:12.236684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df417da-4d8d-43ee-8c8a-7b403439f344 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:12.236838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df417da-4d8d-43ee-8c8a-7b403439f344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:12.254707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5df417da-4d8d-43ee-8c8a-7b403439f344 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:12.255884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5df417da-4d8d-43ee-8c8a-7b403439f344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:12.263529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 20:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:12.411948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117eef6-ce8f-4e84-bc1c-958d9d8bf41c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:12.426614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117eef6-ce8f-4e84-bc1c-958d9d8bf41c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:12.431944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87816950-94a8-43d6-9407-0a520c536d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:12.432718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87816950-94a8-43d6-9407-0a520c536d00 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:12.433000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87816950-94a8-43d6-9407-0a520c536d00 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:12.433275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87816950-94a8-43d6-9407-0a520c536d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:12.442450 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87816950-94a8-43d6-9407-0a520c536d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:12.444029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87816950-94a8-43d6-9407-0a520c536d00 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:12.453018 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 718/1437] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:13.391859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefff911-10ef-44ed-9799-9da50539ee1f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:13.392403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefff911-10ef-44ed-9799-9da50539ee1f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:13.392403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefff911-10ef-44ed-9799-9da50539ee1f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:13.393864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 20:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:13.399297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6bbd0-474c-4f09-b75a-122dc7e2665c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:13.399703 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6bbd0-474c-4f09-b75a-122dc7e2665c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:13.399849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6bbd0-474c-4f09-b75a-122dc7e2665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:13.417605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f6a6bbd0-474c-4f09-b75a-122dc7e2665c None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:13.418743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f6a6bbd0-474c-4f09-b75a-122dc7e2665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:13.427356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 20:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 20:58:13.574239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefff911-10ef-44ed-9799-9da50539ee1f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:13.588348 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefff911-10ef-44ed-9799-9da50539ee1f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:13.593731 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb39361-9522-4363-91e8-2c2211041138 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:13.594366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb39361-9522-4363-91e8-2c2211041138 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:13.594649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb39361-9522-4363-91e8-2c2211041138 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:13.594927 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb39361-9522-4363-91e8-2c2211041138 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:13.602751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb39361-9522-4363-91e8-2c2211041138 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:13.604346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb39361-9522-4363-91e8-2c2211041138 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:13.614114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 721/1440] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:15.687253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7b0e8-8819-49ae-8619-0db9ab8e90c4 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:15.687823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7b0e8-8819-49ae-8619-0db9ab8e90c4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:15.687823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7b0e8-8819-49ae-8619-0db9ab8e90c4 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:15.689163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 20:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:15.694409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707c2b2-7f2e-40c7-92b9-aa23be9d2e80 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:15.694796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707c2b2-7f2e-40c7-92b9-aa23be9d2e80 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:15.694974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707c2b2-7f2e-40c7-92b9-aa23be9d2e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:15.712110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9707c2b2-7f2e-40c7-92b9-aa23be9d2e80 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:15.713288 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9707c2b2-7f2e-40c7-92b9-aa23be9d2e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:15.720939 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:15.758651 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7b0e8-8819-49ae-8619-0db9ab8e90c4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:15.768967 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7b0e8-8819-49ae-8619-0db9ab8e90c4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:15.772499 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9fe8e-fcf0-48ee-b903-61b91129193b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:15.773383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9fe8e-fcf0-48ee-b903-61b91129193b service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:15.773700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9fe8e-fcf0-48ee-b903-61b91129193b service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:15.773980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9fe8e-fcf0-48ee-b903-61b91129193b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:15.782513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9fe8e-fcf0-48ee-b903-61b91129193b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:15.783936 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9fe8e-fcf0-48ee-b903-61b91129193b service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:15.792954 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 721/1443] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:18.123522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc3a68-3681-4257-bd26-af2f13919c96 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:18.124056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc3a68-3681-4257-bd26-af2f13919c96 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:18.124056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc3a68-3681-4257-bd26-af2f13919c96 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:18.125905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 20:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:18.130788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19444152-17fd-40d6-98ab-648c6b5880e6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:18.131217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19444152-17fd-40d6-98ab-648c6b5880e6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:18.131349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19444152-17fd-40d6-98ab-648c6b5880e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:18.149202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-19444152-17fd-40d6-98ab-648c6b5880e6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:18.150406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-19444152-17fd-40d6-98ab-648c6b5880e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:18.158673 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 20:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:18.195368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc3a68-3681-4257-bd26-af2f13919c96 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:18.206377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc3a68-3681-4257-bd26-af2f13919c96 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:18.209859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e231eb-386a-453d-9d53-5ca97c885ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:18.210525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e231eb-386a-453d-9d53-5ca97c885ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:18.210810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e231eb-386a-453d-9d53-5ca97c885ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:18.211089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e231eb-386a-453d-9d53-5ca97c885ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:18.220666 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e231eb-386a-453d-9d53-5ca97c885ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:18.222120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e231eb-386a-453d-9d53-5ca97c885ff3 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:18.231264 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 724/1446] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:20.771711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe30e6-a5c3-42af-b94c-29bb17a36a04 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:20.772377 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe30e6-a5c3-42af-b94c-29bb17a36a04 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:20.772377 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe30e6-a5c3-42af-b94c-29bb17a36a04 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:20.773912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 20:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:20.779872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ca8ef-a603-4325-85e7-f5bef5158c74 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:20.780560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ca8ef-a603-4325-85e7-f5bef5158c74 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:20.780560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ca8ef-a603-4325-85e7-f5bef5158c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:20.798809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-446ca8ef-a603-4325-85e7-f5bef5158c74 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:20.800011 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-446ca8ef-a603-4325-85e7-f5bef5158c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:20.807597 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 20:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:20.845286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe30e6-a5c3-42af-b94c-29bb17a36a04 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:20.855548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe30e6-a5c3-42af-b94c-29bb17a36a04 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:20.859666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514eee47-6866-4216-851c-945f30f10ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:20.860299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eee47-6866-4216-851c-945f30f10ede service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:20.860584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eee47-6866-4216-851c-945f30f10ede service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:20.860862 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eee47-6866-4216-851c-945f30f10ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:20.869448 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514eee47-6866-4216-851c-945f30f10ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:20.870901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514eee47-6866-4216-851c-945f30f10ede service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:20.879917 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 724/1449] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:23.214317 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327860a-48ad-43fc-b633-742cab87ee23 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:23.214850 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327860a-48ad-43fc-b633-742cab87ee23 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:23.214850 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327860a-48ad-43fc-b633-742cab87ee23 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:23.216235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 20:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:23.221766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932457f-519d-48e0-a348-877659144907 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:23.222184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932457f-519d-48e0-a348-877659144907 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:23.222361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932457f-519d-48e0-a348-877659144907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:23.239889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c932457f-519d-48e0-a348-877659144907 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:23.241073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c932457f-519d-48e0-a348-877659144907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:23.249459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 20:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:23.287384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327860a-48ad-43fc-b633-742cab87ee23 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:23.298132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327860a-48ad-43fc-b633-742cab87ee23 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:23.301493 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc01b43-f264-499f-bac0-95b02f5af622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:23.302147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01b43-f264-499f-bac0-95b02f5af622 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:23.302425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01b43-f264-499f-bac0-95b02f5af622 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:23.302695 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01b43-f264-499f-bac0-95b02f5af622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:23.311923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc01b43-f264-499f-bac0-95b02f5af622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:23.313338 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc01b43-f264-499f-bac0-95b02f5af622 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:23.322316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 727/1452] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:25.578745 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42963e1-8558-4f21-9cdd-c76c8d25b573 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:25.579315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42963e1-8558-4f21-9cdd-c76c8d25b573 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:25.579315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42963e1-8558-4f21-9cdd-c76c8d25b573 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:25.580701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 20:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:25.586072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6d549-4e94-4382-985f-349f14d068db None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:25.586547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6d549-4e94-4382-985f-349f14d068db None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:25.586673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6d549-4e94-4382-985f-349f14d068db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:25.604287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2af6d549-4e94-4382-985f-349f14d068db None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:25.605463 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2af6d549-4e94-4382-985f-349f14d068db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:25.613232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 20:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:25.651585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42963e1-8558-4f21-9cdd-c76c8d25b573 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:25.662503 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42963e1-8558-4f21-9cdd-c76c8d25b573 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:25.665912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff1d69-2f60-4cbb-9a01-66c5d328e03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:25.666537 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1d69-2f60-4cbb-9a01-66c5d328e03e service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:25.666818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1d69-2f60-4cbb-9a01-66c5d328e03e service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:25.667092 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1d69-2f60-4cbb-9a01-66c5d328e03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:25.675568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff1d69-2f60-4cbb-9a01-66c5d328e03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:25.676998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff1d69-2f60-4cbb-9a01-66c5d328e03e service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:25.685938 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 727/1455] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:27.925805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1184-d5f5-40c6-808c-3c6b804f4900 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:27.926368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1184-d5f5-40c6-808c-3c6b804f4900 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:27.926368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e1184-d5f5-40c6-808c-3c6b804f4900 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:27.927716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 20:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:27.932946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5626e47-de67-42fa-95b8-1053ef19c598 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:27.933364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5626e47-de67-42fa-95b8-1053ef19c598 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:27.933512 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5626e47-de67-42fa-95b8-1053ef19c598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:27.951821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e5626e47-de67-42fa-95b8-1053ef19c598 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:27.953003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e5626e47-de67-42fa-95b8-1053ef19c598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:27.960657 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 20:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:27.998041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e1184-d5f5-40c6-808c-3c6b804f4900 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:27.999696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5a6e1184-d5f5-40c6-808c-3c6b804f4900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:28.012120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e1184-d5f5-40c6-808c-3c6b804f4900 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:28.016082 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8eb17-14e0-48cd-bf76-eb47fee5c819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:28.016712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8eb17-14e0-48cd-bf76-eb47fee5c819 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:28.016993 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8eb17-14e0-48cd-bf76-eb47fee5c819 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:28.017269 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8eb17-14e0-48cd-bf76-eb47fee5c819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:28.026102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8eb17-14e0-48cd-bf76-eb47fee5c819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:28.027521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8eb17-14e0-48cd-bf76-eb47fee5c819 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:28.037145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 730/1458] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:30.305097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce623b50-f168-4ed7-9150-4f442804e583 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:30.305673 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce623b50-f168-4ed7-9150-4f442804e583 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:30.305673 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce623b50-f168-4ed7-9150-4f442804e583 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:30.307106 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 20:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:30.312941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c270e-d42d-46f2-8be5-dc11eb754b7d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:30.313373 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c270e-d42d-46f2-8be5-dc11eb754b7d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:30.313485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c270e-d42d-46f2-8be5-dc11eb754b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:30.331416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b84c270e-d42d-46f2-8be5-dc11eb754b7d None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:30.332637 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b84c270e-d42d-46f2-8be5-dc11eb754b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:30.340455 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 20:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 20:58:30.378714 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce623b50-f168-4ed7-9150-4f442804e583 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:30.389945 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce623b50-f168-4ed7-9150-4f442804e583 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:30.393469 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2432f7c-0e42-4e2e-8e6a-b5cd3674de01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:30.394124 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2432f7c-0e42-4e2e-8e6a-b5cd3674de01 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:30.394520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2432f7c-0e42-4e2e-8e6a-b5cd3674de01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:30.394904 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2432f7c-0e42-4e2e-8e6a-b5cd3674de01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:30.403722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2432f7c-0e42-4e2e-8e6a-b5cd3674de01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:30.405179 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2432f7c-0e42-4e2e-8e6a-b5cd3674de01 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:30.414316 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 730/1461] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:32.655500 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d802d40-c473-4c22-946e-d74ffc5477e8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:32.656075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d802d40-c473-4c22-946e-d74ffc5477e8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:32.656075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d802d40-c473-4c22-946e-d74ffc5477e8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:32.657455 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 20:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:32.662932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fdcf-6cdf-439a-9846-ce3ac5fdabb9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:32.663374 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fdcf-6cdf-439a-9846-ce3ac5fdabb9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:32.663481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fdcf-6cdf-439a-9846-ce3ac5fdabb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:32.681122 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c021fdcf-6cdf-439a-9846-ce3ac5fdabb9 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:32.682329 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c021fdcf-6cdf-439a-9846-ce3ac5fdabb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:32.689977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 20:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:32.725808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d802d40-c473-4c22-946e-d74ffc5477e8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:32.736742 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d802d40-c473-4c22-946e-d74ffc5477e8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:32.740213 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8a8a6-35a4-4e12-98a7-fee4b0533728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:32.740837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8a8a6-35a4-4e12-98a7-fee4b0533728 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:32.741119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8a8a6-35a4-4e12-98a7-fee4b0533728 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:32.741390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8a8a6-35a4-4e12-98a7-fee4b0533728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:32.750603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8a8a6-35a4-4e12-98a7-fee4b0533728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:32.752047 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8a8a6-35a4-4e12-98a7-fee4b0533728 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:32.761424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 733/1464] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:34.984018 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e0fe8-e48b-4df4-b317-ea016af1ca0e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:34.984548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e0fe8-e48b-4df4-b317-ea016af1ca0e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:34.984548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e0fe8-e48b-4df4-b317-ea016af1ca0e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:34.985994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 20:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:34.991153 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b133b-71a2-4a8b-a73d-cd0626ee3279 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:34.991578 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b133b-71a2-4a8b-a73d-cd0626ee3279 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:34.991714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b133b-71a2-4a8b-a73d-cd0626ee3279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:35.008723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0a4b133b-71a2-4a8b-a73d-cd0626ee3279 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:35.009934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0a4b133b-71a2-4a8b-a73d-cd0626ee3279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:35.017567 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 20:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:58:35.055018 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e0fe8-e48b-4df4-b317-ea016af1ca0e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:35.065399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e0fe8-e48b-4df4-b317-ea016af1ca0e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:35.068895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904fbcd-5399-400a-b05d-444fd3d12699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:35.069521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904fbcd-5399-400a-b05d-444fd3d12699 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:35.069833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904fbcd-5399-400a-b05d-444fd3d12699 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:35.070106 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904fbcd-5399-400a-b05d-444fd3d12699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:35.078712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904fbcd-5399-400a-b05d-444fd3d12699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:35.080135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904fbcd-5399-400a-b05d-444fd3d12699 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:35.089190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 733/1467] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:58:37.296189 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc89c-b91e-4cd3-9ae8-21e8c76f89b4 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:37.296712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc89c-b91e-4cd3-9ae8-21e8c76f89b4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:37.296809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc89c-b91e-4cd3-9ae8-21e8c76f89b4 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:37.298151 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 20:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:58:37.303381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001bb27-ce65-41d2-baa8-43b005e80af7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:37.303836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001bb27-ce65-41d2-baa8-43b005e80af7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:37.303938 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001bb27-ce65-41d2-baa8-43b005e80af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:37.324428 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a001bb27-ce65-41d2-baa8-43b005e80af7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:58:37.326243 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a001bb27-ce65-41d2-baa8-43b005e80af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:58:37.333822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 20:58:37.369026 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc89c-b91e-4cd3-9ae8-21e8c76f89b4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:58:37.379958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc89c-b91e-4cd3-9ae8-21e8c76f89b4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:58:37.383563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e66c2-0e26-4aac-b928-38e3f0964f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:58:37.384194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e66c2-0e26-4aac-b928-38e3f0964f12 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:58:37.384479 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e66c2-0e26-4aac-b928-38e3f0964f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:58:37.384759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e66c2-0e26-4aac-b928-38e3f0964f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:58:37.393964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e66c2-0e26-4aac-b928-38e3f0964f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:58:37.398111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e66c2-0e26-4aac-b928-38e3f0964f12 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:58:37.404646 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 736/1470] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:59:10.626667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e614fce-08f9-427a-800f-238cad1a5f6b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:10.627274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e614fce-08f9-427a-800f-238cad1a5f6b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:10.627274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e614fce-08f9-427a-800f-238cad1a5f6b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:10.628583 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 735/1471] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:59:10.633773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b129c3-6d2b-4c2c-9e0e-cf1b38849eed None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:10.634215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b129c3-6d2b-4c2c-9e0e-cf1b38849eed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:10.634324 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b129c3-6d2b-4c2c-9e0e-cf1b38849eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:10.652811 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c5b129c3-6d2b-4c2c-9e0e-cf1b38849eed None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:59:10.654030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c5b129c3-6d2b-4c2c-9e0e-cf1b38849eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:59:10.661796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 737/1472] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 20:59:10.707682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd21f7-ad9d-4363-a609-2dcc33eb8050 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:10.707968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd21f7-ad9d-4363-a609-2dcc33eb8050 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:10.708247 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd21f7-ad9d-4363-a609-2dcc33eb8050 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:10.709615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 736/1473] 10.222.0.35 () {54 vars in 962 bytes} [Wed May 11 20:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:59:10.715139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e8109-7f60-417d-848a-2ee18fb28b68 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:10.718730 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e8109-7f60-417d-848a-2ee18fb28b68 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:10.718730 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e8109-7f60-417d-848a-2ee18fb28b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:10.733202 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-815e8109-7f60-417d-848a-2ee18fb28b68 None None] MFA Rules not processed for user `4ce12ee27315460793dfedd294eb3c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:59:10.734418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-815e8109-7f60-417d-848a-2ee18fb28b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:59:10.740835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 738/1474] 10.222.0.35 () {58 vars in 1059 bytes} [Wed May 11 20:59:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:59:10.748062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd21f7-ad9d-4363-a609-2dcc33eb8050 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:59:10.758306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd21f7-ad9d-4363-a609-2dcc33eb8050 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:59:10.762366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f93000-68c9-4df1-a69e-2a1bf832d54d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce12ee27315460793dfedd294eb3c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:59:10.762981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f93000-68c9-4df1-a69e-2a1bf832d54d service glance] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:10.763259 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f93000-68c9-4df1-a69e-2a1bf832d54d service glance] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:10.763529 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f93000-68c9-4df1-a69e-2a1bf832d54d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:10.772008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f93000-68c9-4df1-a69e-2a1bf832d54d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:59:10.773790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f93000-68c9-4df1-a69e-2a1bf832d54d service glance] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:59:10.783722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 737/1475] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 20:59:13.071847 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e9f17-84d5-4a6f-9072-13c873015410 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:13.072428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e9f17-84d5-4a6f-9072-13c873015410 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:13.072428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e9f17-84d5-4a6f-9072-13c873015410 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:13.073827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 739/1476] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:59:13.079088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838dfbe-2033-4225-ac80-4eeb6cd329fc None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:13.079492 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838dfbe-2033-4225-ac80-4eeb6cd329fc None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:13.079681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838dfbe-2033-4225-ac80-4eeb6cd329fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:13.097377 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4838dfbe-2033-4225-ac80-4eeb6cd329fc None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:59:13.098539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4838dfbe-2033-4225-ac80-4eeb6cd329fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:59:13.106963 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 738/1477] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:59:13.129224 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e9f17-84d5-4a6f-9072-13c873015410 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:59:13.141301 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e9f17-84d5-4a6f-9072-13c873015410 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:59:13.145710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484ca49-1f2e-44ea-b394-b1326537b7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:59:13.146352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484ca49-1f2e-44ea-b394-b1326537b7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:13.146637 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484ca49-1f2e-44ea-b394-b1326537b7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:13.146930 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484ca49-1f2e-44ea-b394-b1326537b7b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:13.147923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484ca49-1f2e-44ea-b394-b1326537b7b5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:59:13.149714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-a484ca49-1f2e-44ea-b394-b1326537b7b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 20:59:13.149714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 11 20:59:13.149714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: May 11 20:59:13.150851 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484ca49-1f2e-44ea-b394-b1326537b7b5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:59:13.170592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 740/1478] 10.222.0.35 () {56 vars in 1108 bytes} [Wed May 11 20:59:13 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 20:59:15.377245 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b257188-4ef2-4739-b05b-690af5cf89aa None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:15.377841 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b257188-4ef2-4739-b05b-690af5cf89aa None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:15.377841 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b257188-4ef2-4739-b05b-690af5cf89aa None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:15.379201 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 739/1479] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:59:15.384569 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341669b-7796-4870-a2a3-f090bb39063f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:15.384988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341669b-7796-4870-a2a3-f090bb39063f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:15.385125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341669b-7796-4870-a2a3-f090bb39063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:15.403567 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a341669b-7796-4870-a2a3-f090bb39063f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:59:15.404780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a341669b-7796-4870-a2a3-f090bb39063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:59:15.412501 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 741/1480] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:59:15.454750 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b257188-4ef2-4739-b05b-690af5cf89aa None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:59:15.468516 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b257188-4ef2-4739-b05b-690af5cf89aa None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:59:15.473850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17692686-dad0-4d66-9a54-df051c4a8343 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:59:15.474476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17692686-dad0-4d66-9a54-df051c4a8343 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:15.474756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17692686-dad0-4d66-9a54-df051c4a8343 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:15.475032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17692686-dad0-4d66-9a54-df051c4a8343 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:15.482743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17692686-dad0-4d66-9a54-df051c4a8343 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:59:15.484316 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17692686-dad0-4d66-9a54-df051c4a8343 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:59:15.493262 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 740/1481] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:59:17.873992 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50870c-1c49-4ceb-9799-76bdc0f69760 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:17.874486 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50870c-1c49-4ceb-9799-76bdc0f69760 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:17.874595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50870c-1c49-4ceb-9799-76bdc0f69760 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:17.875904 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 742/1482] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:59:17.881186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ce10b-f0eb-4dfb-8255-ef31f5583417 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:17.881646 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ce10b-f0eb-4dfb-8255-ef31f5583417 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:17.881767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ce10b-f0eb-4dfb-8255-ef31f5583417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:17.898942 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1f4ce10b-f0eb-4dfb-8255-ef31f5583417 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:59:17.900116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1f4ce10b-f0eb-4dfb-8255-ef31f5583417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:59:17.908264 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 741/1483] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 20:59:17.944135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50870c-1c49-4ceb-9799-76bdc0f69760 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:59:17.955081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50870c-1c49-4ceb-9799-76bdc0f69760 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:59:17.958600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e87dce-ec4c-45f9-bed8-6c62d6569b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:59:17.959232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e87dce-ec4c-45f9-bed8-6c62d6569b6d service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:17.959520 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e87dce-ec4c-45f9-bed8-6c62d6569b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:17.959820 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e87dce-ec4c-45f9-bed8-6c62d6569b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:17.969235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e87dce-ec4c-45f9-bed8-6c62d6569b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:59:17.970710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e87dce-ec4c-45f9-bed8-6c62d6569b6d service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:59:17.980043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 743/1484] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:59:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:59:20.225345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6ca1-2888-420f-95c0-84467ecd670a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:20.225937 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6ca1-2888-420f-95c0-84467ecd670a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:20.225937 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea6ca1-2888-420f-95c0-84467ecd670a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:20.227215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 742/1485] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:59:20.233065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e70415-8b93-4971-9015-d2f2bb331f14 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:20.233495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e70415-8b93-4971-9015-d2f2bb331f14 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:20.233678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e70415-8b93-4971-9015-d2f2bb331f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:20.251578 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-14e70415-8b93-4971-9015-d2f2bb331f14 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:59:20.252796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-14e70415-8b93-4971-9015-d2f2bb331f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:59:20.260537 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 744/1486] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:59:20.297750 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea6ca1-2888-420f-95c0-84467ecd670a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:59:20.308590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea6ca1-2888-420f-95c0-84467ecd670a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:59:20.312129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15d140-b5b3-44be-a6b6-1a99dc5fb6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:59:20.312751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15d140-b5b3-44be-a6b6-1a99dc5fb6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:20.313031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15d140-b5b3-44be-a6b6-1a99dc5fb6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:20.313304 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15d140-b5b3-44be-a6b6-1a99dc5fb6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:20.321779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15d140-b5b3-44be-a6b6-1a99dc5fb6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:59:20.323228 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15d140-b5b3-44be-a6b6-1a99dc5fb6e4 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:59:20.332176 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 743/1487] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:59:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:59:22.618212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4274e7-3e15-4346-a05f-d9bf286c02a6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:22.618777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4274e7-3e15-4346-a05f-d9bf286c02a6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:22.618777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4274e7-3e15-4346-a05f-d9bf286c02a6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:22.620088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 745/1488] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:59:22.625324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd26a27-64e2-417c-a64a-70aaed97bd16 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:22.625816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd26a27-64e2-417c-a64a-70aaed97bd16 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:22.625935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd26a27-64e2-417c-a64a-70aaed97bd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:22.648061 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7dd26a27-64e2-417c-a64a-70aaed97bd16 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:59:22.649243 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7dd26a27-64e2-417c-a64a-70aaed97bd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:59:22.657609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 744/1489] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 20:59:22.696481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4274e7-3e15-4346-a05f-d9bf286c02a6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:59:22.707426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4274e7-3e15-4346-a05f-d9bf286c02a6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:59:22.710930 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61434f0-7705-4570-b72c-176b406a7c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:59:22.711562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61434f0-7705-4570-b72c-176b406a7c85 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:22.711849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61434f0-7705-4570-b72c-176b406a7c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:22.712128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61434f0-7705-4570-b72c-176b406a7c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:22.721942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61434f0-7705-4570-b72c-176b406a7c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:59:22.723404 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61434f0-7705-4570-b72c-176b406a7c85 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:59:22.732519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 746/1490] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 20:59:25.293774 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6d610-3ebf-4a60-8214-51156181bdde None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:25.294318 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6d610-3ebf-4a60-8214-51156181bdde None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:25.294318 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6d610-3ebf-4a60-8214-51156181bdde None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:25.295674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 745/1491] 10.222.0.35 () {54 vars in 926 bytes} [Wed May 11 20:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 20:59:25.300781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db169f1d-def0-4559-bffa-99c75eadb271 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:25.301220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db169f1d-def0-4559-bffa-99c75eadb271 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:25.301374 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db169f1d-def0-4559-bffa-99c75eadb271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:25.319001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-db169f1d-def0-4559-bffa-99c75eadb271 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 20:59:25.320181 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-db169f1d-def0-4559-bffa-99c75eadb271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 20:59:25.328494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 747/1492] 10.222.0.35 () {58 vars in 1023 bytes} [Wed May 11 20:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 20:59:25.365381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6d610-3ebf-4a60-8214-51156181bdde None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 20:59:25.376531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6d610-3ebf-4a60-8214-51156181bdde None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 20:59:25.380009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0d88e-7d1b-4c9f-87a3-4c6d3c7cfe0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 20:59:25.385972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0d88e-7d1b-4c9f-87a3-4c6d3c7cfe0d service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 20:59:25.385972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0d88e-7d1b-4c9f-87a3-4c6d3c7cfe0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 20:59:25.385972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0d88e-7d1b-4c9f-87a3-4c6d3c7cfe0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 20:59:25.390414 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0d88e-7d1b-4c9f-87a3-4c6d3c7cfe0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 20:59:25.391832 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0d88e-7d1b-4c9f-87a3-4c6d3c7cfe0d service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 20:59:25.401105 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 746/1493] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 20:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:01:03.202558 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c1872-927d-420b-9e31-ba07f2ddbfd6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:03.203157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c1872-927d-420b-9e31-ba07f2ddbfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:03.203157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c1872-927d-420b-9e31-ba07f2ddbfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:03.220554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f34c1872-927d-420b-9e31-ba07f2ddbfd6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:01:03.221805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f34c1872-927d-420b-9e31-ba07f2ddbfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:01:03.229444 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 748/1494] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:01:03.238961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506614ce-b5e3-4250-839c-205405b43ba5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:03.239473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506614ce-b5e3-4250-839c-205405b43ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:03.239600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506614ce-b5e3-4250-839c-205405b43ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:03.257287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-506614ce-b5e3-4250-839c-205405b43ba5 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:01:03.258502 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-506614ce-b5e3-4250-839c-205405b43ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:01:03.266292 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 747/1495] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:01:03.270694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c1872-927d-420b-9e31-ba07f2ddbfd6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:01:03.280141 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c1872-927d-420b-9e31-ba07f2ddbfd6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:01:03.284488 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604381d-f498-471e-bcaf-5be8381960c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:01:03.285125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604381d-f498-471e-bcaf-5be8381960c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:03.285407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604381d-f498-471e-bcaf-5be8381960c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:03.285715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604381d-f498-471e-bcaf-5be8381960c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:03.286426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604381d-f498-471e-bcaf-5be8381960c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:01:03.286732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604381d-f498-471e-bcaf-5be8381960c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:01:03.287728 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-6604381d-f498-471e-bcaf-5be8381960c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 21:01:03.287728 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 11 21:01:03.287728 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: May 11 21:01:03.288615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604381d-f498-471e-bcaf-5be8381960c1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:01:03.300087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 749/1496] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:01:03.308611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506614ce-b5e3-4250-839c-205405b43ba5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:01:03.317432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506614ce-b5e3-4250-839c-205405b43ba5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:01:03.322035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca37648-00d2-4fb9-9fa0-e66ec6cf14b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:01:03.322669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca37648-00d2-4fb9-9fa0-e66ec6cf14b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:03.322952 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca37648-00d2-4fb9-9fa0-e66ec6cf14b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:03.323228 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca37648-00d2-4fb9-9fa0-e66ec6cf14b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:03.323933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca37648-00d2-4fb9-9fa0-e66ec6cf14b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:01:03.325668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: WARNING py.warnings [None req-9ca37648-00d2-4fb9-9fa0-e66ec6cf14b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 21:01:03.325668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: warnings.warn(msg) May 11 21:01:03.325668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: May 11 21:01:03.326876 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca37648-00d2-4fb9-9fa0-e66ec6cf14b5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:01:03.445693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 748/1497] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:01:03 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:01:03.450084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604381d-f498-471e-bcaf-5be8381960c1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:01:03.459588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604381d-f498-471e-bcaf-5be8381960c1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:01:03.512721 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf098b1-0fd4-4fc1-aa1f-164d9196e745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:01:03.513381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf098b1-0fd4-4fc1-aa1f-164d9196e745 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:03.513708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf098b1-0fd4-4fc1-aa1f-164d9196e745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:03.513990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf098b1-0fd4-4fc1-aa1f-164d9196e745 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:03.514718 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf098b1-0fd4-4fc1-aa1f-164d9196e745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:01:03.515720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-cbf098b1-0fd4-4fc1-aa1f-164d9196e745 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 21:01:03.515720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 11 21:01:03.515720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: May 11 21:01:03.516935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf098b1-0fd4-4fc1-aa1f-164d9196e745 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:01:03.610590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 750/1498] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:01:03 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:01:03.614711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca37648-00d2-4fb9-9fa0-e66ec6cf14b5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:01:03.656145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca37648-00d2-4fb9-9fa0-e66ec6cf14b5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:01:03.656145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cbf5a0-fc8a-41d7-9d8b-507daf6b47b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:01:03.656145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbf5a0-fc8a-41d7-9d8b-507daf6b47b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:03.656145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbf5a0-fc8a-41d7-9d8b-507daf6b47b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:03.656584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbf5a0-fc8a-41d7-9d8b-507daf6b47b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:03.656584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbf5a0-fc8a-41d7-9d8b-507daf6b47b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:01:03.656584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: WARNING py.warnings [None req-44cbf5a0-fc8a-41d7-9d8b-507daf6b47b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 21:01:03.656584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: warnings.warn(msg) May 11 21:01:03.656584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: May 11 21:01:03.656584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbf5a0-fc8a-41d7-9d8b-507daf6b47b9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:01:03.656584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 749/1499] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:01:03.659118 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf098b1-0fd4-4fc1-aa1f-164d9196e745 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:01:03.669584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf098b1-0fd4-4fc1-aa1f-164d9196e745 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:01:03.674088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dfb74-e410-4ad1-98cf-ffb2c855c90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:01:03.674760 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dfb74-e410-4ad1-98cf-ffb2c855c90f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:03.675040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dfb74-e410-4ad1-98cf-ffb2c855c90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:03.675314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dfb74-e410-4ad1-98cf-ffb2c855c90f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:03.676031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500dfb74-e410-4ad1-98cf-ffb2c855c90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:01:03.677057 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-500dfb74-e410-4ad1-98cf-ffb2c855c90f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 21:01:03.677057 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 11 21:01:03.677057 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: May 11 21:01:03.678022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500dfb74-e410-4ad1-98cf-ffb2c855c90f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:01:03.692037 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 751/1500] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:01:03.696193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cbf5a0-fc8a-41d7-9d8b-507daf6b47b9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:01:03.705786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cbf5a0-fc8a-41d7-9d8b-507daf6b47b9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:01:03.710281 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918232b-4caa-4ace-8d9d-8e913a5d359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:01:03.711099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918232b-4caa-4ace-8d9d-8e913a5d359a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:03.711384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918232b-4caa-4ace-8d9d-8e913a5d359a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:03.711670 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918232b-4caa-4ace-8d9d-8e913a5d359a admin admin] PATH_INFO: `/v3/projects/d29429d6593041d9862295b60319b053/users/3f6146cddf7540b2bf308453244ee8f3/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:03.725948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918232b-4caa-4ace-8d9d-8e913a5d359a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29429d6593041d9862295b60319b053, user_id=3f6146cddf7540b2bf308453244ee8f3, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:01:03.726973 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: WARNING py.warnings [None req-2918232b-4caa-4ace-8d9d-8e913a5d359a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 21:01:03.726973 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: warnings.warn(msg) May 11 21:01:03.726973 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: May 11 21:01:03.728878 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918232b-4caa-4ace-8d9d-8e913a5d359a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:01:03.809788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 750/1501] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:01:03 2022] PUT /identity/v3/projects/d29429d6593041d9862295b60319b053/users/3f6146cddf7540b2bf308453244ee8f3/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:01:03.820852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006c72-8ef5-4460-b522-a08a984a442d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:03.821215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006c72-8ef5-4460-b522-a08a984a442d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:03.821597 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006c72-8ef5-4460-b522-a08a984a442d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:03.847872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ed006c72-8ef5-4460-b522-a08a984a442d None None] MFA Rules not processed for user `3f6146cddf7540b2bf308453244ee8f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:01:03.849109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ed006c72-8ef5-4460-b522-a08a984a442d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:01:03.909541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 752/1502] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:01:03.923146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8584b1-138a-4a54-ab29-68c477fe2f1b None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:03.923438 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8584b1-138a-4a54-ab29-68c477fe2f1b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:03.923717 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8584b1-138a-4a54-ab29-68c477fe2f1b None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:03.925082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 751/1503] 10.222.0.35 () {54 vars in 963 bytes} [Wed May 11 21:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:01:03.929935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566545f-dade-4f01-ada3-fd948f5e90a6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:03.930230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566545f-dade-4f01-ada3-fd948f5e90a6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:03.930513 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566545f-dade-4f01-ada3-fd948f5e90a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:03.947832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0566545f-dade-4f01-ada3-fd948f5e90a6 None None] MFA Rules not processed for user `3888fb083b0149bd92054cffa88c51e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:01:03.949539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0566545f-dade-4f01-ada3-fd948f5e90a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:01:03.997290 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 753/1504] 10.222.0.35 () {58 vars in 1060 bytes} [Wed May 11 21:01:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:01:04.004607 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8584b1-138a-4a54-ab29-68c477fe2f1b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:01:04.015573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8584b1-138a-4a54-ab29-68c477fe2f1b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:01:04.019329 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210a080-bcdd-4510-ab69-99513c87eb80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:01:04.019971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210a080-bcdd-4510-ab69-99513c87eb80 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:04.020260 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210a080-bcdd-4510-ab69-99513c87eb80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:04.020538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210a080-bcdd-4510-ab69-99513c87eb80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:04.029628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210a080-bcdd-4510-ab69-99513c87eb80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:01:04.031059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210a080-bcdd-4510-ab69-99513c87eb80 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:01:04.039570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 752/1505] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:01:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:01:04.080784 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e381b7d-70cb-4e2c-8f31-ccd7be50f67d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:04.081080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e381b7d-70cb-4e2c-8f31-ccd7be50f67d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:04.081364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e381b7d-70cb-4e2c-8f31-ccd7be50f67d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:04.082701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 754/1506] 10.222.0.35 () {52 vars in 829 bytes} [Wed May 11 21:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:01:04.086148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210a080-bcdd-4510-ab69-99513c87eb80 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:01:04.145753 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210a080-bcdd-4510-ab69-99513c87eb80 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:01:04.150557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:01:04.151426 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:04.152295 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:04.152570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] PATH_INFO: `/v3/users/3f6146cddf7540b2bf308453244ee8f3` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:04.153795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f6146cddf7540b2bf308453244ee8f3)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:01:04.154809 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: WARNING py.warnings [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 21:01:04.154809 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: warnings.warn(msg) May 11 21:01:04.154809 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: May 11 21:01:04.156032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:01:04.405101 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f6146cddf7540b2bf308453244ee8f3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:01:04.485739 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f6146cddf7540b2bf308453244ee8f3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:01:04.498093 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f6146cddf7540b2bf308453244ee8f3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:01:04.501190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f6146cddf7540b2bf308453244ee8f3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:01:04.501190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f6146cddf7540b2bf308453244ee8f3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:01:04.523021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 753/1507] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:01:04 2022] DELETE /identity/v3/users/3f6146cddf7540b2bf308453244ee8f3 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:01:04.527575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9a9cf-cd8c-4863-b6f2-e16964757c0e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:04.528048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9a9cf-cd8c-4863-b6f2-e16964757c0e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:04.528162 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9a9cf-cd8c-4863-b6f2-e16964757c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:04.544952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7fa9a9cf-cd8c-4863-b6f2-e16964757c0e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:01:04.546166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7fa9a9cf-cd8c-4863-b6f2-e16964757c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:01:04.604001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 755/1508] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:01:04.614055 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:01:04.615477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:01:04.670757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9969cd5-f489-4c8e-8403-adf263a2cd14 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:01:04.674277 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7910e-dfde-4c9e-95aa-17a8e0b8e3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:01:04.674920 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7910e-dfde-4c9e-95aa-17a8e0b8e3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:04.675205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7910e-dfde-4c9e-95aa-17a8e0b8e3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:04.675509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7910e-dfde-4c9e-95aa-17a8e0b8e3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:04.684828 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7910e-dfde-4c9e-95aa-17a8e0b8e3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:01:04.686312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7910e-dfde-4c9e-95aa-17a8e0b8e3a7 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:01:04.695591 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 754/1509] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:01:05.127840 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9a9cf-cd8c-4863-b6f2-e16964757c0e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:01:05.129247 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7fa9a9cf-cd8c-4863-b6f2-e16964757c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:01:05.141138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9a9cf-cd8c-4863-b6f2-e16964757c0e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:01:05.146730 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e17d2-e6c2-4d23-be12-573fd5159b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:01:05.147900 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e17d2-e6c2-4d23-be12-573fd5159b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:01:05.148183 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e17d2-e6c2-4d23-be12-573fd5159b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:01:05.148457 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e17d2-e6c2-4d23-be12-573fd5159b10 admin admin] PATH_INFO: `/v3/projects/d29429d6593041d9862295b60319b053` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:01:05.149676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e17d2-e6c2-4d23-be12-573fd5159b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29429d6593041d9862295b60319b053)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:01:05.150689 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-c89e17d2-e6c2-4d23-be12-573fd5159b10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 21:01:05.150689 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 11 21:01:05.150689 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: May 11 21:01:05.152444 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e17d2-e6c2-4d23-be12-573fd5159b10 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:01:05.267500 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c89e17d2-e6c2-4d23-be12-573fd5159b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29429d6593041d9862295b60319b053', 'request_id': 'req-c89e17d2-e6c2-4d23-be12-573fd5159b10'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:01:05.281134 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c89e17d2-e6c2-4d23-be12-573fd5159b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29429d6593041d9862295b60319b053', 'request_id': 'req-c89e17d2-e6c2-4d23-be12-573fd5159b10'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:01:05.286961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c89e17d2-e6c2-4d23-be12-573fd5159b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29429d6593041d9862295b60319b053', 'request_id': 'req-c89e17d2-e6c2-4d23-be12-573fd5159b10'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:01:05.354772 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c89e17d2-e6c2-4d23-be12-573fd5159b10 admin admin] The token cache is being invalidate because project d29429d6593041d9862295b60319b053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:01:05.355165 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c89e17d2-e6c2-4d23-be12-573fd5159b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:01:05.356239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c89e17d2-e6c2-4d23-be12-573fd5159b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:01:05.357953 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 756/1510] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:01:05 2022] DELETE /identity/v3/projects/d29429d6593041d9862295b60319b053 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:02:42.751733 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d64a3-3013-427a-8ca0-22ff2781dfb4 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:42.752350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d64a3-3013-427a-8ca0-22ff2781dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:42.752350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d64a3-3013-427a-8ca0-22ff2781dfb4 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:42.753685 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 21:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:02:42.758521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c280a-8fa7-42dd-af0a-24a935e3d6f6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:42.758937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c280a-8fa7-42dd-af0a-24a935e3d6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:42.759078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c280a-8fa7-42dd-af0a-24a935e3d6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:42.777279 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e88c280a-8fa7-42dd-af0a-24a935e3d6f6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:02:42.778502 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e88c280a-8fa7-42dd-af0a-24a935e3d6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:02:42.833373 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 21:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:02:43.002704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d64a3-3013-427a-8ca0-22ff2781dfb4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:02:43.004312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0e7d64a3-3013-427a-8ca0-22ff2781dfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:02:43.075883 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d64a3-3013-427a-8ca0-22ff2781dfb4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:02:43.081239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbcbfa-3362-41da-a19d-4c788c4239a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:02:43.083243 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbcbfa-3362-41da-a19d-4c788c4239a8 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:43.083243 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbcbfa-3362-41da-a19d-4c788c4239a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:43.083243 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbcbfa-3362-41da-a19d-4c788c4239a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:43.090325 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbcbfa-3362-41da-a19d-4c788c4239a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:02:43.091919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbcbfa-3362-41da-a19d-4c788c4239a8 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:02:43.101001 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 756/1513] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:02:43.928369 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cac53a-0257-4047-99bd-b8cbfdf051a8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:43.928922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cac53a-0257-4047-99bd-b8cbfdf051a8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:43.928922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cac53a-0257-4047-99bd-b8cbfdf051a8 None None] PATH_INFO: `/v3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:43.930312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 758/1514] 10.222.0.70 () {54 vars in 925 bytes} [Wed May 11 21:02:43 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:02:43.940614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63678a04-d829-4295-bd71-4488f24201c5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:43.941124 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63678a04-d829-4295-bd71-4488f24201c5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:43.941235 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63678a04-d829-4295-bd71-4488f24201c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:43.960560 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-63678a04-d829-4295-bd71-4488f24201c5 None None] MFA Rules not processed for user `59cb32d2807549699e37b27ca97d351c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:02:43.961790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-63678a04-d829-4295-bd71-4488f24201c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:02:43.997910 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a05b5-6b8e-4589-91f7-71079969da8c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:43.998118 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a05b5-6b8e-4589-91f7-71079969da8c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:43.998411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a05b5-6b8e-4589-91f7-71079969da8c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:43.999780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 759/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 21:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:02:44.004467 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0738cc-0c6a-44ee-a7b6-744214f8cda6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:44.004754 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0738cc-0c6a-44ee-a7b6-744214f8cda6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:44.005034 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0738cc-0c6a-44ee-a7b6-744214f8cda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:44.025371 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4f0738cc-0c6a-44ee-a7b6-744214f8cda6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:02:44.026343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 757/1516] 10.222.0.70 () {58 vars in 1015 bytes} [Wed May 11 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:02:44.026720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4f0738cc-0c6a-44ee-a7b6-744214f8cda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:02:44.034763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 760/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 21:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:02:44.185378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63678a04-d829-4295-bd71-4488f24201c5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:02:44.197021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63678a04-d829-4295-bd71-4488f24201c5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:02:44.203065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cd842-2119-4b6c-9847-a10a2581efa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:02:44.203699 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cd842-2119-4b6c-9847-a10a2581efa1 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:44.203980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cd842-2119-4b6c-9847-a10a2581efa1 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:44.204255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cd842-2119-4b6c-9847-a10a2581efa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:44.212078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cd842-2119-4b6c-9847-a10a2581efa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:02:44.213736 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cd842-2119-4b6c-9847-a10a2581efa1 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:02:44.222794 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 758/1518] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:02:48.100558 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5cf69-f765-44d0-b54f-e59d2f4d9381 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:48.101102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5cf69-f765-44d0-b54f-e59d2f4d9381 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:48.101102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5cf69-f765-44d0-b54f-e59d2f4d9381 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:48.102516 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 761/1519] 10.222.0.35 () {54 vars in 960 bytes} [Wed May 11 21:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:02:48.108300 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ce9e7-c303-4c97-afd9-6e0a575632f5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:48.108742 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ce9e7-c303-4c97-afd9-6e0a575632f5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:48.108840 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ce9e7-c303-4c97-afd9-6e0a575632f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:48.126910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fb6ce9e7-c303-4c97-afd9-6e0a575632f5 None None] MFA Rules not processed for user `59cb32d2807549699e37b27ca97d351c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:02:48.128090 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fb6ce9e7-c303-4c97-afd9-6e0a575632f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:02:48.136894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 759/1520] 10.222.0.35 () {58 vars in 1057 bytes} [Wed May 11 21:02:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:02:48.145494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5cf69-f765-44d0-b54f-e59d2f4d9381 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:02:48.159288 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5cf69-f765-44d0-b54f-e59d2f4d9381 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:02:48.164140 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef7c49-24fa-49f1-ab96-e1f2bb09f195 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59cb32d2807549699e37b27ca97d351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:02:48.164775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef7c49-24fa-49f1-ab96-e1f2bb09f195 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:48.165162 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef7c49-24fa-49f1-ab96-e1f2bb09f195 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:48.165439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef7c49-24fa-49f1-ab96-e1f2bb09f195 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:48.174068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef7c49-24fa-49f1-ab96-e1f2bb09f195 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:02:48.175799 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef7c49-24fa-49f1-ab96-e1f2bb09f195 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:02:48.185507 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 762/1521] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:02:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:02:55.512039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d955c-fb65-4922-b115-8b2e0e4eccb2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:55.512634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d955c-fb65-4922-b115-8b2e0e4eccb2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:55.512634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d955c-fb65-4922-b115-8b2e0e4eccb2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:55.514012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 21:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:02:55.519017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b29072-39b0-47ae-a1b6-35f3d833f04c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:55.519447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b29072-39b0-47ae-a1b6-35f3d833f04c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:55.519559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b29072-39b0-47ae-a1b6-35f3d833f04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:55.537265 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b3b29072-39b0-47ae-a1b6-35f3d833f04c None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:02:55.538547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b3b29072-39b0-47ae-a1b6-35f3d833f04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:02:55.546206 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 21:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:02:55.696798 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d955c-fb65-4922-b115-8b2e0e4eccb2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:02:55.711007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d955c-fb65-4922-b115-8b2e0e4eccb2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:02:55.716362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01433a1-4b6e-45b7-a974-6dc7db11bcf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:02:55.716995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01433a1-4b6e-45b7-a974-6dc7db11bcf4 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:55.717281 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01433a1-4b6e-45b7-a974-6dc7db11bcf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:55.717594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01433a1-4b6e-45b7-a974-6dc7db11bcf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:55.725573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01433a1-4b6e-45b7-a974-6dc7db11bcf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:02:55.727177 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01433a1-4b6e-45b7-a974-6dc7db11bcf4 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:02:55.736843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 761/1524] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:02:56.616731 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7ae69-070a-4cfb-855d-a90223b16643 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:56.617308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7ae69-070a-4cfb-855d-a90223b16643 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:56.617308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7ae69-070a-4cfb-855d-a90223b16643 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:56.618675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 11 21:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:02:56.624165 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a53134-1883-4fa1-96a5-ae30007d5497 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:56.624602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a53134-1883-4fa1-96a5-ae30007d5497 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:56.624715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a53134-1883-4fa1-96a5-ae30007d5497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:56.642028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c7a53134-1883-4fa1-96a5-ae30007d5497 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:02:56.643198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c7a53134-1883-4fa1-96a5-ae30007d5497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:02:56.651052 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 11 21:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:02:56.800878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7ae69-070a-4cfb-855d-a90223b16643 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:02:56.814832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7ae69-070a-4cfb-855d-a90223b16643 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:02:56.820368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494cc3b8-283e-4ea7-97ea-1fa2c7acf4bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:02:56.821000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cc3b8-283e-4ea7-97ea-1fa2c7acf4bc service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:02:56.821315 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cc3b8-283e-4ea7-97ea-1fa2c7acf4bc service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:02:56.821611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cc3b8-283e-4ea7-97ea-1fa2c7acf4bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:02:56.829845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cc3b8-283e-4ea7-97ea-1fa2c7acf4bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:02:56.831419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494cc3b8-283e-4ea7-97ea-1fa2c7acf4bc service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:02:56.841037 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 765/1527] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:03:01.014874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4504b-9dad-47e5-b55e-b27d98c9b943 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:03:01.015435 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4504b-9dad-47e5-b55e-b27d98c9b943 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:03:01.015435 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4504b-9dad-47e5-b55e-b27d98c9b943 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:03:01.016821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 21:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:03:01.022406 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582171c3-b239-4295-a1c6-376ea25d98eb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:03:01.022861 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582171c3-b239-4295-a1c6-376ea25d98eb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:03:01.022982 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582171c3-b239-4295-a1c6-376ea25d98eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:03:01.041110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-582171c3-b239-4295-a1c6-376ea25d98eb None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:03:01.042345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-582171c3-b239-4295-a1c6-376ea25d98eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:03:01.050401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 21:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:03:01.087054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4504b-9dad-47e5-b55e-b27d98c9b943 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:03:01.088709 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7ab4504b-9dad-47e5-b55e-b27d98c9b943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:03:01.145450 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4504b-9dad-47e5-b55e-b27d98c9b943 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:03:01.149181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47dd54-9949-489a-bc31-037408e27618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:03:01.149859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47dd54-9949-489a-bc31-037408e27618 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:03:01.150142 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47dd54-9949-489a-bc31-037408e27618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:03:01.150417 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47dd54-9949-489a-bc31-037408e27618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:03:01.159708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47dd54-9949-489a-bc31-037408e27618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:03:01.161136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47dd54-9949-489a-bc31-037408e27618 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:03:01.170160 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 764/1530] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:03:03.350481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9b5f0-feb1-45a0-8709-4a28657844ca None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:03:03.350998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9b5f0-feb1-45a0-8709-4a28657844ca None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:03:03.351098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9b5f0-feb1-45a0-8709-4a28657844ca None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:03:03.352395 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 21:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:03:03.358145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb2b13-affa-49c2-83cb-340bc1efe183 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:03:03.364782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb2b13-affa-49c2-83cb-340bc1efe183 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:03:03.364782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb2b13-affa-49c2-83cb-340bc1efe183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:03:03.376842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-afdb2b13-affa-49c2-83cb-340bc1efe183 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:03:03.378197 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-afdb2b13-affa-49c2-83cb-340bc1efe183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:03:03.385996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 21:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:03:03.422301 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9b5f0-feb1-45a0-8709-4a28657844ca None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:03:03.433228 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9b5f0-feb1-45a0-8709-4a28657844ca None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:03:03.436733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025481df-a81b-456b-8df1-cfdd3821a06f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:03:03.437356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025481df-a81b-456b-8df1-cfdd3821a06f service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:03:03.437671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025481df-a81b-456b-8df1-cfdd3821a06f service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:03:03.437946 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025481df-a81b-456b-8df1-cfdd3821a06f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:03:03.446499 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025481df-a81b-456b-8df1-cfdd3821a06f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:03:03.447914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025481df-a81b-456b-8df1-cfdd3821a06f service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:03:03.457003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 768/1533] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:03:07.062772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fab50-dbb4-42cc-a0b9-ec52aebc2f4c None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:03:07.063353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fab50-dbb4-42cc-a0b9-ec52aebc2f4c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:03:07.063353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fab50-dbb4-42cc-a0b9-ec52aebc2f4c None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:03:07.064784 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 21:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:03:07.070192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a2d8-895c-4c6b-8e16-37042aeae89c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:03:07.070626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a2d8-895c-4c6b-8e16-37042aeae89c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:03:07.070752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a2d8-895c-4c6b-8e16-37042aeae89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:03:07.089401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0df8a2d8-895c-4c6b-8e16-37042aeae89c None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:03:07.090668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0df8a2d8-895c-4c6b-8e16-37042aeae89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:03:07.098537 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 21:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:03:07.369126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fab50-dbb4-42cc-a0b9-ec52aebc2f4c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:03:07.371324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-519fab50-dbb4-42cc-a0b9-ec52aebc2f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:03:07.426072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fab50-dbb4-42cc-a0b9-ec52aebc2f4c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:03:07.429598 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc52f9-be60-4a06-acb3-c85ee2e02469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:03:07.430270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc52f9-be60-4a06-acb3-c85ee2e02469 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:03:07.430555 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc52f9-be60-4a06-acb3-c85ee2e02469 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:03:07.430837 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc52f9-be60-4a06-acb3-c85ee2e02469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:03:07.440089 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc52f9-be60-4a06-acb3-c85ee2e02469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:03:07.441542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc52f9-be60-4a06-acb3-c85ee2e02469 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:03:07.451392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 767/1536] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:03:09.712077 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f26913-6612-4893-a4f0-086488c9c607 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:03:09.712616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f26913-6612-4893-a4f0-086488c9c607 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:03:09.712616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f26913-6612-4893-a4f0-086488c9c607 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:03:09.714008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 11 21:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:03:09.719141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c6655-8414-49d5-88e4-866e97719ee1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:03:09.719554 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c6655-8414-49d5-88e4-866e97719ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:03:09.719701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c6655-8414-49d5-88e4-866e97719ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:03:09.738617 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9d6c6655-8414-49d5-88e4-866e97719ee1 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:03:09.739808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9d6c6655-8414-49d5-88e4-866e97719ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:03:09.748239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 11 21:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:03:10.021074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f26913-6612-4893-a4f0-086488c9c607 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:03:10.023007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b2f26913-6612-4893-a4f0-086488c9c607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:03:10.035498 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f26913-6612-4893-a4f0-086488c9c607 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:03:10.038943 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c7e04-9a7c-4a00-a724-3ab39654eb40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:03:10.039573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c7e04-9a7c-4a00-a724-3ab39654eb40 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:03:10.039854 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c7e04-9a7c-4a00-a724-3ab39654eb40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:03:10.040129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c7e04-9a7c-4a00-a724-3ab39654eb40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:03:10.049443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c7e04-9a7c-4a00-a724-3ab39654eb40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:03:10.050883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c7e04-9a7c-4a00-a724-3ab39654eb40 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:03:10.060424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 771/1539] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:41.171890 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cd407-c350-4832-bdad-037e74c684da None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.172497 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cd407-c350-4832-bdad-037e74c684da None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.172497 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cd407-c350-4832-bdad-037e74c684da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.200166 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6a4cd407-c350-4832-bdad-037e74c684da None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.201433 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6a4cd407-c350-4832-bdad-037e74c684da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.217065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 769/1540] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:41.218526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408287c-816c-4f12-b91b-a229ca37b9cb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.219425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408287c-816c-4f12-b91b-a229ca37b9cb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.219936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408287c-816c-4f12-b91b-a229ca37b9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.225674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadeb09-3da5-437a-a876-bda2a27facc7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.226008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadeb09-3da5-437a-a876-bda2a27facc7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.226244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadeb09-3da5-437a-a876-bda2a27facc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.250557 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b408287c-816c-4f12-b91b-a229ca37b9cb None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.252058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b408287c-816c-4f12-b91b-a229ca37b9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.254615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fcadeb09-3da5-437a-a876-bda2a27facc7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.255802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fcadeb09-3da5-437a-a876-bda2a27facc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.267155 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 772/1541] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:41.273701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431d241-0aa9-440a-8075-15808659bfe8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.274197 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431d241-0aa9-440a-8075-15808659bfe8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.274491 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431d241-0aa9-440a-8075-15808659bfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.275018 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 770/1542] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:04:41.277789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109713c-9802-42aa-9864-0a2680f59dae None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.278079 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109713c-9802-42aa-9864-0a2680f59dae None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.278358 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109713c-9802-42aa-9864-0a2680f59dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.307957 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4109713c-9802-42aa-9864-0a2680f59dae None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.309160 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4109713c-9802-42aa-9864-0a2680f59dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.312717 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7431d241-0aa9-440a-8075-15808659bfe8 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.313968 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7431d241-0aa9-440a-8075-15808659bfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.323778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 773/1543] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:41.325110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0810c-f610-486a-9125-83ca863aa19e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.325509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0810c-f610-486a-9125-83ca863aa19e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.327970 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0810c-f610-486a-9125-83ca863aa19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.335411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 771/1544] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:04:41.336279 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109713c-9802-42aa-9864-0a2680f59dae None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:41.353888 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fcd0810c-f610-486a-9125-83ca863aa19e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.355096 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fcd0810c-f610-486a-9125-83ca863aa19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.356391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109713c-9802-42aa-9864-0a2680f59dae None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:41.368331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c228b5c-0b3a-421b-bba7-da8571bffba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:41.369008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c228b5c-0b3a-421b-bba7-da8571bffba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.369290 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c228b5c-0b3a-421b-bba7-da8571bffba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.369589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c228b5c-0b3a-421b-bba7-da8571bffba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.370319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c228b5c-0b3a-421b-bba7-da8571bffba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:04:41.370624 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c228b5c-0b3a-421b-bba7-da8571bffba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:41.371640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: WARNING py.warnings [None req-7c228b5c-0b3a-421b-bba7-da8571bffba2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 21:04:41.371640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: warnings.warn(msg) May 11 21:04:41.371640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: May 11 21:04:41.372533 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c228b5c-0b3a-421b-bba7-da8571bffba2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:41.376870 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 774/1545] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:41.377561 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0810c-f610-486a-9125-83ca863aa19e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:41.393326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0810c-f610-486a-9125-83ca863aa19e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:41.400223 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 772/1546] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:04:41.402129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe468ffa-1cbc-4f25-8043-db184caa47e1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.402413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe468ffa-1cbc-4f25-8043-db184caa47e1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.402688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe468ffa-1cbc-4f25-8043-db184caa47e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.406106 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd3e7e-2660-4a39-a4c0-ce96a63f412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:41.406773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd3e7e-2660-4a39-a4c0-ce96a63f412e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.407052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd3e7e-2660-4a39-a4c0-ce96a63f412e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.407321 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd3e7e-2660-4a39-a4c0-ce96a63f412e admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.408043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd3e7e-2660-4a39-a4c0-ce96a63f412e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:04:41.408347 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd3e7e-2660-4a39-a4c0-ce96a63f412e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:41.411514 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd3e7e-2660-4a39-a4c0-ce96a63f412e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:41.435133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 775/1547] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:04:41.436104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd3e7e-2660-4a39-a4c0-ce96a63f412e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:41.438801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fe468ffa-1cbc-4f25-8043-db184caa47e1 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.440030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fe468ffa-1cbc-4f25-8043-db184caa47e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.451339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd3e7e-2660-4a39-a4c0-ce96a63f412e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:41.465234 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 773/1548] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:41.466053 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515cb37-be75-4bb8-bb16-5a7188bd1b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:41.466290 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe468ffa-1cbc-4f25-8043-db184caa47e1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:41.466732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515cb37-be75-4bb8-bb16-5a7188bd1b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.467018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515cb37-be75-4bb8-bb16-5a7188bd1b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.467292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515cb37-be75-4bb8-bb16-5a7188bd1b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.468016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515cb37-be75-4bb8-bb16-5a7188bd1b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:04:41.468656 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515cb37-be75-4bb8-bb16-5a7188bd1b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:41.470117 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515cb37-be75-4bb8-bb16-5a7188bd1b3b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:41.479757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe468ffa-1cbc-4f25-8043-db184caa47e1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:41.482456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 776/1549] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:04:41.483710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa825c-86ed-429a-9a91-0f3545864747 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.484038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa825c-86ed-429a-9a91-0f3545864747 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.484316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa825c-86ed-429a-9a91-0f3545864747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.485124 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf98340-7c1a-42e2-a574-e93ec4de841e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:41.486327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf98340-7c1a-42e2-a574-e93ec4de841e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.486614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf98340-7c1a-42e2-a574-e93ec4de841e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.486889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf98340-7c1a-42e2-a574-e93ec4de841e admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.487568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf98340-7c1a-42e2-a574-e93ec4de841e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:41.489472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf98340-7c1a-42e2-a574-e93ec4de841e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:41.502018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0bfa825c-86ed-429a-9a91-0f3545864747 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.503193 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0bfa825c-86ed-429a-9a91-0f3545864747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.510858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 777/1550] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:41.511589 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa825c-86ed-429a-9a91-0f3545864747 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:41.521112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa825c-86ed-429a-9a91-0f3545864747 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:41.525811 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220674b3-579a-4513-bf70-d59389a8ec12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:41.526446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220674b3-579a-4513-bf70-d59389a8ec12 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.526724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220674b3-579a-4513-bf70-d59389a8ec12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.527001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220674b3-579a-4513-bf70-d59389a8ec12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.527673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220674b3-579a-4513-bf70-d59389a8ec12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:41.528676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-220674b3-579a-4513-bf70-d59389a8ec12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 21:04:41.528676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 11 21:04:41.528676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: May 11 21:04:41.529883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220674b3-579a-4513-bf70-d59389a8ec12 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:41.579865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 774/1551] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:41.579865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576ef48-8460-4cb0-98e1-0378826d5b04 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.579865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576ef48-8460-4cb0-98e1-0378826d5b04 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.579865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576ef48-8460-4cb0-98e1-0378826d5b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.595510 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4576ef48-8460-4cb0-98e1-0378826d5b04 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.597100 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4576ef48-8460-4cb0-98e1-0378826d5b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.653328 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 775/1552] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:41.654716 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefa612-ef9c-4b47-a346-1359d6e6eb14 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.655008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefa612-ef9c-4b47-a346-1359d6e6eb14 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.655286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefa612-ef9c-4b47-a346-1359d6e6eb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.662995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 778/1553] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:41.665659 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005298a9-5619-4034-a11b-fbfd56ae32ec None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.665659 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005298a9-5619-4034-a11b-fbfd56ae32ec None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.665659 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005298a9-5619-4034-a11b-fbfd56ae32ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.678322 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6fefa612-ef9c-4b47-a346-1359d6e6eb14 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.679502 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6fefa612-ef9c-4b47-a346-1359d6e6eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.682878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-005298a9-5619-4034-a11b-fbfd56ae32ec None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.684036 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-005298a9-5619-4034-a11b-fbfd56ae32ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.736184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 776/1554] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:41.737391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41b8e-ca9f-4128-a3a5-f16d272a93be None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.737716 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41b8e-ca9f-4128-a3a5-f16d272a93be None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.737997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41b8e-ca9f-4128-a3a5-f16d272a93be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.747107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 779/1555] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:41.747981 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005298a9-5619-4034-a11b-fbfd56ae32ec None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:41.757783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005298a9-5619-4034-a11b-fbfd56ae32ec None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:41.760851 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-89e41b8e-ca9f-4128-a3a5-f16d272a93be None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.762080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-89e41b8e-ca9f-4128-a3a5-f16d272a93be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.762337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7037c5-ebf1-4de3-a4e8-43de7859a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:41.762982 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7037c5-ebf1-4de3-a4e8-43de7859a4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.763261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7037c5-ebf1-4de3-a4e8-43de7859a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.763601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7037c5-ebf1-4de3-a4e8-43de7859a4e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.764217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7037c5-ebf1-4de3-a4e8-43de7859a4e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:41.766186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7037c5-ebf1-4de3-a4e8-43de7859a4e7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:41.769866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 777/1556] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:41.771437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb408df-b3e0-4909-849f-d8471de52445 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.771732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb408df-b3e0-4909-849f-d8471de52445 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.772012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb408df-b3e0-4909-849f-d8471de52445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.789199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-aeb408df-b3e0-4909-849f-d8471de52445 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.790422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-aeb408df-b3e0-4909-849f-d8471de52445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.798726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 778/1557] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:41.799459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb408df-b3e0-4909-849f-d8471de52445 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:41.808122 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb408df-b3e0-4909-849f-d8471de52445 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:41.813208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e6128-b4fc-4976-9478-91ab9068464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:41.813868 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e6128-b4fc-4976-9478-91ab9068464f admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.814155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e6128-b4fc-4976-9478-91ab9068464f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.814430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e6128-b4fc-4976-9478-91ab9068464f admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.815095 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e6128-b4fc-4976-9478-91ab9068464f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:41.816102 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: WARNING py.warnings [None req-a90e6128-b4fc-4976-9478-91ab9068464f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 21:04:41.816102 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: warnings.warn(msg) May 11 21:04:41.816102 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: May 11 21:04:41.817303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e6128-b4fc-4976-9478-91ab9068464f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:41.864952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 780/1558] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/projects => generated 405 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:41.866266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8941c6a-e71c-4412-abe3-8f81d78cbe49 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.866558 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8941c6a-e71c-4412-abe3-8f81d78cbe49 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.866835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8941c6a-e71c-4412-abe3-8f81d78cbe49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.883995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f8941c6a-e71c-4412-abe3-8f81d78cbe49 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.885188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f8941c6a-e71c-4412-abe3-8f81d78cbe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.906919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 779/1559] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:41.906919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e6128-b4fc-4976-9478-91ab9068464f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:41.914338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e6128-b4fc-4976-9478-91ab9068464f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:41.943792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 781/1560] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:41.945192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffac0cc-7b9d-4149-901f-8cdd632d2e72 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.945618 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffac0cc-7b9d-4149-901f-8cdd632d2e72 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.945993 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffac0cc-7b9d-4149-901f-8cdd632d2e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.963968 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8ffac0cc-7b9d-4149-901f-8cdd632d2e72 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:41.965357 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8ffac0cc-7b9d-4149-901f-8cdd632d2e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:41.967940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b29bab-789d-4324-8b23-9ef655e2dfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:41.969111 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b29bab-789d-4324-8b23-9ef655e2dfd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.969394 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b29bab-789d-4324-8b23-9ef655e2dfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.969770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b29bab-789d-4324-8b23-9ef655e2dfd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.970454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b29bab-789d-4324-8b23-9ef655e2dfd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:41.972377 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b29bab-789d-4324-8b23-9ef655e2dfd9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:41.973602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 782/1561] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:41.974372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffac0cc-7b9d-4149-901f-8cdd632d2e72 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:41.983672 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffac0cc-7b9d-4149-901f-8cdd632d2e72 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:41.992135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b23490-f7c0-44ab-a885-dcabb16b1045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:41.992135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b23490-f7c0-44ab-a885-dcabb16b1045 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:41.992135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b23490-f7c0-44ab-a885-dcabb16b1045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:41.992135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b23490-f7c0-44ab-a885-dcabb16b1045 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:41.992557 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b23490-f7c0-44ab-a885-dcabb16b1045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:04:41.992557 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b23490-f7c0-44ab-a885-dcabb16b1045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:41.992740 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b23490-f7c0-44ab-a885-dcabb16b1045 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.003597 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 783/1562] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:04:42.004904 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2030ed-6de5-4397-a5f9-9e2f2c170cb9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.005187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2030ed-6de5-4397-a5f9-9e2f2c170cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.005460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2030ed-6de5-4397-a5f9-9e2f2c170cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.022274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9c2030ed-6de5-4397-a5f9-9e2f2c170cb9 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:42.023439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9c2030ed-6de5-4397-a5f9-9e2f2c170cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:42.031545 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 784/1563] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:42.032364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2030ed-6de5-4397-a5f9-9e2f2c170cb9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.041009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2030ed-6de5-4397-a5f9-9e2f2c170cb9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.045332 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06cb2b-2013-4e9e-a6eb-058deb5f114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.045966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06cb2b-2013-4e9e-a6eb-058deb5f114e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.046248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06cb2b-2013-4e9e-a6eb-058deb5f114e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.047170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06cb2b-2013-4e9e-a6eb-058deb5f114e admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.047862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06cb2b-2013-4e9e-a6eb-058deb5f114e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:04:42.048164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06cb2b-2013-4e9e-a6eb-058deb5f114e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.049742 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06cb2b-2013-4e9e-a6eb-058deb5f114e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.060633 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 785/1564] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:04:42.060992 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 780/1565] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:04:41 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:42.062136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06cb2b-2013-4e9e-a6eb-058deb5f114e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.063120 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b29bab-789d-4324-8b23-9ef655e2dfd9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.073209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b29bab-789d-4324-8b23-9ef655e2dfd9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.073381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06cb2b-2013-4e9e-a6eb-058deb5f114e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.077868 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d54f4-48c3-42f7-92c2-0536d1202875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.078031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b269e-df11-4799-b609-7a12f52d6c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.078508 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d54f4-48c3-42f7-92c2-0536d1202875 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.078674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b269e-df11-4799-b609-7a12f52d6c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.078909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d54f4-48c3-42f7-92c2-0536d1202875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.079030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b269e-df11-4799-b609-7a12f52d6c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.079125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d54f4-48c3-42f7-92c2-0536d1202875 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.079232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b269e-df11-4799-b609-7a12f52d6c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.079762 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d54f4-48c3-42f7-92c2-0536d1202875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.079936 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b269e-df11-4799-b609-7a12f52d6c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.081605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b269e-df11-4799-b609-7a12f52d6c19 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.081727 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d54f4-48c3-42f7-92c2-0536d1202875 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.093078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 781/1566] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:42.094416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b269e-df11-4799-b609-7a12f52d6c19 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.103874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b269e-df11-4799-b609-7a12f52d6c19 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.108431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020da8e-fcff-4398-9982-063a3f25d7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.109761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020da8e-fcff-4398-9982-063a3f25d7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.110046 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020da8e-fcff-4398-9982-063a3f25d7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.110320 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020da8e-fcff-4398-9982-063a3f25d7d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.111032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020da8e-fcff-4398-9982-063a3f25d7d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:04:42.111339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020da8e-fcff-4398-9982-063a3f25d7d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.112919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020da8e-fcff-4398-9982-063a3f25d7d4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.123996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 782/1567] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:04:42.124788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020da8e-fcff-4398-9982-063a3f25d7d4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.133668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020da8e-fcff-4398-9982-063a3f25d7d4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.138129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eee082-7a4e-4da2-bf59-4dc6610c3c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.138738 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eee082-7a4e-4da2-bf59-4dc6610c3c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.139023 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eee082-7a4e-4da2-bf59-4dc6610c3c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.139304 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eee082-7a4e-4da2-bf59-4dc6610c3c3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.140018 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eee082-7a4e-4da2-bf59-4dc6610c3c3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:04:42.140330 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eee082-7a4e-4da2-bf59-4dc6610c3c3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.141907 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eee082-7a4e-4da2-bf59-4dc6610c3c3d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.153343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 783/1568] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:04:42.154105 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eee082-7a4e-4da2-bf59-4dc6610c3c3d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.163604 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eee082-7a4e-4da2-bf59-4dc6610c3c3d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.168016 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074329e2-b5d1-40a2-abd7-7e030fd896fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.168611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074329e2-b5d1-40a2-abd7-7e030fd896fb admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.170251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074329e2-b5d1-40a2-abd7-7e030fd896fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.170251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074329e2-b5d1-40a2-abd7-7e030fd896fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.170251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074329e2-b5d1-40a2-abd7-7e030fd896fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.172327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074329e2-b5d1-40a2-abd7-7e030fd896fb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.200323 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 786/1569] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:04:42 2022] POST /identity/v3/users => generated 303 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:42.201059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d54f4-48c3-42f7-92c2-0536d1202875 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.210205 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d54f4-48c3-42f7-92c2-0536d1202875 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.214922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f92d05-4151-4dd0-898c-55b2cfab4d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.215536 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f92d05-4151-4dd0-898c-55b2cfab4d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.215815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f92d05-4151-4dd0-898c-55b2cfab4d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.216130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f92d05-4151-4dd0-898c-55b2cfab4d73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.216834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f92d05-4151-4dd0-898c-55b2cfab4d73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:04:42.217141 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f92d05-4151-4dd0-898c-55b2cfab4d73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.219257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f92d05-4151-4dd0-898c-55b2cfab4d73 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.232218 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 787/1570] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:04:42.232971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f92d05-4151-4dd0-898c-55b2cfab4d73 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.242623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f92d05-4151-4dd0-898c-55b2cfab4d73 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.247144 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ff2d5-a461-47c6-91f4-57bfb4a6e4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.247755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ff2d5-a461-47c6-91f4-57bfb4a6e4bf admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.248046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ff2d5-a461-47c6-91f4-57bfb4a6e4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.248307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ff2d5-a461-47c6-91f4-57bfb4a6e4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.249000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ff2d5-a461-47c6-91f4-57bfb4a6e4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.250684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ff2d5-a461-47c6-91f4-57bfb4a6e4bf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.260086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 788/1571] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:42.264215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ff2d5-a461-47c6-91f4-57bfb4a6e4bf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.270456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ff2d5-a461-47c6-91f4-57bfb4a6e4bf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.275080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ceae7-7715-4b7c-81e2-39d94e262a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.275659 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ceae7-7715-4b7c-81e2-39d94e262a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.275930 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ceae7-7715-4b7c-81e2-39d94e262a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.276209 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ceae7-7715-4b7c-81e2-39d94e262a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.276850 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ceae7-7715-4b7c-81e2-39d94e262a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.278736 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ceae7-7715-4b7c-81e2-39d94e262a3e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.293205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 784/1572] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:04:42 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:42.297513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074329e2-b5d1-40a2-abd7-7e030fd896fb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.350731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074329e2-b5d1-40a2-abd7-7e030fd896fb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.355191 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ca743-8a76-4577-a2d3-8fa7b8f9c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.355839 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca743-8a76-4577-a2d3-8fa7b8f9c40e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.356146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca743-8a76-4577-a2d3-8fa7b8f9c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.356425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca743-8a76-4577-a2d3-8fa7b8f9c40e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.357136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ca743-8a76-4577-a2d3-8fa7b8f9c40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.358793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ca743-8a76-4577-a2d3-8fa7b8f9c40e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.368466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 785/1573] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:42.369212 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ca743-8a76-4577-a2d3-8fa7b8f9c40e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.378334 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ca743-8a76-4577-a2d3-8fa7b8f9c40e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.382860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26be6aa-24a9-4f0b-abee-b33420ca9f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.383466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26be6aa-24a9-4f0b-abee-b33420ca9f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.383752 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26be6aa-24a9-4f0b-abee-b33420ca9f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.384031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26be6aa-24a9-4f0b-abee-b33420ca9f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.384712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26be6aa-24a9-4f0b-abee-b33420ca9f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.386634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26be6aa-24a9-4f0b-abee-b33420ca9f5a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.407831 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 789/1574] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:04:42 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:42.408637 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ceae7-7715-4b7c-81e2-39d94e262a3e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.466565 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ceae7-7715-4b7c-81e2-39d94e262a3e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.471644 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ba56d-5aab-4502-b893-d89b9612e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.472315 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba56d-5aab-4502-b893-d89b9612e51a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.472630 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba56d-5aab-4502-b893-d89b9612e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.472902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba56d-5aab-4502-b893-d89b9612e51a admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.473609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ba56d-5aab-4502-b893-d89b9612e51a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.475504 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ba56d-5aab-4502-b893-d89b9612e51a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.481331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 786/1575] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:04:42 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:42.482017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26be6aa-24a9-4f0b-abee-b33420ca9f5a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.540009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26be6aa-24a9-4f0b-abee-b33420ca9f5a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.544507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c8ce9-27bb-48f8-8dce-49f4c2b90db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.545162 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c8ce9-27bb-48f8-8dce-49f4c2b90db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.545447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c8ce9-27bb-48f8-8dce-49f4c2b90db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.545753 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c8ce9-27bb-48f8-8dce-49f4c2b90db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.546470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c8ce9-27bb-48f8-8dce-49f4c2b90db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.548062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c8ce9-27bb-48f8-8dce-49f4c2b90db9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.557583 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 787/1576] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:42.558344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c8ce9-27bb-48f8-8dce-49f4c2b90db9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.570338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c8ce9-27bb-48f8-8dce-49f4c2b90db9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.571749 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 790/1577] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:04:42 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:42.571749 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ba56d-5aab-4502-b893-d89b9612e51a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.626777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5e63f-3dc1-4f78-b420-7885fda2badc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.627444 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5e63f-3dc1-4f78-b420-7885fda2badc admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.627727 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5e63f-3dc1-4f78-b420-7885fda2badc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.628007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5e63f-3dc1-4f78-b420-7885fda2badc admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.628693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5e63f-3dc1-4f78-b420-7885fda2badc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.630646 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5e63f-3dc1-4f78-b420-7885fda2badc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.631706 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ba56d-5aab-4502-b893-d89b9612e51a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.636222 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a332c2-4ce5-41c6-9200-c0f196a61977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.636879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a332c2-4ce5-41c6-9200-c0f196a61977 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.637166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a332c2-4ce5-41c6-9200-c0f196a61977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.637444 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a332c2-4ce5-41c6-9200-c0f196a61977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.638207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a332c2-4ce5-41c6-9200-c0f196a61977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.639789 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a332c2-4ce5-41c6-9200-c0f196a61977 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.650428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 791/1578] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:42.651211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a332c2-4ce5-41c6-9200-c0f196a61977 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.660301 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a332c2-4ce5-41c6-9200-c0f196a61977 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.664777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb1339-9a26-4b9e-94ed-9a8dad4caf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.665394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb1339-9a26-4b9e-94ed-9a8dad4caf49 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.665713 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb1339-9a26-4b9e-94ed-9a8dad4caf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.666001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb1339-9a26-4b9e-94ed-9a8dad4caf49 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.666662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb1339-9a26-4b9e-94ed-9a8dad4caf49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.668536 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb1339-9a26-4b9e-94ed-9a8dad4caf49 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.713856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 788/1579] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:04:42 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:42.713856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5e63f-3dc1-4f78-b420-7885fda2badc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.768130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5e63f-3dc1-4f78-b420-7885fda2badc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.772892 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c498c-7c70-4b80-8d78-9a767cb8f218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.773793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c498c-7c70-4b80-8d78-9a767cb8f218 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.774080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c498c-7c70-4b80-8d78-9a767cb8f218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.774355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c498c-7c70-4b80-8d78-9a767cb8f218 admin admin] PATH_INFO: `/v3/projects/ba603b859ac34a119a85b6eaef862098/users/70ae8e6e3ec8401cbc7be32478ec7a89/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.787810 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c498c-7c70-4b80-8d78-9a767cb8f218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba603b859ac34a119a85b6eaef862098, user_id=70ae8e6e3ec8401cbc7be32478ec7a89, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.790567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c498c-7c70-4b80-8d78-9a767cb8f218 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.794274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 792/1580] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:04:42 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:42.795100 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb1339-9a26-4b9e-94ed-9a8dad4caf49 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.805060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb1339-9a26-4b9e-94ed-9a8dad4caf49 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.809600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e84ca-1fc8-4478-9734-92796f8f3e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.810233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e84ca-1fc8-4478-9734-92796f8f3e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.810521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e84ca-1fc8-4478-9734-92796f8f3e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.810802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e84ca-1fc8-4478-9734-92796f8f3e14 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.811505 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e84ca-1fc8-4478-9734-92796f8f3e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.814089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e84ca-1fc8-4478-9734-92796f8f3e14 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.860889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 789/1581] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:42 2022] PUT /identity/v3/projects/ba603b859ac34a119a85b6eaef862098/users/70ae8e6e3ec8401cbc7be32478ec7a89/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:42.861735 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c498c-7c70-4b80-8d78-9a767cb8f218 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.898868 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 793/1582] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:04:42 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:42.899711 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e84ca-1fc8-4478-9734-92796f8f3e14 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.908915 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e84ca-1fc8-4478-9734-92796f8f3e14 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.923141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c498c-7c70-4b80-8d78-9a767cb8f218 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.927731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf439a-534d-4177-aca5-a86f48dbf6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.928399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf439a-534d-4177-aca5-a86f48dbf6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.928684 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf439a-534d-4177-aca5-a86f48dbf6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.928963 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf439a-534d-4177-aca5-a86f48dbf6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.929678 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf439a-534d-4177-aca5-a86f48dbf6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.931620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf439a-534d-4177-aca5-a86f48dbf6b7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.962247 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152b455-00aa-4deb-b6da-860c9cb3901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.962918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b455-00aa-4deb-b6da-860c9cb3901d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.963205 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b455-00aa-4deb-b6da-860c9cb3901d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.963481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b455-00aa-4deb-b6da-860c9cb3901d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.964233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152b455-00aa-4deb-b6da-860c9cb3901d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.965882 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152b455-00aa-4deb-b6da-860c9cb3901d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:42.975469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 794/1583] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:42.976256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152b455-00aa-4deb-b6da-860c9cb3901d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:42.985223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152b455-00aa-4deb-b6da-860c9cb3901d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:42.992703 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217dd83-d645-413d-863b-8df453ec5a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:42.992703 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217dd83-d645-413d-863b-8df453ec5a4c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:42.992703 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217dd83-d645-413d-863b-8df453ec5a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:42.992703 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217dd83-d645-413d-863b-8df453ec5a4c admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:42.993110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217dd83-d645-413d-863b-8df453ec5a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:42.993401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217dd83-d645-413d-863b-8df453ec5a4c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.055172 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 790/1584] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:04:42 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:43.055172 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf439a-534d-4177-aca5-a86f48dbf6b7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.063068 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf439a-534d-4177-aca5-a86f48dbf6b7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.067541 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a136fa8-0981-4555-8d84-87da3b3ba075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.068398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a136fa8-0981-4555-8d84-87da3b3ba075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.068684 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a136fa8-0981-4555-8d84-87da3b3ba075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.068964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a136fa8-0981-4555-8d84-87da3b3ba075 admin admin] PATH_INFO: `/v3/projects/513637db58d34fe198b2de93d2cbbeaa/users/f9968edcee104432ade2014e39683bb5/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.080392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 795/1585] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:04:42 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:43.081229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217dd83-d645-413d-863b-8df453ec5a4c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.084626 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a136fa8-0981-4555-8d84-87da3b3ba075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513637db58d34fe198b2de93d2cbbeaa, user_id=f9968edcee104432ade2014e39683bb5, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.086732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a136fa8-0981-4555-8d84-87da3b3ba075 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.090622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217dd83-d645-413d-863b-8df453ec5a4c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.095177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbffc6-77e2-48d6-b1da-2dcf30715d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.095826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbffc6-77e2-48d6-b1da-2dcf30715d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.096110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbffc6-77e2-48d6-b1da-2dcf30715d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.096385 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbffc6-77e2-48d6-b1da-2dcf30715d96 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.097054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbffc6-77e2-48d6-b1da-2dcf30715d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.098987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbffc6-77e2-48d6-b1da-2dcf30715d96 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.159761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 791/1586] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:43 2022] PUT /identity/v3/projects/513637db58d34fe198b2de93d2cbbeaa/users/f9968edcee104432ade2014e39683bb5/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:43.160581 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a136fa8-0981-4555-8d84-87da3b3ba075 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.189456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 796/1587] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:04:43 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:43.191038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfb102-073f-40d9-8d30-e6cf7320c54f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.191335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfb102-073f-40d9-8d30-e6cf7320c54f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.191613 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfb102-073f-40d9-8d30-e6cf7320c54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.208826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-63dfb102-073f-40d9-8d30-e6cf7320c54f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:43.210038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-63dfb102-073f-40d9-8d30-e6cf7320c54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:43.219622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a136fa8-0981-4555-8d84-87da3b3ba075 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.224335 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44eef3-e03a-46c0-be4b-eb87f87f0a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.224998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44eef3-e03a-46c0-be4b-eb87f87f0a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.225284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44eef3-e03a-46c0-be4b-eb87f87f0a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.225592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44eef3-e03a-46c0-be4b-eb87f87f0a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.226319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44eef3-e03a-46c0-be4b-eb87f87f0a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.227943 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44eef3-e03a-46c0-be4b-eb87f87f0a69 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.237937 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 792/1588] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:43.238793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44eef3-e03a-46c0-be4b-eb87f87f0a69 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.247949 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44eef3-e03a-46c0-be4b-eb87f87f0a69 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.253085 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a920c-c70b-432d-98b8-d98c6a4cde6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.253748 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a920c-c70b-432d-98b8-d98c6a4cde6d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.254036 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a920c-c70b-432d-98b8-d98c6a4cde6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.254306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a920c-c70b-432d-98b8-d98c6a4cde6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.255012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a920c-c70b-432d-98b8-d98c6a4cde6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.256585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a920c-c70b-432d-98b8-d98c6a4cde6d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.266095 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 793/1589] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:43.266913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a920c-c70b-432d-98b8-d98c6a4cde6d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.270516 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 797/1590] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:43.271629 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfb102-073f-40d9-8d30-e6cf7320c54f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.277410 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a920c-c70b-432d-98b8-d98c6a4cde6d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.280506 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfb102-073f-40d9-8d30-e6cf7320c54f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.282038 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a54f7e-4108-4e8b-b5e9-631d0ef28446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.282912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a54f7e-4108-4e8b-b5e9-631d0ef28446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.283203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a54f7e-4108-4e8b-b5e9-631d0ef28446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.283515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a54f7e-4108-4e8b-b5e9-631d0ef28446 admin admin] PATH_INFO: `/v3/projects/869f6f7fd5ac4d6d98a6c966e0d0204c/users/c1a3f4517575466b86eeeae61b87a469/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.287827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037101f8-bfec-4a59-92e5-8cfabb1cdd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.288481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037101f8-bfec-4a59-92e5-8cfabb1cdd60 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.288763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037101f8-bfec-4a59-92e5-8cfabb1cdd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.289037 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037101f8-bfec-4a59-92e5-8cfabb1cdd60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.289799 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037101f8-bfec-4a59-92e5-8cfabb1cdd60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.291398 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037101f8-bfec-4a59-92e5-8cfabb1cdd60 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.299817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a54f7e-4108-4e8b-b5e9-631d0ef28446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869f6f7fd5ac4d6d98a6c966e0d0204c, user_id=c1a3f4517575466b86eeeae61b87a469, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.302120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 798/1591] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:43.302512 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a54f7e-4108-4e8b-b5e9-631d0ef28446 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.303009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037101f8-bfec-4a59-92e5-8cfabb1cdd60 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.316412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037101f8-bfec-4a59-92e5-8cfabb1cdd60 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.318786 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d06a3a-0919-43e1-95f8-b31f16b52142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.319412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d06a3a-0919-43e1-95f8-b31f16b52142 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.319694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d06a3a-0919-43e1-95f8-b31f16b52142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.319971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d06a3a-0919-43e1-95f8-b31f16b52142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.320671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d06a3a-0919-43e1-95f8-b31f16b52142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.322297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d06a3a-0919-43e1-95f8-b31f16b52142 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.331618 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 799/1592] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:43.332867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdcbad-eff6-4373-afd5-f323bc8b690a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.333160 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdcbad-eff6-4373-afd5-f323bc8b690a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.333438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdcbad-eff6-4373-afd5-f323bc8b690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.349318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-68fdcbad-eff6-4373-afd5-f323bc8b690a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:43.350509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-68fdcbad-eff6-4373-afd5-f323bc8b690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:43.357803 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 800/1593] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:43.358663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdcbad-eff6-4373-afd5-f323bc8b690a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.368176 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdcbad-eff6-4373-afd5-f323bc8b690a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.369983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 794/1594] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:43 2022] PUT /identity/v3/projects/869f6f7fd5ac4d6d98a6c966e0d0204c/users/c1a3f4517575466b86eeeae61b87a469/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:43.370854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a54f7e-4108-4e8b-b5e9-631d0ef28446 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.428081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992c2a7-1c2d-4e48-a96e-c06539c5f16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.428750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992c2a7-1c2d-4e48-a96e-c06539c5f16f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.429038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992c2a7-1c2d-4e48-a96e-c06539c5f16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.429316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992c2a7-1c2d-4e48-a96e-c06539c5f16f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.430075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992c2a7-1c2d-4e48-a96e-c06539c5f16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.431691 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992c2a7-1c2d-4e48-a96e-c06539c5f16f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.432193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a54f7e-4108-4e8b-b5e9-631d0ef28446 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.436711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b6298-4a65-4ad0-9683-0135ab1c95d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.437398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b6298-4a65-4ad0-9683-0135ab1c95d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.437714 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b6298-4a65-4ad0-9683-0135ab1c95d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.437996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b6298-4a65-4ad0-9683-0135ab1c95d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.438748 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b6298-4a65-4ad0-9683-0135ab1c95d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.440338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b6298-4a65-4ad0-9683-0135ab1c95d9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.444739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 801/1595] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:43.444739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992c2a7-1c2d-4e48-a96e-c06539c5f16f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.450219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 795/1596] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:43.451034 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b6298-4a65-4ad0-9683-0135ab1c95d9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.452664 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992c2a7-1c2d-4e48-a96e-c06539c5f16f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.454823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d10b6298-4a65-4ad0-9683-0135ab1c95d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:43.457435 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a5e5d-4446-4f36-9df4-e7c8b284e0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.458127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a5e5d-4446-4f36-9df4-e7c8b284e0ff admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.458412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a5e5d-4446-4f36-9df4-e7c8b284e0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.458687 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a5e5d-4446-4f36-9df4-e7c8b284e0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.459406 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a5e5d-4446-4f36-9df4-e7c8b284e0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.461008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a5e5d-4446-4f36-9df4-e7c8b284e0ff admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.471450 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 802/1597] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:43.477078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a5e5d-4446-4f36-9df4-e7c8b284e0ff admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.482337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a5e5d-4446-4f36-9df4-e7c8b284e0ff admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.487533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c93a1-c922-43e5-9d0a-2a4c39e12c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.488165 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c93a1-c922-43e5-9d0a-2a4c39e12c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.488448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c93a1-c922-43e5-9d0a-2a4c39e12c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.488723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c93a1-c922-43e5-9d0a-2a4c39e12c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.489431 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c93a1-c922-43e5-9d0a-2a4c39e12c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.491039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c93a1-c922-43e5-9d0a-2a4c39e12c1f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.502295 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 803/1598] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:43.503273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c93a1-c922-43e5-9d0a-2a4c39e12c1f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.509406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b6298-4a65-4ad0-9683-0135ab1c95d9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.512418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c93a1-c922-43e5-9d0a-2a4c39e12c1f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.513061 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63020327-13ac-4a2a-a32c-cdea83fa9142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.513738 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63020327-13ac-4a2a-a32c-cdea83fa9142 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.514025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63020327-13ac-4a2a-a32c-cdea83fa9142 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.514302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63020327-13ac-4a2a-a32c-cdea83fa9142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.517157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b667f2d-1e76-4cd8-beda-a521e2d17c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.518049 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b667f2d-1e76-4cd8-beda-a521e2d17c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.523045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b667f2d-1e76-4cd8-beda-a521e2d17c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.523045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b667f2d-1e76-4cd8-beda-a521e2d17c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.523045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b667f2d-1e76-4cd8-beda-a521e2d17c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.523045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b667f2d-1e76-4cd8-beda-a521e2d17c8f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.524188 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63020327-13ac-4a2a-a32c-cdea83fa9142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.525655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63020327-13ac-4a2a-a32c-cdea83fa9142 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.531847 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 804/1599] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:43.533788 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b667f2d-1e76-4cd8-beda-a521e2d17c8f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.536519 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 796/1600] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:43.537945 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a794dce-6827-4788-a04b-8cc2489f2bff None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.538308 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a794dce-6827-4788-a04b-8cc2489f2bff None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.538651 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a794dce-6827-4788-a04b-8cc2489f2bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.543359 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b667f2d-1e76-4cd8-beda-a521e2d17c8f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.550873 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af86ca1-3031-4247-9f73-db3a5e9502fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.551755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af86ca1-3031-4247-9f73-db3a5e9502fe service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.552197 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af86ca1-3031-4247-9f73-db3a5e9502fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.552568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af86ca1-3031-4247-9f73-db3a5e9502fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.556507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9a794dce-6827-4788-a04b-8cc2489f2bff None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:43.557725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9a794dce-6827-4788-a04b-8cc2489f2bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:43.562385 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af86ca1-3031-4247-9f73-db3a5e9502fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.564061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af86ca1-3031-4247-9f73-db3a5e9502fe service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.565296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 797/1601] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:43.566193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a794dce-6827-4788-a04b-8cc2489f2bff None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.574145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 805/1602] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:43.574860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af86ca1-3031-4247-9f73-db3a5e9502fe service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.581916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a794dce-6827-4788-a04b-8cc2489f2bff None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.584391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af86ca1-3031-4247-9f73-db3a5e9502fe service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.588079 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f394e7-ba1e-429f-a9cd-87d6903b258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.588871 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f394e7-ba1e-429f-a9cd-87d6903b258e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.589197 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f394e7-ba1e-429f-a9cd-87d6903b258e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.589565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f394e7-ba1e-429f-a9cd-87d6903b258e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.589805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d261c-e1c0-431b-a320-939e3bc4c926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.590382 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f394e7-ba1e-429f-a9cd-87d6903b258e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.590668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d261c-e1c0-431b-a320-939e3bc4c926 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.590947 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d261c-e1c0-431b-a320-939e3bc4c926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.591217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d261c-e1c0-431b-a320-939e3bc4c926 admin admin] PATH_INFO: `/v3/projects/54d75c229dc14e59b53a1ec63a0f00f8/users/d7666a6299cc4c44ac7495ed00f137dd/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.591909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f394e7-ba1e-429f-a9cd-87d6903b258e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.604138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 798/1603] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:43.604138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f394e7-ba1e-429f-a9cd-87d6903b258e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.614932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d261c-e1c0-431b-a320-939e3bc4c926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d75c229dc14e59b53a1ec63a0f00f8, user_id=d7666a6299cc4c44ac7495ed00f137dd, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.614932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-6c6d261c-e1c0-431b-a320-939e3bc4c926 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 21:04:43.614932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 11 21:04:43.614932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: May 11 21:04:43.614932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d261c-e1c0-431b-a320-939e3bc4c926 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.615374 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f394e7-ba1e-429f-a9cd-87d6903b258e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.620256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac408a-96a8-4499-ac89-f7b7798440c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.621168 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac408a-96a8-4499-ac89-f7b7798440c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.621460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac408a-96a8-4499-ac89-f7b7798440c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.621767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac408a-96a8-4499-ac89-f7b7798440c0 admin admin] PATH_INFO: `/v3/projects/145f00ba10e646c3a31d2f8ced65c5fa/users/f1516fa442aa44b788482522e74adb3c/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.635496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac408a-96a8-4499-ac89-f7b7798440c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=145f00ba10e646c3a31d2f8ced65c5fa, user_id=f1516fa442aa44b788482522e74adb3c, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.638206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac408a-96a8-4499-ac89-f7b7798440c0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.795577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 799/1604] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:43 2022] PUT /identity/v3/projects/145f00ba10e646c3a31d2f8ced65c5fa/users/f1516fa442aa44b788482522e74adb3c/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:43.800867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 806/1605] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:43 2022] PUT /identity/v3/projects/54d75c229dc14e59b53a1ec63a0f00f8/users/d7666a6299cc4c44ac7495ed00f137dd/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:43.800998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac408a-96a8-4499-ac89-f7b7798440c0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.801081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d261c-e1c0-431b-a320-939e3bc4c926 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:43.876959 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac408a-96a8-4499-ac89-f7b7798440c0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.881720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d261c-e1c0-431b-a320-939e3bc4c926 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:43.882000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075e77a-5701-4678-9fad-322089addaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.882899 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075e77a-5701-4678-9fad-322089addaf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.883185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075e77a-5701-4678-9fad-322089addaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.883435 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075e77a-5701-4678-9fad-322089addaf0 admin admin] PATH_INFO: `/v3/projects/3f88ec88dc464807b966bc9fe0f17e56/users/d3fefcc4859a4b2ebcb733e54f98e98a/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.888497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b84bd-73ce-449c-aad4-86c425e57057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:43.889657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b84bd-73ce-449c-aad4-86c425e57057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:43.896594 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b84bd-73ce-449c-aad4-86c425e57057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:43.896594 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b84bd-73ce-449c-aad4-86c425e57057 admin admin] PATH_INFO: `/v3/projects/7e2b1fbf2b2948a1a108a660353e1dc0/users/cd22e4760d2344ad95e151f65bef15b5/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:43.903354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075e77a-5701-4678-9fad-322089addaf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f88ec88dc464807b966bc9fe0f17e56, user_id=d3fefcc4859a4b2ebcb733e54f98e98a, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.906693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0075e77a-5701-4678-9fad-322089addaf0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:43.909291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b84bd-73ce-449c-aad4-86c425e57057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2b1fbf2b2948a1a108a660353e1dc0, user_id=cd22e4760d2344ad95e151f65bef15b5, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:43.912036 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b84bd-73ce-449c-aad4-86c425e57057 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:44.011992 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 800/1606] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:43 2022] PUT /identity/v3/projects/3f88ec88dc464807b966bc9fe0f17e56/users/d3fefcc4859a4b2ebcb733e54f98e98a/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:44.011992 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075e77a-5701-4678-9fad-322089addaf0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:44.024095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 807/1607] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:43 2022] PUT /identity/v3/projects/7e2b1fbf2b2948a1a108a660353e1dc0/users/cd22e4760d2344ad95e151f65bef15b5/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:44.024886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b84bd-73ce-449c-aad4-86c425e57057 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:44.070611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0075e77a-5701-4678-9fad-322089addaf0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:44.100418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b84bd-73ce-449c-aad4-86c425e57057 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:44.105470 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11561c0e-51b4-4d4c-8a0b-5d004a46b025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:44.106498 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11561c0e-51b4-4d4c-8a0b-5d004a46b025 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:44.106878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11561c0e-51b4-4d4c-8a0b-5d004a46b025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:44.107249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11561c0e-51b4-4d4c-8a0b-5d004a46b025 admin admin] PATH_INFO: `/v3/projects/ad1ed05b84e545989b4753dab7bd4b3f/users/baed8aff24b64c788f40e6d7dd1f99c3/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:44.122957 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad1b82-da9e-479e-be99-d4492a2072e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:44.123838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1b82-da9e-479e-be99-d4492a2072e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:44.123964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1b82-da9e-479e-be99-d4492a2072e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:44.124147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11561c0e-51b4-4d4c-8a0b-5d004a46b025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1ed05b84e545989b4753dab7bd4b3f, user_id=baed8aff24b64c788f40e6d7dd1f99c3, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:44.124294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1b82-da9e-479e-be99-d4492a2072e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:44.127501 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11561c0e-51b4-4d4c-8a0b-5d004a46b025 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:44.134352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad1b82-da9e-479e-be99-d4492a2072e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:44.135917 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad1b82-da9e-479e-be99-d4492a2072e0 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:44.146746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 801/1608] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:44.148075 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c29cf-5475-45af-a69e-1fc416828588 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:44.148374 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c29cf-5475-45af-a69e-1fc416828588 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:44.148651 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c29cf-5475-45af-a69e-1fc416828588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:44.166384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b60c29cf-5475-45af-a69e-1fc416828588 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:44.168221 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b60c29cf-5475-45af-a69e-1fc416828588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:44.176699 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 802/1609] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:44.178212 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cc389-2cec-4a1d-92cf-c003592ed04e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:44.178673 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cc389-2cec-4a1d-92cf-c003592ed04e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:44.179022 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cc389-2cec-4a1d-92cf-c003592ed04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:44.193206 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 808/1610] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:44 2022] PUT /identity/v3/projects/ad1ed05b84e545989b4753dab7bd4b3f/users/baed8aff24b64c788f40e6d7dd1f99c3/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:44.194926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a020537-8d0f-45fb-a09d-1d1bd7a4c731 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:44.195275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a020537-8d0f-45fb-a09d-1d1bd7a4c731 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:44.195487 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a020537-8d0f-45fb-a09d-1d1bd7a4c731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:44.209292 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e04cc389-2cec-4a1d-92cf-c003592ed04e None None] MFA Rules not processed for user `f1516fa442aa44b788482522e74adb3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:44.210826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e04cc389-2cec-4a1d-92cf-c003592ed04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:44.225441 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7a020537-8d0f-45fb-a09d-1d1bd7a4c731 None None] MFA Rules not processed for user `d3fefcc4859a4b2ebcb733e54f98e98a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:44.226159 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7a020537-8d0f-45fb-a09d-1d1bd7a4c731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:44.282753 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 803/1611] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:44.287273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177f6f2-2a3f-4630-9290-a1b9fe50e9c2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:44.287273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177f6f2-2a3f-4630-9290-a1b9fe50e9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:44.287273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177f6f2-2a3f-4630-9290-a1b9fe50e9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:44.316300 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f177f6f2-2a3f-4630-9290-a1b9fe50e9c2 None None] MFA Rules not processed for user `cd22e4760d2344ad95e151f65bef15b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:44.322862 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f177f6f2-2a3f-4630-9290-a1b9fe50e9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:44.335847 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 809/1612] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:44.336941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a020537-8d0f-45fb-a09d-1d1bd7a4c731 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:44.400861 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a020537-8d0f-45fb-a09d-1d1bd7a4c731 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:44.404694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1795b48-a9e4-4abf-b02f-aa747d56d4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:44.405344 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1795b48-a9e4-4abf-b02f-aa747d56d4bf service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:44.405661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1795b48-a9e4-4abf-b02f-aa747d56d4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:44.406124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1795b48-a9e4-4abf-b02f-aa747d56d4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:44.417755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 804/1613] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:44.419063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d2761-de78-47d0-8fed-80f8583b36f4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:44.419359 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d2761-de78-47d0-8fed-80f8583b36f4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:44.419640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d2761-de78-47d0-8fed-80f8583b36f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:44.439070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-048d2761-de78-47d0-8fed-80f8583b36f4 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:44.440339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-048d2761-de78-47d0-8fed-80f8583b36f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:44.477901 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1795b48-a9e4-4abf-b02f-aa747d56d4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:44.479602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1795b48-a9e4-4abf-b02f-aa747d56d4bf service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:44.492392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 810/1614] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:44.493600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1795b48-a9e4-4abf-b02f-aa747d56d4bf service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:44.515062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 805/1615] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:44.517127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b78a3-2683-4cfe-9320-dd3acf62b3e6 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:44.517989 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b78a3-2683-4cfe-9320-dd3acf62b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:44.518383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b78a3-2683-4cfe-9320-dd3acf62b3e6 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:44.520576 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 806/1616] 10.222.0.35 () {54 vars in 961 bytes} [Wed May 11 21:04:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:04:44.521973 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b78a3-2683-4cfe-9320-dd3acf62b3e6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:44.540620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b78a3-2683-4cfe-9320-dd3acf62b3e6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:44.548740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aebd2-6244-4c16-a55b-3c8f96c3d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:44.550170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aebd2-6244-4c16-a55b-3c8f96c3d2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:44.550566 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aebd2-6244-4c16-a55b-3c8f96c3d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:44.550950 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aebd2-6244-4c16-a55b-3c8f96c3d2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:44.552114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aebd2-6244-4c16-a55b-3c8f96c3d2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:44.556339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aebd2-6244-4c16-a55b-3c8f96c3d2e4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:44.567647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1795b48-a9e4-4abf-b02f-aa747d56d4bf service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:44.572748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db98e0-dadd-4841-9ef6-303f252eaf61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:44.573876 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db98e0-dadd-4841-9ef6-303f252eaf61 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:44.574168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db98e0-dadd-4841-9ef6-303f252eaf61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:44.574624 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db98e0-dadd-4841-9ef6-303f252eaf61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:44.585032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db98e0-dadd-4841-9ef6-303f252eaf61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:44.586529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db98e0-dadd-4841-9ef6-303f252eaf61 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:44.596091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 811/1617] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:44.597369 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e6190-5498-4357-a0f0-7b4772552292 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:44.597696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e6190-5498-4357-a0f0-7b4772552292 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:44.598104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e6190-5498-4357-a0f0-7b4772552292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:44.618556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c36e6190-5498-4357-a0f0-7b4772552292 None None] MFA Rules not processed for user `f400b94d3fbc40bdace4860fe83a0891`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:44.619859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c36e6190-5498-4357-a0f0-7b4772552292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:44.705583 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 807/1618] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:04:44 2022] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:44.707586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 812/1619] 10.222.0.35 () {58 vars in 1058 bytes} [Wed May 11 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:44.709500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aebd2-6244-4c16-a55b-3c8f96c3d2e4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:44.710168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e6190-5498-4357-a0f0-7b4772552292 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:44.725087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e6190-5498-4357-a0f0-7b4772552292 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:44.816700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aebd2-6244-4c16-a55b-3c8f96c3d2e4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:44.827532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8f934-4f48-453d-af20-7cecf6536444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:44.828911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8f934-4f48-453d-af20-7cecf6536444 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:44.828911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8f934-4f48-453d-af20-7cecf6536444 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:44.829126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8f934-4f48-453d-af20-7cecf6536444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:44.834685 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd00fa-8efa-4730-ab2b-bf4d094f8b10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:44.835366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd00fa-8efa-4730-ab2b-bf4d094f8b10 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:44.835703 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd00fa-8efa-4730-ab2b-bf4d094f8b10 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:44.835994 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd00fa-8efa-4730-ab2b-bf4d094f8b10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:44.964064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd00fa-8efa-4730-ab2b-bf4d094f8b10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:44.972290 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd00fa-8efa-4730-ab2b-bf4d094f8b10 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:44.975811 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8f934-4f48-453d-af20-7cecf6536444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:44.977688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8f934-4f48-453d-af20-7cecf6536444 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:44.992639 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 808/1620] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:44.993579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8f934-4f48-453d-af20-7cecf6536444 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:44.997208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 813/1621] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:45.005426 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8f934-4f48-453d-af20-7cecf6536444 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:45.011662 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270a10f-4d72-4997-b7bb-b1c7475fb38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:45.012811 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270a10f-4d72-4997-b7bb-b1c7475fb38d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:45.013088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270a10f-4d72-4997-b7bb-b1c7475fb38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:45.013463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4270a10f-4d72-4997-b7bb-b1c7475fb38d admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:45.015571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270a10f-4d72-4997-b7bb-b1c7475fb38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:45.016894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4270a10f-4d72-4997-b7bb-b1c7475fb38d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:45.183361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 809/1622] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:04:44 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:45.192370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd00fa-8efa-4730-ab2b-bf4d094f8b10 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:45.197434 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd00fa-8efa-4730-ab2b-bf4d094f8b10 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:45.209706 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047963a-bafa-43bf-9b62-1d22470f4b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:45.212732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047963a-bafa-43bf-9b62-1d22470f4b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:45.213096 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047963a-bafa-43bf-9b62-1d22470f4b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:45.213472 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047963a-bafa-43bf-9b62-1d22470f4b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:45.214366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047963a-bafa-43bf-9b62-1d22470f4b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:45.216310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047963a-bafa-43bf-9b62-1d22470f4b54 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:45.228955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 814/1623] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:04:45.232975 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270a10f-4d72-4997-b7bb-b1c7475fb38d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:45.243767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4270a10f-4d72-4997-b7bb-b1c7475fb38d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:45.248852 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37786a46-e955-427d-808b-50bba5b74dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:45.250263 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786a46-e955-427d-808b-50bba5b74dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:45.250263 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786a46-e955-427d-808b-50bba5b74dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:45.250743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786a46-e955-427d-808b-50bba5b74dd8 admin admin] PATH_INFO: `/v3/projects/17ef566a26b749858a48abc079b14abf/users/52e02df5a3b94d93aa96c5ea69b3da92/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:45.266923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37786a46-e955-427d-808b-50bba5b74dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ef566a26b749858a48abc079b14abf, user_id=52e02df5a3b94d93aa96c5ea69b3da92, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:45.270061 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37786a46-e955-427d-808b-50bba5b74dd8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:45.270196 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973aca2-a8db-4fc7-b280-fa82f8b44031 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:45.270765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973aca2-a8db-4fc7-b280-fa82f8b44031 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:45.270765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973aca2-a8db-4fc7-b280-fa82f8b44031 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:45.272752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 815/1624] 10.222.0.35 () {54 vars in 912 bytes} [Wed May 11 21:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 21:04:45.278150 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01613ddb-04f7-4f4a-8e94-0caf9d8bedf7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:45.278493 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01613ddb-04f7-4f4a-8e94-0caf9d8bedf7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:45.278816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01613ddb-04f7-4f4a-8e94-0caf9d8bedf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:45.297750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-01613ddb-04f7-4f4a-8e94-0caf9d8bedf7 None None] MFA Rules not processed for user `f400b94d3fbc40bdace4860fe83a0891`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:45.298962 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-01613ddb-04f7-4f4a-8e94-0caf9d8bedf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:45.310143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 816/1625] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:04:45.327168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01613ddb-04f7-4f4a-8e94-0caf9d8bedf7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:45.359452 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 810/1626] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:45 2022] PUT /identity/v3/projects/17ef566a26b749858a48abc079b14abf/users/52e02df5a3b94d93aa96c5ea69b3da92/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:45.362978 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37786a46-e955-427d-808b-50bba5b74dd8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:45.437514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37786a46-e955-427d-808b-50bba5b74dd8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:45.444525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01613ddb-04f7-4f4a-8e94-0caf9d8bedf7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:45.450238 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f8470-0fd7-4323-9981-4fa1734d614c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:45.450935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f8470-0fd7-4323-9981-4fa1734d614c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:45.451228 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f8470-0fd7-4323-9981-4fa1734d614c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:45.451507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f8470-0fd7-4323-9981-4fa1734d614c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:45.452248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f8470-0fd7-4323-9981-4fa1734d614c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:45.454560 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f8470-0fd7-4323-9981-4fa1734d614c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:45.477243 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 811/1627] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:04:45.478906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd65c96-51e7-4e71-bc45-81183c0f73bb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:45.479455 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd65c96-51e7-4e71-bc45-81183c0f73bb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:45.479969 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd65c96-51e7-4e71-bc45-81183c0f73bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:45.525951 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ccd65c96-51e7-4e71-bc45-81183c0f73bb None None] MFA Rules not processed for user `70ae8e6e3ec8401cbc7be32478ec7a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:45.528939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ccd65c96-51e7-4e71-bc45-81183c0f73bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:45.542896 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1490a-782a-4a13-b848-cd73d6fa8795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:45.544200 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1490a-782a-4a13-b848-cd73d6fa8795 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:45.544485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1490a-782a-4a13-b848-cd73d6fa8795 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:45.545835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1490a-782a-4a13-b848-cd73d6fa8795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:45.674206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 812/1628] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:45.686770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd65c96-51e7-4e71-bc45-81183c0f73bb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:45.698864 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd65c96-51e7-4e71-bc45-81183c0f73bb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:45.704393 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc0cb8-029e-49c3-bdf6-2c5f2b635ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:45.705612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc0cb8-029e-49c3-bdf6-2c5f2b635ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:45.706568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc0cb8-029e-49c3-bdf6-2c5f2b635ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:45.706965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc0cb8-029e-49c3-bdf6-2c5f2b635ac8 admin admin] PATH_INFO: `/v3/projects/17ef566a26b749858a48abc079b14abf/users/52e02df5a3b94d93aa96c5ea69b3da92/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:45.709323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc0cb8-029e-49c3-bdf6-2c5f2b635ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ef566a26b749858a48abc079b14abf, user_id=52e02df5a3b94d93aa96c5ea69b3da92, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:45.713347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc0cb8-029e-49c3-bdf6-2c5f2b635ac8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:45.723833 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1490a-782a-4a13-b848-cd73d6fa8795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:45.725294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1490a-782a-4a13-b848-cd73d6fa8795 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:45.743044 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 813/1629] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:45 2022] PUT /identity/v3/projects/17ef566a26b749858a48abc079b14abf/users/52e02df5a3b94d93aa96c5ea69b3da92/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:45.744712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f368f-f604-44d2-8a52-05a102f08e61 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:45.745149 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f368f-f604-44d2-8a52-05a102f08e61 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:45.745624 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f368f-f604-44d2-8a52-05a102f08e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:45.756455 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 817/1630] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:04:45.768158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5c859-b627-4d1b-960d-ce7f6e193fad None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:45.768509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5c859-b627-4d1b-960d-ce7f6e193fad None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:45.768793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5c859-b627-4d1b-960d-ce7f6e193fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:45.775239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7b3f368f-f604-44d2-8a52-05a102f08e61 None None] MFA Rules not processed for user `70ae8e6e3ec8401cbc7be32478ec7a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:45.776854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7b3f368f-f604-44d2-8a52-05a102f08e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:45.826039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-84b5c859-b627-4d1b-960d-ce7f6e193fad None None] MFA Rules not processed for user `52e02df5a3b94d93aa96c5ea69b3da92`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:45.827621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-84b5c859-b627-4d1b-960d-ce7f6e193fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:45.937913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 814/1631] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:45.962498 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f9e32-7f91-4c5c-afc1-35583e89fda4 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:45.962927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f9e32-7f91-4c5c-afc1-35583e89fda4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:45.963254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f9e32-7f91-4c5c-afc1-35583e89fda4 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:45.965050 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 815/1632] 10.222.0.35 () {54 vars in 961 bytes} [Wed May 11 21:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 11 21:04:45.979858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 818/1633] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:45.981961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb6a7-d2e4-4b40-98b7-1df55237eaa1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:45.982377 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb6a7-d2e4-4b40-98b7-1df55237eaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:45.982715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb6a7-d2e4-4b40-98b7-1df55237eaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:46.026398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2accb6a7-d2e4-4b40-98b7-1df55237eaa1 None None] MFA Rules not processed for user `f400b94d3fbc40bdace4860fe83a0891`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:46.028938 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2accb6a7-d2e4-4b40-98b7-1df55237eaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:46.031639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5c859-b627-4d1b-960d-ce7f6e193fad None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:46.150062 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5c859-b627-4d1b-960d-ce7f6e193fad None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:46.154514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 816/1634] 10.222.0.35 () {58 vars in 1058 bytes} [Wed May 11 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:46.157957 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8116b3-cc71-4229-9774-bff6ad5280c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:46.158634 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8116b3-cc71-4229-9774-bff6ad5280c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:46.159015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8116b3-cc71-4229-9774-bff6ad5280c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:46.159304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8116b3-cc71-4229-9774-bff6ad5280c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:46.163178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accb6a7-d2e4-4b40-98b7-1df55237eaa1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:46.179895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accb6a7-d2e4-4b40-98b7-1df55237eaa1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:46.184218 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8116b3-cc71-4229-9774-bff6ad5280c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:46.187794 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8116b3-cc71-4229-9774-bff6ad5280c0 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:46.196950 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd953a-a3c2-4f55-8770-815544239a03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:46.197800 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd953a-a3c2-4f55-8770-815544239a03 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:46.198112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd953a-a3c2-4f55-8770-815544239a03 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:46.198475 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd953a-a3c2-4f55-8770-815544239a03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:46.224671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 819/1635] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:46.243555 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd953a-a3c2-4f55-8770-815544239a03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:46.245379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd953a-a3c2-4f55-8770-815544239a03 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:46.256724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 817/1636] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:04:46.677735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c157e-b2c7-4eec-ba32-79b88e95d94c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:46.678307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c157e-b2c7-4eec-ba32-79b88e95d94c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:46.678636 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c157e-b2c7-4eec-ba32-79b88e95d94c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:46.681321 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 820/1637] 10.222.0.35 () {54 vars in 912 bytes} [Wed May 11 21:04:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:04:46.693034 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88258075-5d93-4232-8f66-927d61ae068e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:46.693034 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88258075-5d93-4232-8f66-927d61ae068e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:46.693034 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88258075-5d93-4232-8f66-927d61ae068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:46.715763 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-88258075-5d93-4232-8f66-927d61ae068e None None] MFA Rules not processed for user `f400b94d3fbc40bdace4860fe83a0891`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:46.717361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-88258075-5d93-4232-8f66-927d61ae068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:46.743339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 818/1638] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 21:04:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:46.757900 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c157e-b2c7-4eec-ba32-79b88e95d94c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:46.761548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-004c157e-b2c7-4eec-ba32-79b88e95d94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:46.792963 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b15f1-92b5-4f21-9fde-558e0b93a9da None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:46.793361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b15f1-92b5-4f21-9fde-558e0b93a9da None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:46.793804 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b15f1-92b5-4f21-9fde-558e0b93a9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:46.879428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c157e-b2c7-4eec-ba32-79b88e95d94c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:46.883517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-471b15f1-92b5-4f21-9fde-558e0b93a9da None None] MFA Rules not processed for user `c1a3f4517575466b86eeeae61b87a469`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:46.883517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-471b15f1-92b5-4f21-9fde-558e0b93a9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:46.883732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfd7ea-aec1-4fab-a241-6074ec17f16d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce12ee27315460793dfedd294eb3c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:46.885099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfd7ea-aec1-4fab-a241-6074ec17f16d service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:46.885655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfd7ea-aec1-4fab-a241-6074ec17f16d service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:46.886166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfd7ea-aec1-4fab-a241-6074ec17f16d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:46.911489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfd7ea-aec1-4fab-a241-6074ec17f16d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:46.915181 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfd7ea-aec1-4fab-a241-6074ec17f16d service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:46.946079 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 821/1639] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:47.076378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 819/1640] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:04:47.080894 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfd7ea-aec1-4fab-a241-6074ec17f16d service glance] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:47.208117 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfd7ea-aec1-4fab-a241-6074ec17f16d service glance] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:47.227239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1881e36-cfeb-434f-98c8-9857ae2098b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:47.229708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1881e36-cfeb-434f-98c8-9857ae2098b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:47.230130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1881e36-cfeb-434f-98c8-9857ae2098b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:47.240435 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1881e36-cfeb-434f-98c8-9857ae2098b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:47.241912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1881e36-cfeb-434f-98c8-9857ae2098b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:47.244877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1881e36-cfeb-434f-98c8-9857ae2098b1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:47.366475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 822/1641] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:04:47 2022] POST /identity/v3/projects => generated 405 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:47.370678 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b15f1-92b5-4f21-9fde-558e0b93a9da None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:47.384531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b15f1-92b5-4f21-9fde-558e0b93a9da None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:47.545729 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef46c6-52fd-4cfc-8c8e-08d486918d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:47.546737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef46c6-52fd-4cfc-8c8e-08d486918d9b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:47.547234 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef46c6-52fd-4cfc-8c8e-08d486918d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:47.549242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef46c6-52fd-4cfc-8c8e-08d486918d9b admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:47.553677 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef46c6-52fd-4cfc-8c8e-08d486918d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:47.556620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef46c6-52fd-4cfc-8c8e-08d486918d9b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:47.653983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 820/1642] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:04:47 2022] POST /identity/v3/users => generated 309 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:47.661882 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1881e36-cfeb-434f-98c8-9857ae2098b1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:47.670074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1881e36-cfeb-434f-98c8-9857ae2098b1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:47.675962 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54840e31-e8fa-4833-8355-432752543231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:47.676612 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54840e31-e8fa-4833-8355-432752543231 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:47.676971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54840e31-e8fa-4833-8355-432752543231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:47.677322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54840e31-e8fa-4833-8355-432752543231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:47.678167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54840e31-e8fa-4833-8355-432752543231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:47.687011 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef46c6-52fd-4cfc-8c8e-08d486918d9b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:47.709671 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef46c6-52fd-4cfc-8c8e-08d486918d9b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:47.710288 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54840e31-e8fa-4833-8355-432752543231 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:47.729779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68477237-a78e-4c1f-802e-a2a803dfb7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:47.737569 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477237-a78e-4c1f-802e-a2a803dfb7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:47.737892 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477237-a78e-4c1f-802e-a2a803dfb7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:47.738184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68477237-a78e-4c1f-802e-a2a803dfb7ca admin admin] PATH_INFO: `/v3/users/cd22e4760d2344ad95e151f65bef15b5` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:47.743573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68477237-a78e-4c1f-802e-a2a803dfb7ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd22e4760d2344ad95e151f65bef15b5)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:47.749921 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 823/1643] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:04:47.750548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68477237-a78e-4c1f-802e-a2a803dfb7ca admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:47.754182 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54840e31-e8fa-4833-8355-432752543231 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:47.828688 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54840e31-e8fa-4833-8355-432752543231 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:47.860680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185152af-6f91-4200-9a7b-b15445e5ce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:47.863098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185152af-6f91-4200-9a7b-b15445e5ce3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:47.865462 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185152af-6f91-4200-9a7b-b15445e5ce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:47.866988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185152af-6f91-4200-9a7b-b15445e5ce3a admin admin] PATH_INFO: `/v3/projects/ee6862c9a3d9421eb6e4ffd1e9ee307c/users/7abdf406e2904ae89431301fc7ed37f2/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:47.921949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185152af-6f91-4200-9a7b-b15445e5ce3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6862c9a3d9421eb6e4ffd1e9ee307c, user_id=7abdf406e2904ae89431301fc7ed37f2, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:47.927384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185152af-6f91-4200-9a7b-b15445e5ce3a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:48.083616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 824/1644] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:47 2022] PUT /identity/v3/projects/ee6862c9a3d9421eb6e4ffd1e9ee307c/users/7abdf406e2904ae89431301fc7ed37f2/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:48.084869 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918ff7d-6758-4ccc-893e-cb6f361c9c0d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:48.085169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918ff7d-6758-4ccc-893e-cb6f361c9c0d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:48.085451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918ff7d-6758-4ccc-893e-cb6f361c9c0d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:48.087706 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 825/1645] 10.222.0.35 () {54 vars in 912 bytes} [Wed May 11 21:04:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:04:48.088364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918ff7d-6758-4ccc-893e-cb6f361c9c0d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:48.110454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-68477237-a78e-4c1f-802e-a2a803dfb7ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd22e4760d2344ad95e151f65bef15b5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:48.165511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918ff7d-6758-4ccc-893e-cb6f361c9c0d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:48.170894 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8b552-0848-4e3a-9d8c-fcfe5352a1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:48.170894 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8b552-0848-4e3a-9d8c-fcfe5352a1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:48.171188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8b552-0848-4e3a-9d8c-fcfe5352a1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:48.172066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8b552-0848-4e3a-9d8c-fcfe5352a1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:48.172803 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8b552-0848-4e3a-9d8c-fcfe5352a1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:48.174441 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8b552-0848-4e3a-9d8c-fcfe5352a1e6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:48.185098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 826/1646] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:48.186314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a464b-4212-422d-8a4f-9fe89f7dd6b8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:48.186607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a464b-4212-422d-8a4f-9fe89f7dd6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:48.186953 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a464b-4212-422d-8a4f-9fe89f7dd6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:48.228711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-68477237-a78e-4c1f-802e-a2a803dfb7ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd22e4760d2344ad95e151f65bef15b5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:48.237143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-065a464b-4212-422d-8a4f-9fe89f7dd6b8 None None] MFA Rules not processed for user `8aa998f15cd543338cd0fc8b5a501066`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:48.238456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-065a464b-4212-422d-8a4f-9fe89f7dd6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:48.240125 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-68477237-a78e-4c1f-802e-a2a803dfb7ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd22e4760d2344ad95e151f65bef15b5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:48.240835 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-68477237-a78e-4c1f-802e-a2a803dfb7ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd22e4760d2344ad95e151f65bef15b5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:48.241616 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-68477237-a78e-4c1f-802e-a2a803dfb7ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd22e4760d2344ad95e151f65bef15b5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:48.276049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 821/1647] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:04:47 2022] DELETE /identity/v3/users/cd22e4760d2344ad95e151f65bef15b5 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:04:48.279727 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68477237-a78e-4c1f-802e-a2a803dfb7ca admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:48.284207 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-68477237-a78e-4c1f-802e-a2a803dfb7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:48.361382 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 827/1648] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 21:04:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:48.366521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b77b24-5044-483f-ab13-daa7acd5deed None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:48.366521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b77b24-5044-483f-ab13-daa7acd5deed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:48.366521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b77b24-5044-483f-ab13-daa7acd5deed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:48.392948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e5b77b24-5044-483f-ab13-daa7acd5deed None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:48.404841 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e5b77b24-5044-483f-ab13-daa7acd5deed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:48.405095 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68477237-a78e-4c1f-802e-a2a803dfb7ca admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:48.415150 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 828/1649] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:48.427316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b77b24-5044-483f-ab13-daa7acd5deed None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:48.427316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e5b77b24-5044-483f-ab13-daa7acd5deed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:48.427913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c8fc9-17e7-4b38-a241-c352c955fbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:48.427913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c8fc9-17e7-4b38-a241-c352c955fbca admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:48.427913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c8fc9-17e7-4b38-a241-c352c955fbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:48.427913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c8fc9-17e7-4b38-a241-c352c955fbca admin admin] PATH_INFO: `/v3/projects/ee6862c9a3d9421eb6e4ffd1e9ee307c/users/7abdf406e2904ae89431301fc7ed37f2/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:48.428260 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c8fc9-17e7-4b38-a241-c352c955fbca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6862c9a3d9421eb6e4ffd1e9ee307c, user_id=7abdf406e2904ae89431301fc7ed37f2, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:48.430487 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c8fc9-17e7-4b38-a241-c352c955fbca admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:48.451867 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 822/1650] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:48 2022] PUT /identity/v3/projects/ee6862c9a3d9421eb6e4ffd1e9ee307c/users/7abdf406e2904ae89431301fc7ed37f2/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:48.469365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c8fc9-17e7-4b38-a241-c352c955fbca admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:48.471818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3e8c8fc9-17e7-4b38-a241-c352c955fbca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:48.563226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c8fc9-17e7-4b38-a241-c352c955fbca admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:48.572916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97e505-3459-4ba6-9cc1-d10fef8c1257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:48.573785 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97e505-3459-4ba6-9cc1-d10fef8c1257 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:48.574143 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97e505-3459-4ba6-9cc1-d10fef8c1257 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:48.574428 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97e505-3459-4ba6-9cc1-d10fef8c1257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:48.647111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b77b24-5044-483f-ab13-daa7acd5deed None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:48.658733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27bbb6-6c96-47c5-b057-c9502f0fdf18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:48.662014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27bbb6-6c96-47c5-b057-c9502f0fdf18 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:48.662490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27bbb6-6c96-47c5-b057-c9502f0fdf18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:48.662877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27bbb6-6c96-47c5-b057-c9502f0fdf18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:48.681395 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27bbb6-6c96-47c5-b057-c9502f0fdf18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:48.683157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27bbb6-6c96-47c5-b057-c9502f0fdf18 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:48.694932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 829/1651] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:48.727045 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97e505-3459-4ba6-9cc1-d10fef8c1257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:48.729145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97e505-3459-4ba6-9cc1-d10fef8c1257 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:48.742062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 823/1652] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:49.986121 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565843a6-29b9-49f9-8b35-d75c3b6ef6a8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:49.986697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565843a6-29b9-49f9-8b35-d75c3b6ef6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:49.986697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565843a6-29b9-49f9-8b35-d75c3b6ef6a8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:49.988049 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 830/1653] 10.222.0.35 () {54 vars in 960 bytes} [Wed May 11 21:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:04:49.994048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f88bd-c174-418d-a985-5de2d75a103c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:49.994579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f88bd-c174-418d-a985-5de2d75a103c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:49.994898 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f88bd-c174-418d-a985-5de2d75a103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:50.047708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-399f88bd-c174-418d-a985-5de2d75a103c None None] MFA Rules not processed for user `59cb32d2807549699e37b27ca97d351c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:50.052803 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-399f88bd-c174-418d-a985-5de2d75a103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:50.319654 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 824/1654] 10.222.0.35 () {58 vars in 1057 bytes} [Wed May 11 21:04:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:50.328112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565843a6-29b9-49f9-8b35-d75c3b6ef6a8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:50.360098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565843a6-29b9-49f9-8b35-d75c3b6ef6a8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:50.368509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc90341-0f91-444e-a6ad-4a9089944fc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59cb32d2807549699e37b27ca97d351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:50.370353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc90341-0f91-444e-a6ad-4a9089944fc5 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:50.370845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc90341-0f91-444e-a6ad-4a9089944fc5 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:50.371332 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc90341-0f91-444e-a6ad-4a9089944fc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:50.373895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bdc90341-0f91-444e-a6ad-4a9089944fc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:50.390275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc90341-0f91-444e-a6ad-4a9089944fc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:50.392278 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc90341-0f91-444e-a6ad-4a9089944fc5 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:50.419758 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 831/1655] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:50.706532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f88bd-c174-418d-a985-5de2d75a103c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:50.708146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-399f88bd-c174-418d-a985-5de2d75a103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:50.732964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f88bd-c174-418d-a985-5de2d75a103c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:50.742584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7583cae-4e98-4b3f-9426-af61cab6b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:50.743700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583cae-4e98-4b3f-9426-af61cab6b39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:50.744131 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583cae-4e98-4b3f-9426-af61cab6b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:50.744543 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583cae-4e98-4b3f-9426-af61cab6b39a admin admin] PATH_INFO: `/v3/projects/7e2b1fbf2b2948a1a108a660353e1dc0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:50.746727 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7583cae-4e98-4b3f-9426-af61cab6b39a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2b1fbf2b2948a1a108a660353e1dc0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:50.755611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: WARNING py.warnings [None req-e7583cae-4e98-4b3f-9426-af61cab6b39a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 21:04:50.755611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: warnings.warn(msg) May 11 21:04:50.755611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: May 11 21:04:50.757114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7583cae-4e98-4b3f-9426-af61cab6b39a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:50.954695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7583cae-4e98-4b3f-9426-af61cab6b39a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2b1fbf2b2948a1a108a660353e1dc0', 'request_id': 'req-e7583cae-4e98-4b3f-9426-af61cab6b39a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:50.973848 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7583cae-4e98-4b3f-9426-af61cab6b39a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2b1fbf2b2948a1a108a660353e1dc0', 'request_id': 'req-e7583cae-4e98-4b3f-9426-af61cab6b39a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:50.981582 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7583cae-4e98-4b3f-9426-af61cab6b39a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2b1fbf2b2948a1a108a660353e1dc0', 'request_id': 'req-e7583cae-4e98-4b3f-9426-af61cab6b39a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:51.101464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7583cae-4e98-4b3f-9426-af61cab6b39a admin admin] The token cache is being invalidate because project 7e2b1fbf2b2948a1a108a660353e1dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:04:51.102504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7583cae-4e98-4b3f-9426-af61cab6b39a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:51.104196 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7583cae-4e98-4b3f-9426-af61cab6b39a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:51.108592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 825/1656] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:04:50 2022] DELETE /identity/v3/projects/7e2b1fbf2b2948a1a108a660353e1dc0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:51.112517 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc90341-0f91-444e-a6ad-4a9089944fc5 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:51.130746 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc90341-0f91-444e-a6ad-4a9089944fc5 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:51.259423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:51.261513 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:51.262046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:51.262459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] PATH_INFO: `/v3/users/52e02df5a3b94d93aa96c5ea69b3da92` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:51.263911 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e02df5a3b94d93aa96c5ea69b3da92)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:51.265164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 11 21:04:51.265164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: warnings.warn(msg) May 11 21:04:51.265164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: May 11 21:04:51.266757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:51.578915 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e02df5a3b94d93aa96c5ea69b3da92'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:51.609668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e02df5a3b94d93aa96c5ea69b3da92'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:51.704814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e02df5a3b94d93aa96c5ea69b3da92'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:51.705451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e02df5a3b94d93aa96c5ea69b3da92'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:51.706273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e02df5a3b94d93aa96c5ea69b3da92'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:51.776112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 832/1657] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:04:51 2022] DELETE /identity/v3/users/52e02df5a3b94d93aa96c5ea69b3da92 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:52.708233 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dbe7e-7d70-45c9-9aa2-326e35bbd3f9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:52.708633 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dbe7e-7d70-45c9-9aa2-326e35bbd3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:52.708928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dbe7e-7d70-45c9-9aa2-326e35bbd3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:52.760090 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-862dbe7e-7d70-45c9-9aa2-326e35bbd3f9 None None] MFA Rules not processed for user `7abdf406e2904ae89431301fc7ed37f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:52.761516 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-862dbe7e-7d70-45c9-9aa2-326e35bbd3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:52.918215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 826/1658] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:53.602108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:53.614041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:53.796585 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d68671-901d-48c4-9b60-2756feace995 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:53.817997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d007d0-6ca0-412e-884f-117ef04a8f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:53.818971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d007d0-6ca0-412e-884f-117ef04a8f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:53.823340 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d007d0-6ca0-412e-884f-117ef04a8f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:53.823757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d007d0-6ca0-412e-884f-117ef04a8f67 admin admin] PATH_INFO: `/v3/projects/17ef566a26b749858a48abc079b14abf` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:53.826914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d007d0-6ca0-412e-884f-117ef04a8f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17ef566a26b749858a48abc079b14abf)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:53.829642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d007d0-6ca0-412e-884f-117ef04a8f67 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:54.330945 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-20d007d0-6ca0-412e-884f-117ef04a8f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17ef566a26b749858a48abc079b14abf', 'request_id': 'req-20d007d0-6ca0-412e-884f-117ef04a8f67'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:54.357075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-20d007d0-6ca0-412e-884f-117ef04a8f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17ef566a26b749858a48abc079b14abf', 'request_id': 'req-20d007d0-6ca0-412e-884f-117ef04a8f67'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:54.380700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-20d007d0-6ca0-412e-884f-117ef04a8f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17ef566a26b749858a48abc079b14abf', 'request_id': 'req-20d007d0-6ca0-412e-884f-117ef04a8f67'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:54.456938 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-20d007d0-6ca0-412e-884f-117ef04a8f67 admin admin] The token cache is being invalidate because project 17ef566a26b749858a48abc079b14abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:04:54.457235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-20d007d0-6ca0-412e-884f-117ef04a8f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:54.458120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-20d007d0-6ca0-412e-884f-117ef04a8f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:54.460633 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 833/1659] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:04:53 2022] DELETE /identity/v3/projects/17ef566a26b749858a48abc079b14abf => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:54.469482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9308729-9242-48b3-bcbb-3f07d3a4e12c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:54.470058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9308729-9242-48b3-bcbb-3f07d3a4e12c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:54.470141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9308729-9242-48b3-bcbb-3f07d3a4e12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:54.502055 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a9308729-9242-48b3-bcbb-3f07d3a4e12c None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:54.503308 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a9308729-9242-48b3-bcbb-3f07d3a4e12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:54.698389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 827/1660] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:54.702011 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619e028-1504-48cd-a98b-15e24579baa5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:54.702908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619e028-1504-48cd-a98b-15e24579baa5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:54.703420 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619e028-1504-48cd-a98b-15e24579baa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:54.755532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0619e028-1504-48cd-a98b-15e24579baa5 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:54.759353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0619e028-1504-48cd-a98b-15e24579baa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:54.803136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9308729-9242-48b3-bcbb-3f07d3a4e12c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:54.803570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 834/1661] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:54.814641 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9308729-9242-48b3-bcbb-3f07d3a4e12c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:54.825386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eccda6-682d-4463-a79c-57ff1a8d601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:54.832887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eccda6-682d-4463-a79c-57ff1a8d601e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:54.832887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eccda6-682d-4463-a79c-57ff1a8d601e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:54.832887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eccda6-682d-4463-a79c-57ff1a8d601e admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:54.832887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eccda6-682d-4463-a79c-57ff1a8d601e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:04:54.832887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eccda6-682d-4463-a79c-57ff1a8d601e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:54.832887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eccda6-682d-4463-a79c-57ff1a8d601e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:54.904370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619e028-1504-48cd-a98b-15e24579baa5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:54.915093 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619e028-1504-48cd-a98b-15e24579baa5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:54.929858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 828/1662] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:04:54.957718 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503ad13-e2d8-4c63-8f85-4bf6c2c54ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:54.959187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503ad13-e2d8-4c63-8f85-4bf6c2c54ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:54.959674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503ad13-e2d8-4c63-8f85-4bf6c2c54ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:54.960168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503ad13-e2d8-4c63-8f85-4bf6c2c54ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:54.961071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503ad13-e2d8-4c63-8f85-4bf6c2c54ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:54.963504 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503ad13-e2d8-4c63-8f85-4bf6c2c54ca5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:55.168848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 835/1663] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:04:54 2022] POST /identity/v3/projects => generated 385 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:55.173210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eccda6-682d-4463-a79c-57ff1a8d601e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:55.191147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eccda6-682d-4463-a79c-57ff1a8d601e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:55.379859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c128b1-9662-41b8-99db-7e86d5540477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:55.382902 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c128b1-9662-41b8-99db-7e86d5540477 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:55.384076 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c128b1-9662-41b8-99db-7e86d5540477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:55.384464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c128b1-9662-41b8-99db-7e86d5540477 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:55.387263 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c128b1-9662-41b8-99db-7e86d5540477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:55.391618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c128b1-9662-41b8-99db-7e86d5540477 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:55.539550 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 829/1664] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:04:55 2022] POST /identity/v3/users => generated 293 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:04:55.543858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503ad13-e2d8-4c63-8f85-4bf6c2c54ca5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:55.560485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503ad13-e2d8-4c63-8f85-4bf6c2c54ca5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:55.579784 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e4b55-a749-4010-b8ce-a1d039d40def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:55.584810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e4b55-a749-4010-b8ce-a1d039d40def admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:55.584810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e4b55-a749-4010-b8ce-a1d039d40def admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:55.584810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e4b55-a749-4010-b8ce-a1d039d40def admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:55.585362 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e4b55-a749-4010-b8ce-a1d039d40def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:55.602399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e4b55-a749-4010-b8ce-a1d039d40def admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:55.677958 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c128b1-9662-41b8-99db-7e86d5540477 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:55.679304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 836/1665] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:55.700786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c128b1-9662-41b8-99db-7e86d5540477 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:55.712805 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4305e-4ec4-4553-bf31-51675c77682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:55.713810 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4305e-4ec4-4553-bf31-51675c77682f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:55.714232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4305e-4ec4-4553-bf31-51675c77682f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:55.714693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4305e-4ec4-4553-bf31-51675c77682f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:55.715564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4305e-4ec4-4553-bf31-51675c77682f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:55.742756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4305e-4ec4-4553-bf31-51675c77682f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:55.777521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 830/1666] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:55.779622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e4b55-a749-4010-b8ce-a1d039d40def admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:55.797089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e4b55-a749-4010-b8ce-a1d039d40def admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:55.825485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8d497-87fe-41f1-ad30-c3f4af49a30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:55.826829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8d497-87fe-41f1-ad30-c3f4af49a30d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:55.827145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8d497-87fe-41f1-ad30-c3f4af49a30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:55.827425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8d497-87fe-41f1-ad30-c3f4af49a30d admin admin] PATH_INFO: `/v3/projects/007e7c6efe2c418b9f7f2791525326b8/users/5dd0960df414429391e92b19d918255d/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:55.827711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade9ad7-09ef-4083-a2fd-703ad1ac5963 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:55.828096 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade9ad7-09ef-4083-a2fd-703ad1ac5963 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:55.828652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade9ad7-09ef-4083-a2fd-703ad1ac5963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:55.858057 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8d497-87fe-41f1-ad30-c3f4af49a30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=007e7c6efe2c418b9f7f2791525326b8, user_id=5dd0960df414429391e92b19d918255d, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:55.862232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8d497-87fe-41f1-ad30-c3f4af49a30d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:55.865756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2ade9ad7-09ef-4083-a2fd-703ad1ac5963 None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:55.878846 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2ade9ad7-09ef-4083-a2fd-703ad1ac5963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:55.981814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 837/1667] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:55 2022] PUT /identity/v3/projects/007e7c6efe2c418b9f7f2791525326b8/users/5dd0960df414429391e92b19d918255d/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:55.994582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558306c7-8d51-458f-ab23-471215e6a4c3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:55.995108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558306c7-8d51-458f-ab23-471215e6a4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:55.995608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558306c7-8d51-458f-ab23-471215e6a4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:56.052159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 831/1668] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 11 21:04:56.073007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-558306c7-8d51-458f-ab23-471215e6a4c3 None None] MFA Rules not processed for user `5dd0960df414429391e92b19d918255d`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:56.075341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-558306c7-8d51-458f-ab23-471215e6a4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:56.235587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 838/1669] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:56.240159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade9ad7-09ef-4083-a2fd-703ad1ac5963 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:56.268921 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade9ad7-09ef-4083-a2fd-703ad1ac5963 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:56.543375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb21d30-a64e-4598-b245-fb40ebd96a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:56.543375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21d30-a64e-4598-b245-fb40ebd96a98 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:56.543375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21d30-a64e-4598-b245-fb40ebd96a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:56.543375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21d30-a64e-4598-b245-fb40ebd96a98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:56.552782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb21d30-a64e-4598-b245-fb40ebd96a98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:56.557213 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb21d30-a64e-4598-b245-fb40ebd96a98 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:56.597726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558306c7-8d51-458f-ab23-471215e6a4c3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:56.602588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-558306c7-8d51-458f-ab23-471215e6a4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:56.694127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 832/1670] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:04:56 2022] POST /identity/v3/projects => generated 387 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:56.700121 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ecf2-b2b3-47f1-b559-ea45286e5e97 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:56.700677 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ecf2-b2b3-47f1-b559-ea45286e5e97 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:56.701515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ecf2-b2b3-47f1-b559-ea45286e5e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:56.788455 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8dd9ecf2-b2b3-47f1-b559-ea45286e5e97 None None] MFA Rules not processed for user `f9968edcee104432ade2014e39683bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:56.789737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8dd9ecf2-b2b3-47f1-b559-ea45286e5e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:56.816673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558306c7-8d51-458f-ab23-471215e6a4c3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:56.980519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f18de-5246-4e65-a6b1-c20d33cd7cfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:56.982079 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f18de-5246-4e65-a6b1-c20d33cd7cfa service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:56.982499 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f18de-5246-4e65-a6b1-c20d33cd7cfa service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:56.986609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f18de-5246-4e65-a6b1-c20d33cd7cfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:57.033291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 833/1671] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:57.034265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ecf2-b2b3-47f1-b559-ea45286e5e97 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:57.150386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ecf2-b2b3-47f1-b559-ea45286e5e97 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:57.182738 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9198442-7038-4581-b3ac-62e8666aae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:57.183721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198442-7038-4581-b3ac-62e8666aae21 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:57.185980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198442-7038-4581-b3ac-62e8666aae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:57.185980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9198442-7038-4581-b3ac-62e8666aae21 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:57.187423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9198442-7038-4581-b3ac-62e8666aae21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:57.195420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9198442-7038-4581-b3ac-62e8666aae21 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:57.199891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f18de-5246-4e65-a6b1-c20d33cd7cfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:57.201692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f18de-5246-4e65-a6b1-c20d33cd7cfa service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:57.222491 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 839/1672] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:04:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 21:04:57.223571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f18de-5246-4e65-a6b1-c20d33cd7cfa service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:57.227928 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-249f18de-5246-4e65-a6b1-c20d33cd7cfa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:57.461285 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f18de-5246-4e65-a6b1-c20d33cd7cfa service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:57.473160 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d6d94-cf51-4917-9fe3-926b8072b867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:57.476785 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d6d94-cf51-4917-9fe3-926b8072b867 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:57.477169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d6d94-cf51-4917-9fe3-926b8072b867 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:57.477478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d6d94-cf51-4917-9fe3-926b8072b867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:57.514592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d6d94-cf51-4917-9fe3-926b8072b867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:57.516223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d6d94-cf51-4917-9fe3-926b8072b867 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:57.552245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 840/1673] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:57.597484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 834/1674] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:04:57 2022] POST /identity/v3/users => generated 300 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:04:57.601354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d6d94-cf51-4917-9fe3-926b8072b867 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:57.623516 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d6d94-cf51-4917-9fe3-926b8072b867 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:57.654806 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e80fa8-9fff-481c-888c-1a954d3b460d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:57.656042 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e80fa8-9fff-481c-888c-1a954d3b460d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:57.656378 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e80fa8-9fff-481c-888c-1a954d3b460d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:57.656652 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e80fa8-9fff-481c-888c-1a954d3b460d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:57.657386 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e80fa8-9fff-481c-888c-1a954d3b460d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:57.659099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e80fa8-9fff-481c-888c-1a954d3b460d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:57.696179 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 841/1675] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:57.697862 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9198442-7038-4581-b3ac-62e8666aae21 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:57.714337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9198442-7038-4581-b3ac-62e8666aae21 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:57.731999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c90406-57e8-471b-b2fd-3e92517020b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:57.734726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c90406-57e8-471b-b2fd-3e92517020b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:57.735225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c90406-57e8-471b-b2fd-3e92517020b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:57.735860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c90406-57e8-471b-b2fd-3e92517020b2 admin admin] PATH_INFO: `/v3/projects/ba7998520735479daa91f03340455e8c/users/572b7aae75644cc5a800a9e25ba81de2/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:57.801605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c90406-57e8-471b-b2fd-3e92517020b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7998520735479daa91f03340455e8c, user_id=572b7aae75644cc5a800a9e25ba81de2, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:57.816656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c90406-57e8-471b-b2fd-3e92517020b2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:57.951847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 835/1676] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:57 2022] PUT /identity/v3/projects/ba7998520735479daa91f03340455e8c/users/572b7aae75644cc5a800a9e25ba81de2/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:57.955821 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e80fa8-9fff-481c-888c-1a954d3b460d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:57.989011 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e80fa8-9fff-481c-888c-1a954d3b460d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:58.232286 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fe160-f5e4-4f53-a0ef-df3a7fd6cbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:58.234382 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe160-f5e4-4f53-a0ef-df3a7fd6cbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:58.234382 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe160-f5e4-4f53-a0ef-df3a7fd6cbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:58.234382 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fe160-f5e4-4f53-a0ef-df3a7fd6cbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:58.239385 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fe160-f5e4-4f53-a0ef-df3a7fd6cbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:58.244495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fe160-f5e4-4f53-a0ef-df3a7fd6cbb9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:58.274348 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 842/1677] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:04:58.274709 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c90406-57e8-471b-b2fd-3e92517020b2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:58.293886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c90406-57e8-471b-b2fd-3e92517020b2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:58.329715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d5874-2774-414b-b60a-0fa7ca847302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:58.333366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d5874-2774-414b-b60a-0fa7ca847302 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:58.334163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d5874-2774-414b-b60a-0fa7ca847302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:58.334460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d5874-2774-414b-b60a-0fa7ca847302 admin admin] PATH_INFO: `/v3/projects/ba7998520735479daa91f03340455e8c/users/572b7aae75644cc5a800a9e25ba81de2/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:58.343996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d5874-2774-414b-b60a-0fa7ca847302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7998520735479daa91f03340455e8c, user_id=572b7aae75644cc5a800a9e25ba81de2, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:58.355299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d5874-2774-414b-b60a-0fa7ca847302 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:58.416002 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 836/1678] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:04:58 2022] PUT /identity/v3/projects/ba7998520735479daa91f03340455e8c/users/572b7aae75644cc5a800a9e25ba81de2/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:58.417992 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae04757-86b5-467a-b0e2-a564ae0a1f25 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:58.418477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae04757-86b5-467a-b0e2-a564ae0a1f25 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:58.418930 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae04757-86b5-467a-b0e2-a564ae0a1f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:58.501234 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341086dc-6bbe-418f-82f8-ba8af41f4490 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:58.501518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341086dc-6bbe-418f-82f8-ba8af41f4490 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:58.502069 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341086dc-6bbe-418f-82f8-ba8af41f4490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:58.546618 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2ae04757-86b5-467a-b0e2-a564ae0a1f25 None None] MFA Rules not processed for user `572b7aae75644cc5a800a9e25ba81de2`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:58.549618 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2ae04757-86b5-467a-b0e2-a564ae0a1f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:58.587099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-341086dc-6bbe-418f-82f8-ba8af41f4490 None None] MFA Rules not processed for user `8aa998f15cd543338cd0fc8b5a501066`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:58.598535 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-341086dc-6bbe-418f-82f8-ba8af41f4490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:58.771671 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 843/1679] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:58.772650 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae04757-86b5-467a-b0e2-a564ae0a1f25 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:58.785243 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2ae04757-86b5-467a-b0e2-a564ae0a1f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:58.815343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 837/1680] 10.222.0.70 () {58 vars in 1015 bytes} [Wed May 11 21:04:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:04:58.817880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341086dc-6bbe-418f-82f8-ba8af41f4490 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:58.821414 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-341086dc-6bbe-418f-82f8-ba8af41f4490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:59.101033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae04757-86b5-467a-b0e2-a564ae0a1f25 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:59.101033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc41c42-e11f-4817-b9e7-0ad9ac31d936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:59.101033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc41c42-e11f-4817-b9e7-0ad9ac31d936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:59.101033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc41c42-e11f-4817-b9e7-0ad9ac31d936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:59.101864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc41c42-e11f-4817-b9e7-0ad9ac31d936 admin admin] PATH_INFO: `/v3/users/d3fefcc4859a4b2ebcb733e54f98e98a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:59.101864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc41c42-e11f-4817-b9e7-0ad9ac31d936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3fefcc4859a4b2ebcb733e54f98e98a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:59.101864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc41c42-e11f-4817-b9e7-0ad9ac31d936 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:59.102063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341086dc-6bbe-418f-82f8-ba8af41f4490 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:59.102063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf83002-a424-4f7b-84ea-c24fb3fc0714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:59.102063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf83002-a424-4f7b-84ea-c24fb3fc0714 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:59.102063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf83002-a424-4f7b-84ea-c24fb3fc0714 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:59.102333 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf83002-a424-4f7b-84ea-c24fb3fc0714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:59.102333 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf83002-a424-4f7b-84ea-c24fb3fc0714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:59.102333 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf83002-a424-4f7b-84ea-c24fb3fc0714 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:59.121553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 838/1681] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:59.145346 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf83002-a424-4f7b-84ea-c24fb3fc0714 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:59.154908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-aaf83002-a424-4f7b-84ea-c24fb3fc0714 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:59.247460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf83002-a424-4f7b-84ea-c24fb3fc0714 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:59.266518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673801d-df85-4de4-8908-031f4e86ef9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:59.269369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673801d-df85-4de4-8908-031f4e86ef9c service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:59.270125 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673801d-df85-4de4-8908-031f4e86ef9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:59.271971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673801d-df85-4de4-8908-031f4e86ef9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:59.298158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673801d-df85-4de4-8908-031f4e86ef9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:59.300725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673801d-df85-4de4-8908-031f4e86ef9c service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:59.323406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 839/1682] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:04:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:04:59.328694 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673801d-df85-4de4-8908-031f4e86ef9c service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:04:59.383284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673801d-df85-4de4-8908-031f4e86ef9c service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:04:59.405861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13759378-ab66-43f4-a577-f7dd12e8fd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:04:59.406786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13759378-ab66-43f4-a577-f7dd12e8fd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:59.407101 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13759378-ab66-43f4-a577-f7dd12e8fd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:59.407418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13759378-ab66-43f4-a577-f7dd12e8fd7b admin admin] PATH_INFO: `/v3/users/5dd0960df414429391e92b19d918255d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:59.419369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13759378-ab66-43f4-a577-f7dd12e8fd7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd0960df414429391e92b19d918255d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:04:59.419369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13759378-ab66-43f4-a577-f7dd12e8fd7b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:04:59.581921 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cbc41c42-e11f-4817-b9e7-0ad9ac31d936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3fefcc4859a4b2ebcb733e54f98e98a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:59.625478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cbc41c42-e11f-4817-b9e7-0ad9ac31d936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3fefcc4859a4b2ebcb733e54f98e98a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:59.716576 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-13759378-ab66-43f4-a577-f7dd12e8fd7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd0960df414429391e92b19d918255d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:59.718217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cbc41c42-e11f-4817-b9e7-0ad9ac31d936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3fefcc4859a4b2ebcb733e54f98e98a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:59.719014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cbc41c42-e11f-4817-b9e7-0ad9ac31d936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3fefcc4859a4b2ebcb733e54f98e98a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:59.719824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cbc41c42-e11f-4817-b9e7-0ad9ac31d936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3fefcc4859a4b2ebcb733e54f98e98a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:59.786950 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 844/1683] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:04:58 2022] DELETE /identity/v3/users/d3fefcc4859a4b2ebcb733e54f98e98a => generated 0 bytes in 1012 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:59.790737 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45af1a3-5ac3-405f-a338-4b8158727791 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:59.795017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45af1a3-5ac3-405f-a338-4b8158727791 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:59.795017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45af1a3-5ac3-405f-a338-4b8158727791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:59.817430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-13759378-ab66-43f4-a577-f7dd12e8fd7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd0960df414429391e92b19d918255d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:59.825606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-13759378-ab66-43f4-a577-f7dd12e8fd7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd0960df414429391e92b19d918255d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:59.828614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-13759378-ab66-43f4-a577-f7dd12e8fd7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd0960df414429391e92b19d918255d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:59.830606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-13759378-ab66-43f4-a577-f7dd12e8fd7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd0960df414429391e92b19d918255d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:04:59.870144 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b45af1a3-5ac3-405f-a338-4b8158727791 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:59.870144 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b45af1a3-5ac3-405f-a338-4b8158727791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:04:59.878966 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 840/1684] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:04:59 2022] DELETE /identity/v3/users/5dd0960df414429391e92b19d918255d => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:04:59.885432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60a99-dfcb-4d58-ad3a-f0e415313bdb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:04:59.885432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60a99-dfcb-4d58-ad3a-f0e415313bdb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:04:59.885432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60a99-dfcb-4d58-ad3a-f0e415313bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:04:59.929021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-65e60a99-dfcb-4d58-ad3a-f0e415313bdb None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:04:59.933415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-65e60a99-dfcb-4d58-ad3a-f0e415313bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:00.038394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 845/1685] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:00.082041 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 841/1686] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:00.129945 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45af1a3-5ac3-405f-a338-4b8158727791 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:00.131550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b45af1a3-5ac3-405f-a338-4b8158727791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:00.245869 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45af1a3-5ac3-405f-a338-4b8158727791 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:00.291000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e60a99-dfcb-4d58-ad3a-f0e415313bdb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:00.292566 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-65e60a99-dfcb-4d58-ad3a-f0e415313bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:00.321318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d505f68-687f-46cb-9f25-b5059a5ab9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:00.322108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d505f68-687f-46cb-9f25-b5059a5ab9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:00.322698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d505f68-687f-46cb-9f25-b5059a5ab9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:00.323031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d505f68-687f-46cb-9f25-b5059a5ab9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:00.342601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d505f68-687f-46cb-9f25-b5059a5ab9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:00.345028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d505f68-687f-46cb-9f25-b5059a5ab9f2 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:00.360923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 846/1687] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:00.442993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e60a99-dfcb-4d58-ad3a-f0e415313bdb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:00.449844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e402b8-68ea-49dc-b246-6b5cbe304d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:00.450813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e402b8-68ea-49dc-b246-6b5cbe304d5d service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:00.451113 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e402b8-68ea-49dc-b246-6b5cbe304d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:00.451595 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e402b8-68ea-49dc-b246-6b5cbe304d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:00.478652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e402b8-68ea-49dc-b246-6b5cbe304d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:00.481930 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e402b8-68ea-49dc-b246-6b5cbe304d5d service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:00.507862 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 842/1688] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:05:00.719683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d505f68-687f-46cb-9f25-b5059a5ab9f2 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:00.721256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0d505f68-687f-46cb-9f25-b5059a5ab9f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:00.748178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d505f68-687f-46cb-9f25-b5059a5ab9f2 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:00.765081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb257df-9eaa-4208-befd-b4d59349b7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:00.765868 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb257df-9eaa-4208-befd-b4d59349b7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:00.766225 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb257df-9eaa-4208-befd-b4d59349b7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:00.766505 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb257df-9eaa-4208-befd-b4d59349b7a0 admin admin] PATH_INFO: `/v3/users/c1a3f4517575466b86eeeae61b87a469` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:00.775224 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb257df-9eaa-4208-befd-b4d59349b7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a3f4517575466b86eeeae61b87a469)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:00.777267 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb257df-9eaa-4208-befd-b4d59349b7a0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:01.063908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9cb257df-9eaa-4208-befd-b4d59349b7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a3f4517575466b86eeeae61b87a469'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:01.073713 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9cb257df-9eaa-4208-befd-b4d59349b7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a3f4517575466b86eeeae61b87a469'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:01.188270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e402b8-68ea-49dc-b246-6b5cbe304d5d service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:01.196698 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-18e402b8-68ea-49dc-b246-6b5cbe304d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:01.196963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9cb257df-9eaa-4208-befd-b4d59349b7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a3f4517575466b86eeeae61b87a469'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:01.196963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9cb257df-9eaa-4208-befd-b4d59349b7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a3f4517575466b86eeeae61b87a469'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:01.196963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9cb257df-9eaa-4208-befd-b4d59349b7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a3f4517575466b86eeeae61b87a469'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:01.226183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e402b8-68ea-49dc-b246-6b5cbe304d5d service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:01.234622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 847/1689] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:00 2022] DELETE /identity/v3/users/c1a3f4517575466b86eeeae61b87a469 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:01.240333 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35f526-6cde-49ee-bb90-81eadfd7c35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:01.241240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35f526-6cde-49ee-bb90-81eadfd7c35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:01.241547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35f526-6cde-49ee-bb90-81eadfd7c35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:01.245747 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35f526-6cde-49ee-bb90-81eadfd7c35d admin admin] PATH_INFO: `/v3/users/f1516fa442aa44b788482522e74adb3c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:01.250882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35f526-6cde-49ee-bb90-81eadfd7c35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1516fa442aa44b788482522e74adb3c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:01.253226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35f526-6cde-49ee-bb90-81eadfd7c35d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:01.529098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ba35f526-6cde-49ee-bb90-81eadfd7c35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1516fa442aa44b788482522e74adb3c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:01.634380 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ba35f526-6cde-49ee-bb90-81eadfd7c35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1516fa442aa44b788482522e74adb3c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:01.645432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ba35f526-6cde-49ee-bb90-81eadfd7c35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1516fa442aa44b788482522e74adb3c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:01.648344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ba35f526-6cde-49ee-bb90-81eadfd7c35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1516fa442aa44b788482522e74adb3c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:01.649746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ba35f526-6cde-49ee-bb90-81eadfd7c35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1516fa442aa44b788482522e74adb3c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:01.723959 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 843/1690] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:01 2022] DELETE /identity/v3/users/f1516fa442aa44b788482522e74adb3c => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:01.724699 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa999aab-1397-452b-b1b8-da8d594099e9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:01.725449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa999aab-1397-452b-b1b8-da8d594099e9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:01.725792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa999aab-1397-452b-b1b8-da8d594099e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:01.767619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-aa999aab-1397-452b-b1b8-da8d594099e9 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:01.769089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-aa999aab-1397-452b-b1b8-da8d594099e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:01.918649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 848/1691] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:01.969066 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35f526-6cde-49ee-bb90-81eadfd7c35d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:01.969066 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ba35f526-6cde-49ee-bb90-81eadfd7c35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:02.110006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35f526-6cde-49ee-bb90-81eadfd7c35d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:02.128287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2b107-0347-433c-a301-7175f128d063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:02.128973 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2b107-0347-433c-a301-7175f128d063 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:02.129218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2b107-0347-433c-a301-7175f128d063 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:02.129500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2b107-0347-433c-a301-7175f128d063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:02.154491 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d0c93-ab22-40bc-a064-ec573fb18769 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:02.157041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d0c93-ab22-40bc-a064-ec573fb18769 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:02.157622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d0c93-ab22-40bc-a064-ec573fb18769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:02.183442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2b107-0347-433c-a301-7175f128d063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:02.183726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2b107-0347-433c-a301-7175f128d063 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:02.218307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 844/1692] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:02.219286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2b107-0347-433c-a301-7175f128d063 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:02.220628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-59a2b107-0347-433c-a301-7175f128d063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:02.252047 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-053d0c93-ab22-40bc-a064-ec573fb18769 None None] MFA Rules not processed for user `baed8aff24b64c788f40e6d7dd1f99c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:02.254603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-053d0c93-ab22-40bc-a064-ec573fb18769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:02.276397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2b107-0347-433c-a301-7175f128d063 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:02.293781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:02.295662 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:02.296143 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:02.296562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] PATH_INFO: `/v3/projects/3f88ec88dc464807b966bc9fe0f17e56` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:02.302846 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f88ec88dc464807b966bc9fe0f17e56)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:02.318804 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:02.491616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 849/1693] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:02.492684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d0c93-ab22-40bc-a064-ec573fb18769 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:02.500759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-053d0c93-ab22-40bc-a064-ec573fb18769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:02.528533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d0c93-ab22-40bc-a064-ec573fb18769 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:02.542879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:02.543766 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:02.544058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:02.544338 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] PATH_INFO: `/v3/projects/869f6f7fd5ac4d6d98a6c966e0d0204c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:02.546222 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=869f6f7fd5ac4d6d98a6c966e0d0204c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:02.548475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:02.607643 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f88ec88dc464807b966bc9fe0f17e56', 'request_id': 'req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:02.624991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f88ec88dc464807b966bc9fe0f17e56', 'request_id': 'req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:02.640564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f88ec88dc464807b966bc9fe0f17e56', 'request_id': 'req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:02.782214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869f6f7fd5ac4d6d98a6c966e0d0204c', 'request_id': 'req-d95af03c-56f1-41e1-834d-e5a8c4203b8b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:02.805884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] The token cache is being invalidate because project 3f88ec88dc464807b966bc9fe0f17e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:02.805884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:02.805884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:02.807942 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 845/1694] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:02 2022] DELETE /identity/v3/projects/3f88ec88dc464807b966bc9fe0f17e56 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:02.816965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:02.823624 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:02.836750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869f6f7fd5ac4d6d98a6c966e0d0204c', 'request_id': 'req-d95af03c-56f1-41e1-834d-e5a8c4203b8b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:02.862552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869f6f7fd5ac4d6d98a6c966e0d0204c', 'request_id': 'req-d95af03c-56f1-41e1-834d-e5a8c4203b8b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:02.986999 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] The token cache is being invalidate because project 869f6f7fd5ac4d6d98a6c966e0d0204c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:02.987189 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:02.992307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:03.006588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 850/1695] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:02 2022] DELETE /identity/v3/projects/869f6f7fd5ac4d6d98a6c966e0d0204c => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:03.009080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51ef3e-a5c4-49c0-a2dd-46d28e10ac1c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:03.015327 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:03.025987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:03.178939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:03.180332 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:03.180624 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:03.180907 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] PATH_INFO: `/v3/projects/007e7c6efe2c418b9f7f2791525326b8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:03.182674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] RBAC: Authorizing `identity:delete_project(project_id=007e7c6efe2c418b9f7f2791525326b8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:03.186601 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:03.331454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95af03c-56f1-41e1-834d-e5a8c4203b8b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:03.355936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac5d1a-ea9a-4daf-901a-10dc2716873b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:03.356980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac5d1a-ea9a-4daf-901a-10dc2716873b service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:03.357484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac5d1a-ea9a-4daf-901a-10dc2716873b service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:03.358844 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac5d1a-ea9a-4daf-901a-10dc2716873b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:03.361362 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c8ac5d1a-ea9a-4daf-901a-10dc2716873b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:03.434900 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007e7c6efe2c418b9f7f2791525326b8', 'request_id': 'req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:03.484088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007e7c6efe2c418b9f7f2791525326b8', 'request_id': 'req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:03.504375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007e7c6efe2c418b9f7f2791525326b8', 'request_id': 'req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:03.624201 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac5d1a-ea9a-4daf-901a-10dc2716873b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:03.627119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac5d1a-ea9a-4daf-901a-10dc2716873b service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:03.649432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] The token cache is being invalidate because project 007e7c6efe2c418b9f7f2791525326b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:03.649754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:03.652872 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:03.658084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 851/1696] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:03.663476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 846/1697] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:02 2022] DELETE /identity/v3/projects/007e7c6efe2c418b9f7f2791525326b8 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:03.664624 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:03.666477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:03.674670 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68807d58-ffed-4798-906a-687e17a45c94 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:03.675376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68807d58-ffed-4798-906a-687e17a45c94 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:03.675990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68807d58-ffed-4798-906a-687e17a45c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:03.743391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-68807d58-ffed-4798-906a-687e17a45c94 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:03.748258 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-68807d58-ffed-4798-906a-687e17a45c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:03.952797 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 852/1698] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:03.957102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68807d58-ffed-4798-906a-687e17a45c94 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:03.965578 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-68807d58-ffed-4798-906a-687e17a45c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:03.971410 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bea22c-e4ba-4cfd-be07-7cbdf4f6609f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:03.989400 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fb10f-0ace-4f04-8ea1-b19fb252278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:03.990754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb10f-0ace-4f04-8ea1-b19fb252278a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:03.991000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb10f-0ace-4f04-8ea1-b19fb252278a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:03.991539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb10f-0ace-4f04-8ea1-b19fb252278a admin admin] PATH_INFO: `/v3/users/7abdf406e2904ae89431301fc7ed37f2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:03.996664 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fb10f-0ace-4f04-8ea1-b19fb252278a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abdf406e2904ae89431301fc7ed37f2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:04.001116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fb10f-0ace-4f04-8ea1-b19fb252278a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:04.004145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68807d58-ffed-4798-906a-687e17a45c94 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:04.035161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ca54-8f38-4df9-9f7b-8133abdb9645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:04.037357 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ca54-8f38-4df9-9f7b-8133abdb9645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:04.040327 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ca54-8f38-4df9-9f7b-8133abdb9645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:04.042447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ca54-8f38-4df9-9f7b-8133abdb9645 admin admin] PATH_INFO: `/v3/projects/145f00ba10e646c3a31d2f8ced65c5fa` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:04.046917 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5ca54-8f38-4df9-9f7b-8133abdb9645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=145f00ba10e646c3a31d2f8ced65c5fa)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:04.055679 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5ca54-8f38-4df9-9f7b-8133abdb9645 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:04.313007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7d5fb10f-0ace-4f04-8ea1-b19fb252278a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abdf406e2904ae89431301fc7ed37f2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:04.343507 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1db5ca54-8f38-4df9-9f7b-8133abdb9645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '145f00ba10e646c3a31d2f8ced65c5fa', 'request_id': 'req-1db5ca54-8f38-4df9-9f7b-8133abdb9645'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:04.368885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1db5ca54-8f38-4df9-9f7b-8133abdb9645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '145f00ba10e646c3a31d2f8ced65c5fa', 'request_id': 'req-1db5ca54-8f38-4df9-9f7b-8133abdb9645'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:04.380228 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1db5ca54-8f38-4df9-9f7b-8133abdb9645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '145f00ba10e646c3a31d2f8ced65c5fa', 'request_id': 'req-1db5ca54-8f38-4df9-9f7b-8133abdb9645'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:04.423366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7d5fb10f-0ace-4f04-8ea1-b19fb252278a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abdf406e2904ae89431301fc7ed37f2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:04.431901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7d5fb10f-0ace-4f04-8ea1-b19fb252278a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abdf406e2904ae89431301fc7ed37f2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:04.433148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7d5fb10f-0ace-4f04-8ea1-b19fb252278a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abdf406e2904ae89431301fc7ed37f2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:04.436629 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7d5fb10f-0ace-4f04-8ea1-b19fb252278a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abdf406e2904ae89431301fc7ed37f2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:04.460429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 847/1699] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:03 2022] DELETE /identity/v3/users/7abdf406e2904ae89431301fc7ed37f2 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:04.461348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fb10f-0ace-4f04-8ea1-b19fb252278a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:04.462857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7d5fb10f-0ace-4f04-8ea1-b19fb252278a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:04.525925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1db5ca54-8f38-4df9-9f7b-8133abdb9645 admin admin] The token cache is being invalidate because project 145f00ba10e646c3a31d2f8ced65c5fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:04.533277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1db5ca54-8f38-4df9-9f7b-8133abdb9645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:04.533277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1db5ca54-8f38-4df9-9f7b-8133abdb9645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:04.533277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 853/1700] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:03 2022] DELETE /identity/v3/projects/145f00ba10e646c3a31d2f8ced65c5fa => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:04.533732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feae7c3-2d2f-41be-b21f-de8a956b36eb None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:04.534023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feae7c3-2d2f-41be-b21f-de8a956b36eb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:04.534308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feae7c3-2d2f-41be-b21f-de8a956b36eb None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:04.540319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 854/1701] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 11 21:05:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:05:04.541768 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b8765-d6b8-45aa-93c4-bbbf67d27203 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:04.542061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b8765-d6b8-45aa-93c4-bbbf67d27203 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:04.545184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b8765-d6b8-45aa-93c4-bbbf67d27203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:04.597045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-710b8765-d6b8-45aa-93c4-bbbf67d27203 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:04.600083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-710b8765-d6b8-45aa-93c4-bbbf67d27203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:04.643044 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fb10f-0ace-4f04-8ea1-b19fb252278a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:04.661999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fa332-45ef-4543-b842-3c3ad7a6e788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:04.664631 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fa332-45ef-4543-b842-3c3ad7a6e788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:04.668018 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fa332-45ef-4543-b842-3c3ad7a6e788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:04.669196 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fa332-45ef-4543-b842-3c3ad7a6e788 admin admin] PATH_INFO: `/v3/users/572b7aae75644cc5a800a9e25ba81de2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:04.674856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fa332-45ef-4543-b842-3c3ad7a6e788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=572b7aae75644cc5a800a9e25ba81de2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:04.686426 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fa332-45ef-4543-b842-3c3ad7a6e788 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:04.710600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 855/1702] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:04.715731 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba49e7-b925-4f4b-859d-62abbe567e1c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:04.716038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba49e7-b925-4f4b-859d-62abbe567e1c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:04.716337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba49e7-b925-4f4b-859d-62abbe567e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:04.770204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-35ba49e7-b925-4f4b-859d-62abbe567e1c None None] MFA Rules not processed for user `d7666a6299cc4c44ac7495ed00f137dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:04.771712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-35ba49e7-b925-4f4b-859d-62abbe567e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:04.900753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 856/1703] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:04.900753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674729b-3278-4d8b-b3f7-bc444812d839 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:04.900753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674729b-3278-4d8b-b3f7-bc444812d839 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:04.900753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674729b-3278-4d8b-b3f7-bc444812d839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:04.921949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6674729b-3278-4d8b-b3f7-bc444812d839 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:04.923458 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6674729b-3278-4d8b-b3f7-bc444812d839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:04.935261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 857/1704] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:04.945089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674729b-3278-4d8b-b3f7-bc444812d839 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:04.957433 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674729b-3278-4d8b-b3f7-bc444812d839 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:04.964439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b454e17-d5af-45a4-bf84-1fd826802d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:04.964952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b454e17-d5af-45a4-bf84-1fd826802d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:04.965341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b454e17-d5af-45a4-bf84-1fd826802d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:04.965751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b454e17-d5af-45a4-bf84-1fd826802d59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:04.966693 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b454e17-d5af-45a4-bf84-1fd826802d59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:04.966818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-380fa332-45ef-4543-b842-3c3ad7a6e788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '572b7aae75644cc5a800a9e25ba81de2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:04.967208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b454e17-d5af-45a4-bf84-1fd826802d59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:04.969543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b454e17-d5af-45a4-bf84-1fd826802d59 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:04.989677 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 858/1705] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:05:04.991583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97d619-ab6c-47c2-892f-4594c164c41d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:04.991978 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97d619-ab6c-47c2-892f-4594c164c41d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:04.992413 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97d619-ab6c-47c2-892f-4594c164c41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:05.027472 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7c97d619-ab6c-47c2-892f-4594c164c41d None None] MFA Rules not processed for user `f400b94d3fbc40bdace4860fe83a0891`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:05.029555 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7c97d619-ab6c-47c2-892f-4594c164c41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:05.070904 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-380fa332-45ef-4543-b842-3c3ad7a6e788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '572b7aae75644cc5a800a9e25ba81de2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:05.095134 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-380fa332-45ef-4543-b842-3c3ad7a6e788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '572b7aae75644cc5a800a9e25ba81de2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:05.096665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-380fa332-45ef-4543-b842-3c3ad7a6e788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '572b7aae75644cc5a800a9e25ba81de2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:05.099082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-380fa332-45ef-4543-b842-3c3ad7a6e788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '572b7aae75644cc5a800a9e25ba81de2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:05.157187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 859/1706] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 11 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:05.159631 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97d619-ab6c-47c2-892f-4594c164c41d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:05.163884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7c97d619-ab6c-47c2-892f-4594c164c41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:05.173711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 848/1707] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:04 2022] DELETE /identity/v3/users/572b7aae75644cc5a800a9e25ba81de2 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:05.181685 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9d27d-c3a5-4636-a672-82099e06c94f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:05.182123 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9d27d-c3a5-4636-a672-82099e06c94f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:05.182419 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9d27d-c3a5-4636-a672-82099e06c94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:05.193661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97d619-ab6c-47c2-892f-4594c164c41d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:05.255323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a9e9d27d-c3a5-4636-a672-82099e06c94f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:05.260362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a9e9d27d-c3a5-4636-a672-82099e06c94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:05.384217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40caf9-d282-4c0c-992a-f44b0991250e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:05.384964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40caf9-d282-4c0c-992a-f44b0991250e service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:05.385350 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40caf9-d282-4c0c-992a-f44b0991250e service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:05.385762 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40caf9-d282-4c0c-992a-f44b0991250e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:05.388872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6c40caf9-d282-4c0c-992a-f44b0991250e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:05.534209 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40caf9-d282-4c0c-992a-f44b0991250e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:05.536089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c40caf9-d282-4c0c-992a-f44b0991250e service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:05.548596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 860/1708] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:05.549679 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40caf9-d282-4c0c-992a-f44b0991250e service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:05.550232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 849/1709] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:05.554108 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9d27d-c3a5-4636-a672-82099e06c94f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:05.554108 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a9e9d27d-c3a5-4636-a672-82099e06c94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:05.556590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6c40caf9-d282-4c0c-992a-f44b0991250e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:05.586676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40caf9-d282-4c0c-992a-f44b0991250e service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:05.586848 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9d27d-c3a5-4636-a672-82099e06c94f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:05.598108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d78ce-a71c-4f6e-9dc6-5aaaada08832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:05.598881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d78ce-a71c-4f6e-9dc6-5aaaada08832 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:05.599371 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d78ce-a71c-4f6e-9dc6-5aaaada08832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:05.600384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba758c-064e-44de-85a5-6af452d154e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:05.600707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d78ce-a71c-4f6e-9dc6-5aaaada08832 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:05.601062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba758c-064e-44de-85a5-6af452d154e6 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:05.601356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba758c-064e-44de-85a5-6af452d154e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:05.601724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba758c-064e-44de-85a5-6af452d154e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:05.602124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d78ce-a71c-4f6e-9dc6-5aaaada08832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:05.604932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d78ce-a71c-4f6e-9dc6-5aaaada08832 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:05.628498 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba758c-064e-44de-85a5-6af452d154e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:05.631400 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba758c-064e-44de-85a5-6af452d154e6 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:05.648124 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 850/1710] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:05.649063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba758c-064e-44de-85a5-6af452d154e6 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:05.674218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba758c-064e-44de-85a5-6af452d154e6 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:05.687366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553af2ea-2c40-49fe-bb79-31f5bf5285eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:05.692280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553af2ea-2c40-49fe-bb79-31f5bf5285eb admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:05.692280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553af2ea-2c40-49fe-bb79-31f5bf5285eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:05.692280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553af2ea-2c40-49fe-bb79-31f5bf5285eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:05.692280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553af2ea-2c40-49fe-bb79-31f5bf5285eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:05.692280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553af2ea-2c40-49fe-bb79-31f5bf5285eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:05.692280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553af2ea-2c40-49fe-bb79-31f5bf5285eb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:05.724036 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 851/1711] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:05:05.730766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553af2ea-2c40-49fe-bb79-31f5bf5285eb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:05.735336 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-553af2ea-2c40-49fe-bb79-31f5bf5285eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:05.767645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 861/1712] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:05 2022] POST /identity/v3/projects => generated 365 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:05.774828 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d78ce-a71c-4f6e-9dc6-5aaaada08832 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:05.788216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553af2ea-2c40-49fe-bb79-31f5bf5285eb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:05.943616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d78ce-a71c-4f6e-9dc6-5aaaada08832 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:05.949575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6eb056-4fc3-49a1-9b7b-942a54d5b971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:05.953512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6eb056-4fc3-49a1-9b7b-942a54d5b971 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:05.953512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6eb056-4fc3-49a1-9b7b-942a54d5b971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:05.953512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6eb056-4fc3-49a1-9b7b-942a54d5b971 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:05.953512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6eb056-4fc3-49a1-9b7b-942a54d5b971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:05.957568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6eb056-4fc3-49a1-9b7b-942a54d5b971 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:05.974291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:05.975232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:05.975519 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:05.975797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] PATH_INFO: `/v3/projects/ee6862c9a3d9421eb6e4ffd1e9ee307c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:05.982607 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6862c9a3d9421eb6e4ffd1e9ee307c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:05.985221 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:06.080748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 862/1713] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:05 2022] POST /identity/v3/projects => generated 373 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:06.080748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6eb056-4fc3-49a1-9b7b-942a54d5b971 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:06.164674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6862c9a3d9421eb6e4ffd1e9ee307c', 'request_id': 'req-69907c40-84e2-4c8d-8673-b3aab0b116d4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:06.180454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6862c9a3d9421eb6e4ffd1e9ee307c', 'request_id': 'req-69907c40-84e2-4c8d-8673-b3aab0b116d4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:06.203343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6862c9a3d9421eb6e4ffd1e9ee307c', 'request_id': 'req-69907c40-84e2-4c8d-8673-b3aab0b116d4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:06.348530 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] The token cache is being invalidate because project ee6862c9a3d9421eb6e4ffd1e9ee307c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:06.349072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:06.349976 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:06.352000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 852/1714] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:05 2022] DELETE /identity/v3/projects/ee6862c9a3d9421eb6e4ffd1e9ee307c => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:06.352946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:06.354473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:06.404214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6eb056-4fc3-49a1-9b7b-942a54d5b971 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:06.500328 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69907c40-84e2-4c8d-8673-b3aab0b116d4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:06.514778 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f1a31-45de-4e07-85ac-16411ac7f757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:06.515524 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f1a31-45de-4e07-85ac-16411ac7f757 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:06.515805 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f1a31-45de-4e07-85ac-16411ac7f757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:06.516156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f1a31-45de-4e07-85ac-16411ac7f757 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:06.516925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f1a31-45de-4e07-85ac-16411ac7f757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:06.518873 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74847096-0cf9-430d-a24b-515d711616fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:06.520317 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74847096-0cf9-430d-a24b-515d711616fd admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:06.522571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74847096-0cf9-430d-a24b-515d711616fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:06.523269 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74847096-0cf9-430d-a24b-515d711616fd admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:06.524331 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74847096-0cf9-430d-a24b-515d711616fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:06.528660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f1a31-45de-4e07-85ac-16411ac7f757 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:06.531896 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74847096-0cf9-430d-a24b-515d711616fd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:06.653925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 863/1715] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:06 2022] POST /identity/v3/users => generated 283 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:06.656077 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38064399-6aa7-4f67-a9ba-2ad4ae915b12 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:06.661126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 853/1716] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:06 2022] POST /identity/v3/users => generated 287 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:06.665492 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f1a31-45de-4e07-85ac-16411ac7f757 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:06.669669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a36f1a31-45de-4e07-85ac-16411ac7f757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:06.676166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38064399-6aa7-4f67-a9ba-2ad4ae915b12 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:06.679619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38064399-6aa7-4f67-a9ba-2ad4ae915b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:06.703260 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-38064399-6aa7-4f67-a9ba-2ad4ae915b12 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:06.704689 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-38064399-6aa7-4f67-a9ba-2ad4ae915b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:06.710821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f1a31-45de-4e07-85ac-16411ac7f757 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:06.718972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45921e0c-38ca-42f5-98ba-b7ed86f705db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:06.725500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45921e0c-38ca-42f5-98ba-b7ed86f705db admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:06.725500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45921e0c-38ca-42f5-98ba-b7ed86f705db admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:06.725500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45921e0c-38ca-42f5-98ba-b7ed86f705db admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:06.725500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45921e0c-38ca-42f5-98ba-b7ed86f705db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:06.725500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45921e0c-38ca-42f5-98ba-b7ed86f705db admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:06.730961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 864/1717] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:06.732535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38064399-6aa7-4f67-a9ba-2ad4ae915b12 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:06.747930 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 854/1718] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:06.751708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f013b-d248-43bd-8b60-ac54ea908c8b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:06.752027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f013b-d248-43bd-8b60-ac54ea908c8b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:06.752312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f013b-d248-43bd-8b60-ac54ea908c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:06.757435 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38064399-6aa7-4f67-a9ba-2ad4ae915b12 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:06.766575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcc4aa-d58c-445c-884c-1b6e7f3fb762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:06.768103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcc4aa-d58c-445c-884c-1b6e7f3fb762 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:06.768804 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcc4aa-d58c-445c-884c-1b6e7f3fb762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:06.769381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcc4aa-d58c-445c-884c-1b6e7f3fb762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:06.772234 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcc4aa-d58c-445c-884c-1b6e7f3fb762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:06.774921 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcc4aa-d58c-445c-884c-1b6e7f3fb762 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:06.793244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 865/1719] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:06.794361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcc4aa-d58c-445c-884c-1b6e7f3fb762 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:06.803136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4a7f013b-d248-43bd-8b60-ac54ea908c8b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:06.804480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4a7f013b-d248-43bd-8b60-ac54ea908c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:06.820980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcc4aa-d58c-445c-884c-1b6e7f3fb762 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:06.827751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c3106-04f8-434e-8178-6d9b5bbe49f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:06.829054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c3106-04f8-434e-8178-6d9b5bbe49f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:06.829441 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c3106-04f8-434e-8178-6d9b5bbe49f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:06.830078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c3106-04f8-434e-8178-6d9b5bbe49f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:06.831076 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c3106-04f8-434e-8178-6d9b5bbe49f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:06.833081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c3106-04f8-434e-8178-6d9b5bbe49f4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:06.849880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 866/1720] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:06.850986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c3106-04f8-434e-8178-6d9b5bbe49f4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:06.855136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 855/1721] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:06.855907 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f013b-d248-43bd-8b60-ac54ea908c8b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:06.857420 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4a7f013b-d248-43bd-8b60-ac54ea908c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:06.875846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c3106-04f8-434e-8178-6d9b5bbe49f4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:06.884155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f013b-d248-43bd-8b60-ac54ea908c8b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:06.884534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272e335-7f0a-4a53-95f5-d870864a3cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:06.886244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272e335-7f0a-4a53-95f5-d870864a3cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:06.886722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272e335-7f0a-4a53-95f5-d870864a3cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:06.887110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272e335-7f0a-4a53-95f5-d870864a3cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:06.887925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272e335-7f0a-4a53-95f5-d870864a3cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:06.889722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272e335-7f0a-4a53-95f5-d870864a3cc0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:06.904028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:06.904028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:06.904028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:06.904028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] PATH_INFO: `/v3/projects/ba7998520735479daa91f03340455e8c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:06.924327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba7998520735479daa91f03340455e8c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:06.926256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:06.943791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 867/1722] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:06.944850 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272e335-7f0a-4a53-95f5-d870864a3cc0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:06.963932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272e335-7f0a-4a53-95f5-d870864a3cc0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:06.978149 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0fc1d-8f2e-477d-91d1-29a0f2321a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:06.980298 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0fc1d-8f2e-477d-91d1-29a0f2321a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:06.980592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0fc1d-8f2e-477d-91d1-29a0f2321a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:06.980899 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0fc1d-8f2e-477d-91d1-29a0f2321a6d admin admin] PATH_INFO: `/v3/projects/5235dc9cf70d4bf5b9f6e77a9b4d7927/users/83686c3cce074976849dbf415b016772/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:07.000436 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0fc1d-8f2e-477d-91d1-29a0f2321a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5235dc9cf70d4bf5b9f6e77a9b4d7927, user_id=83686c3cce074976849dbf415b016772, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:07.004198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0fc1d-8f2e-477d-91d1-29a0f2321a6d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:07.132276 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 868/1723] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:06 2022] PUT /identity/v3/projects/5235dc9cf70d4bf5b9f6e77a9b4d7927/users/83686c3cce074976849dbf415b016772/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:07.133735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0fc1d-8f2e-477d-91d1-29a0f2321a6d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:07.158066 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba7998520735479daa91f03340455e8c', 'request_id': 'req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:07.169872 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba7998520735479daa91f03340455e8c', 'request_id': 'req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:07.186700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba7998520735479daa91f03340455e8c', 'request_id': 'req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:07.281347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] The token cache is being invalidate because project ba7998520735479daa91f03340455e8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:07.284344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:07.284827 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:07.287905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 856/1724] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:06 2022] DELETE /identity/v3/projects/ba7998520735479daa91f03340455e8c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:07.289028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:07.296709 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:07.393800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0fc1d-8f2e-477d-91d1-29a0f2321a6d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:07.471577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da59203-c6fd-4dac-8c9a-1fce717aaf8a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:07.489416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f73a79-e559-4fdf-b1ad-115bd868229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:07.490614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73a79-e559-4fdf-b1ad-115bd868229d admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:07.491100 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73a79-e559-4fdf-b1ad-115bd868229d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:07.491633 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73a79-e559-4fdf-b1ad-115bd868229d admin admin] PATH_INFO: `/v3/projects/6a0b482c747a4034847a0fd358200082/users/1995309e781f43e1aa8ca7aa15718f63/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:07.508970 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f73a79-e559-4fdf-b1ad-115bd868229d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0b482c747a4034847a0fd358200082, user_id=1995309e781f43e1aa8ca7aa15718f63, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:07.512146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f73a79-e559-4fdf-b1ad-115bd868229d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:07.553632 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa70668-b6dd-4e02-836f-bdd8d0e25bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:07.554540 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa70668-b6dd-4e02-836f-bdd8d0e25bfe admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:07.555057 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa70668-b6dd-4e02-836f-bdd8d0e25bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:07.555155 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa70668-b6dd-4e02-836f-bdd8d0e25bfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:07.555840 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa70668-b6dd-4e02-836f-bdd8d0e25bfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:07.556307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa70668-b6dd-4e02-836f-bdd8d0e25bfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:07.558921 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa70668-b6dd-4e02-836f-bdd8d0e25bfe admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:07.590313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 869/1725] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:05:07.591754 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dae0d9-3a95-4982-9927-aaed1b096f91 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:07.592562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dae0d9-3a95-4982-9927-aaed1b096f91 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:07.592895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dae0d9-3a95-4982-9927-aaed1b096f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:07.635404 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 857/1726] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:07 2022] PUT /identity/v3/projects/6a0b482c747a4034847a0fd358200082/users/1995309e781f43e1aa8ca7aa15718f63/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:07.637511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf237668-85ed-4280-b80d-f9087dd843df None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:07.637979 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf237668-85ed-4280-b80d-f9087dd843df None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:07.639447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf237668-85ed-4280-b80d-f9087dd843df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:07.646785 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-83dae0d9-3a95-4982-9927-aaed1b096f91 None None] MFA Rules not processed for user `83686c3cce074976849dbf415b016772`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:07.648078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-83dae0d9-3a95-4982-9927-aaed1b096f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:07.673662 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bf237668-85ed-4280-b80d-f9087dd843df None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:07.680514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bf237668-85ed-4280-b80d-f9087dd843df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:07.797068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 870/1727] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:07.800685 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dae0d9-3a95-4982-9927-aaed1b096f91 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:07.802356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-83dae0d9-3a95-4982-9927-aaed1b096f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:07.815755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 858/1728] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:07.818181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c2727-314e-4ac3-bc30-8bc17d7e0d72 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:07.818479 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c2727-314e-4ac3-bc30-8bc17d7e0d72 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:07.825841 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c2727-314e-4ac3-bc30-8bc17d7e0d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:07.880338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4e0c2727-314e-4ac3-bc30-8bc17d7e0d72 None None] MFA Rules not processed for user `1995309e781f43e1aa8ca7aa15718f63`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:07.889909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4e0c2727-314e-4ac3-bc30-8bc17d7e0d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:07.979277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dae0d9-3a95-4982-9927-aaed1b096f91 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:07.989310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109537a3-5fa1-48b5-941d-fa470747ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:07.990266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109537a3-5fa1-48b5-941d-fa470747ed1f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:07.990559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109537a3-5fa1-48b5-941d-fa470747ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:07.990955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109537a3-5fa1-48b5-941d-fa470747ed1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:07.991650 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109537a3-5fa1-48b5-941d-fa470747ed1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:07.999910 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109537a3-5fa1-48b5-941d-fa470747ed1f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:08.065974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 859/1729] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:08.067451 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c2727-314e-4ac3-bc30-8bc17d7e0d72 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:08.070312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4e0c2727-314e-4ac3-bc30-8bc17d7e0d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:08.099438 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c2727-314e-4ac3-bc30-8bc17d7e0d72 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:08.116521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbeba31-2b7d-4164-84e7-94c4264e436d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:08.117353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeba31-2b7d-4164-84e7-94c4264e436d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:08.117703 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeba31-2b7d-4164-84e7-94c4264e436d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:08.117934 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeba31-2b7d-4164-84e7-94c4264e436d admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:08.118744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbeba31-2b7d-4164-84e7-94c4264e436d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:08.120749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbeba31-2b7d-4164-84e7-94c4264e436d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:08.167146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 871/1730] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:07 2022] POST /identity/v3/projects => generated 371 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:08.174055 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c35ed-573e-40b4-97cf-827d9d666a46 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:08.174349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c35ed-573e-40b4-97cf-827d9d666a46 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:08.174679 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c35ed-573e-40b4-97cf-827d9d666a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:08.220753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b20c35ed-573e-40b4-97cf-827d9d666a46 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:08.223051 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b20c35ed-573e-40b4-97cf-827d9d666a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:08.224849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 860/1731] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:08 2022] POST /identity/v3/projects => generated 363 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:08.225905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbeba31-2b7d-4164-84e7-94c4264e436d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:08.358932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbeba31-2b7d-4164-84e7-94c4264e436d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:08.367727 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec77233-b982-48d8-a5b5-b60bde8359e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:08.371972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec77233-b982-48d8-a5b5-b60bde8359e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:08.371972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec77233-b982-48d8-a5b5-b60bde8359e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:08.371972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec77233-b982-48d8-a5b5-b60bde8359e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:08.371972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec77233-b982-48d8-a5b5-b60bde8359e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:08.372401 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec77233-b982-48d8-a5b5-b60bde8359e7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:08.374840 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 872/1732] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:08.376075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c35ed-573e-40b4-97cf-827d9d666a46 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:08.402389 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c35ed-573e-40b4-97cf-827d9d666a46 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:08.418469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47baa26-5e1c-4e38-9603-cde4042a354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:08.419406 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47baa26-5e1c-4e38-9603-cde4042a354a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:08.419696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47baa26-5e1c-4e38-9603-cde4042a354a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:08.423914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47baa26-5e1c-4e38-9603-cde4042a354a admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:08.423914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47baa26-5e1c-4e38-9603-cde4042a354a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:08.423914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47baa26-5e1c-4e38-9603-cde4042a354a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:08.494468 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 861/1733] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:08 2022] POST /identity/v3/projects => generated 373 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:08.495322 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec77233-b982-48d8-a5b5-b60bde8359e7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:08.543068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 873/1734] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:08 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:08.543866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47baa26-5e1c-4e38-9603-cde4042a354a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:08.580028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47baa26-5e1c-4e38-9603-cde4042a354a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:08.703279 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec77233-b982-48d8-a5b5-b60bde8359e7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:08.712089 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175be83-4e39-49d7-83c3-12f7779ab0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:08.713331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175be83-4e39-49d7-83c3-12f7779ab0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:08.713602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175be83-4e39-49d7-83c3-12f7779ab0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:08.713923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175be83-4e39-49d7-83c3-12f7779ab0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:08.714785 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175be83-4e39-49d7-83c3-12f7779ab0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:08.717922 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175be83-4e39-49d7-83c3-12f7779ab0e7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:08.749997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15711c-640f-46ca-a034-344693add1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:08.750964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15711c-640f-46ca-a034-344693add1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:08.751978 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15711c-640f-46ca-a034-344693add1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:08.753121 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15711c-640f-46ca-a034-344693add1bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:08.754373 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15711c-640f-46ca-a034-344693add1bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:08.755232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15711c-640f-46ca-a034-344693add1bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:08.758237 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15711c-640f-46ca-a034-344693add1bc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:08.787371 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 874/1735] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:05:08.788657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15711c-640f-46ca-a034-344693add1bc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:08.807088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15711c-640f-46ca-a034-344693add1bc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:08.820930 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d3f8d-f717-4e98-bda5-a673d48f81d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:08.820930 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3f8d-f717-4e98-bda5-a673d48f81d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:08.823634 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3f8d-f717-4e98-bda5-a673d48f81d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:08.823634 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3f8d-f717-4e98-bda5-a673d48f81d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:08.823634 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d3f8d-f717-4e98-bda5-a673d48f81d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:08.829673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d3f8d-f717-4e98-bda5-a673d48f81d6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:08.861974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 862/1736] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:08 2022] POST /identity/v3/users => generated 288 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:08.861974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175be83-4e39-49d7-83c3-12f7779ab0e7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:08.883468 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175be83-4e39-49d7-83c3-12f7779ab0e7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:08.895248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1932b83-8377-4055-bbae-b010e0c4c54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:08.896552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932b83-8377-4055-bbae-b010e0c4c54f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:08.898914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932b83-8377-4055-bbae-b010e0c4c54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:08.899373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932b83-8377-4055-bbae-b010e0c4c54f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:08.900194 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1932b83-8377-4055-bbae-b010e0c4c54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:08.908094 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1932b83-8377-4055-bbae-b010e0c4c54f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:08.951009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 863/1737] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:08.953096 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1932b83-8377-4055-bbae-b010e0c4c54f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:08.980466 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 875/1738] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:08 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:08.983460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d3f8d-f717-4e98-bda5-a673d48f81d6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:09.019579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1932b83-8377-4055-bbae-b010e0c4c54f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:09.023393 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d3f8d-f717-4e98-bda5-a673d48f81d6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:09.049143 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4596f59-9021-4554-bd7d-7ad7c00ba369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:09.051770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4596f59-9021-4554-bd7d-7ad7c00ba369 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:09.052906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc46ee-3017-4a57-b20b-47881480de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:09.054223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc46ee-3017-4a57-b20b-47881480de76 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:09.054860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4596f59-9021-4554-bd7d-7ad7c00ba369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:09.055419 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4596f59-9021-4554-bd7d-7ad7c00ba369 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:09.055981 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc46ee-3017-4a57-b20b-47881480de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:09.057126 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc46ee-3017-4a57-b20b-47881480de76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:09.058653 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4596f59-9021-4554-bd7d-7ad7c00ba369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:09.059318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc46ee-3017-4a57-b20b-47881480de76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:09.064813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4596f59-9021-4554-bd7d-7ad7c00ba369 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:09.068050 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc46ee-3017-4a57-b20b-47881480de76 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:09.113810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 876/1739] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:09.113810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc46ee-3017-4a57-b20b-47881480de76 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:09.149024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc46ee-3017-4a57-b20b-47881480de76 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:09.166555 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ce3b7-52df-4912-852c-cf2ff573b9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:09.170192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ce3b7-52df-4912-852c-cf2ff573b9ba admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:09.171625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ce3b7-52df-4912-852c-cf2ff573b9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:09.176714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ce3b7-52df-4912-852c-cf2ff573b9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:09.176714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ce3b7-52df-4912-852c-cf2ff573b9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:09.176714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ce3b7-52df-4912-852c-cf2ff573b9ba admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:09.205309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 864/1740] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:08 2022] POST /identity/v3/projects => generated 381 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:09.206696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4596f59-9021-4554-bd7d-7ad7c00ba369 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:09.230233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 877/1741] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:09.230233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ce3b7-52df-4912-852c-cf2ff573b9ba admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:09.256562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ce3b7-52df-4912-852c-cf2ff573b9ba admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:09.404797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4596f59-9021-4554-bd7d-7ad7c00ba369 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:09.415262 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dc04d-6202-427f-8ac9-4de9545b3bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:09.415961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dc04d-6202-427f-8ac9-4de9545b3bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:09.416245 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dc04d-6202-427f-8ac9-4de9545b3bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:09.416524 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dc04d-6202-427f-8ac9-4de9545b3bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:09.417353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55dc04d-6202-427f-8ac9-4de9545b3bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:09.419043 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55dc04d-6202-427f-8ac9-4de9545b3bc5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:09.461904 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674f4f0-97d1-466e-92bb-42a1190e0ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:09.463428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674f4f0-97d1-466e-92bb-42a1190e0ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:09.463945 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674f4f0-97d1-466e-92bb-42a1190e0ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:09.464416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674f4f0-97d1-466e-92bb-42a1190e0ff9 admin admin] PATH_INFO: `/v3/projects/e2eaec42d9284f888dac14659fee3418/users/7eb207b48c6e4322a19af8db3631cc0f/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:09.466315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 865/1742] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:09.467909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dc04d-6202-427f-8ac9-4de9545b3bc5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:09.504772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dc04d-6202-427f-8ac9-4de9545b3bc5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:09.527046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674f4f0-97d1-466e-92bb-42a1190e0ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2eaec42d9284f888dac14659fee3418, user_id=7eb207b48c6e4322a19af8db3631cc0f, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:09.531274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674f4f0-97d1-466e-92bb-42a1190e0ff9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:09.532165 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9454a-10c2-404e-af85-a9760f9316bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:09.533034 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9454a-10c2-404e-af85-a9760f9316bd admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:09.533456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9454a-10c2-404e-af85-a9760f9316bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:09.533888 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9454a-10c2-404e-af85-a9760f9316bd admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:09.534747 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9454a-10c2-404e-af85-a9760f9316bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:09.539472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9454a-10c2-404e-af85-a9760f9316bd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:09.677847 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 878/1743] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:09 2022] PUT /identity/v3/projects/e2eaec42d9284f888dac14659fee3418/users/7eb207b48c6e4322a19af8db3631cc0f/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:09.679305 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674f4f0-97d1-466e-92bb-42a1190e0ff9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:09.727519 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 866/1744] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:09 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:09.728888 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9454a-10c2-404e-af85-a9760f9316bd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:09.783874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9454a-10c2-404e-af85-a9760f9316bd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:09.863419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674f4f0-97d1-466e-92bb-42a1190e0ff9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:09.868735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139e596-7be2-4d60-ad6f-8518bb8c842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:09.869581 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139e596-7be2-4d60-ad6f-8518bb8c842e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:09.869855 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139e596-7be2-4d60-ad6f-8518bb8c842e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:09.870132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139e596-7be2-4d60-ad6f-8518bb8c842e admin admin] PATH_INFO: `/v3/projects/becf69a081a94daab8520756bf063386/users/81f7b0467e004b32add6caf0f8d5ccbc/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:09.902795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce5c50-d026-40b6-a12a-15cec9fa4415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:09.903358 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5c50-d026-40b6-a12a-15cec9fa4415 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:09.903657 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5c50-d026-40b6-a12a-15cec9fa4415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:09.904230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce5c50-d026-40b6-a12a-15cec9fa4415 admin admin] PATH_INFO: `/v3/projects/c976e2576e7841fdb39f8b8825caa68b/users/0ed76163fa02423a89676a7f54c7c499/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:09.927225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce5c50-d026-40b6-a12a-15cec9fa4415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c976e2576e7841fdb39f8b8825caa68b, user_id=0ed76163fa02423a89676a7f54c7c499, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:09.929943 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139e596-7be2-4d60-ad6f-8518bb8c842e admin admin] RBAC: Authorizing `identity:create_grant(project_id=becf69a081a94daab8520756bf063386, user_id=81f7b0467e004b32add6caf0f8d5ccbc, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:09.930736 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce5c50-d026-40b6-a12a-15cec9fa4415 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:09.932679 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139e596-7be2-4d60-ad6f-8518bb8c842e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:10.023889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 867/1745] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:09 2022] PUT /identity/v3/projects/c976e2576e7841fdb39f8b8825caa68b/users/0ed76163fa02423a89676a7f54c7c499/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:10.025188 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce5c50-d026-40b6-a12a-15cec9fa4415 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:10.051996 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 879/1746] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:09 2022] PUT /identity/v3/projects/becf69a081a94daab8520756bf063386/users/81f7b0467e004b32add6caf0f8d5ccbc/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:10.056276 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139e596-7be2-4d60-ad6f-8518bb8c842e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:10.210132 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce5c50-d026-40b6-a12a-15cec9fa4415 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:10.216610 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf60219-e0ca-45f7-bd46-936c88ab4999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:10.216610 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf60219-e0ca-45f7-bd46-936c88ab4999 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:10.217847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf60219-e0ca-45f7-bd46-936c88ab4999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:10.218140 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf60219-e0ca-45f7-bd46-936c88ab4999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:10.218883 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf60219-e0ca-45f7-bd46-936c88ab4999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:10.220784 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139e596-7be2-4d60-ad6f-8518bb8c842e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:10.223135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf60219-e0ca-45f7-bd46-936c88ab4999 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:10.248641 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 868/1747] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:10.251150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf60219-e0ca-45f7-bd46-936c88ab4999 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:10.258212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda5040-0282-4fea-b0e5-30b8f5a702b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:10.258902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda5040-0282-4fea-b0e5-30b8f5a702b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:10.259186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda5040-0282-4fea-b0e5-30b8f5a702b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:10.259461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda5040-0282-4fea-b0e5-30b8f5a702b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:10.260193 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda5040-0282-4fea-b0e5-30b8f5a702b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:10.266186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda5040-0282-4fea-b0e5-30b8f5a702b9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:10.277626 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf60219-e0ca-45f7-bd46-936c88ab4999 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:10.286396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b86c6-0fc3-48ca-a334-710e151f68e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:10.287590 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b86c6-0fc3-48ca-a334-710e151f68e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:10.288209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b86c6-0fc3-48ca-a334-710e151f68e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:10.289255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b86c6-0fc3-48ca-a334-710e151f68e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:10.290827 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b86c6-0fc3-48ca-a334-710e151f68e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:10.301670 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b86c6-0fc3-48ca-a334-710e151f68e3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:10.304301 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 880/1748] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:10.310838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d675e3-3ac6-4bd5-8db8-c7fbde80985b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:10.311600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d675e3-3ac6-4bd5-8db8-c7fbde80985b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:10.312933 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d675e3-3ac6-4bd5-8db8-c7fbde80985b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:10.334277 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 869/1749] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:10.340084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec87294-0a3d-45fb-980e-883f7e972195 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:10.340412 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec87294-0a3d-45fb-980e-883f7e972195 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:10.340689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec87294-0a3d-45fb-980e-883f7e972195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:10.432062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7ec87294-0a3d-45fb-980e-883f7e972195 None None] MFA Rules not processed for user `f9968edcee104432ade2014e39683bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:10.433109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e9d675e3-3ac6-4bd5-8db8-c7fbde80985b None None] MFA Rules not processed for user `81f7b0467e004b32add6caf0f8d5ccbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:10.435253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e9d675e3-3ac6-4bd5-8db8-c7fbde80985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:10.438962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7ec87294-0a3d-45fb-980e-883f7e972195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:10.531114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 870/1750] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:10.532437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec87294-0a3d-45fb-980e-883f7e972195 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:10.547372 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec87294-0a3d-45fb-980e-883f7e972195 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:10.553653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 881/1751] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:10.554703 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d675e3-3ac6-4bd5-8db8-c7fbde80985b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:10.556241 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b425b6-984c-45a0-896e-05188dd504d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:10.557587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b425b6-984c-45a0-896e-05188dd504d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:10.558103 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b425b6-984c-45a0-896e-05188dd504d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:10.558600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b425b6-984c-45a0-896e-05188dd504d2 admin admin] PATH_INFO: `/v3/projects/e2eaec42d9284f888dac14659fee3418/users/7eb207b48c6e4322a19af8db3631cc0f/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:10.562419 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b425b6-984c-45a0-896e-05188dd504d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2eaec42d9284f888dac14659fee3418, user_id=7eb207b48c6e4322a19af8db3631cc0f, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:10.565992 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b425b6-984c-45a0-896e-05188dd504d2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:10.567156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d675e3-3ac6-4bd5-8db8-c7fbde80985b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:10.572883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bc352-a440-4e73-906d-5edfa61e434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:10.573665 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc352-a440-4e73-906d-5edfa61e434e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:10.573883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc352-a440-4e73-906d-5edfa61e434e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:10.574158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bc352-a440-4e73-906d-5edfa61e434e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:10.575146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bc352-a440-4e73-906d-5edfa61e434e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:10.581023 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 871/1752] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:10 2022] PUT /identity/v3/projects/e2eaec42d9284f888dac14659fee3418/users/7eb207b48c6e4322a19af8db3631cc0f/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:10.582514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b425b6-984c-45a0-896e-05188dd504d2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:10.585941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bc352-a440-4e73-906d-5edfa61e434e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:10.607390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 882/1753] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:10.609120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bc352-a440-4e73-906d-5edfa61e434e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:10.632603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bc352-a440-4e73-906d-5edfa61e434e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:10.718716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd2519-e236-41e3-ac0d-8b7e7ade6d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:10.719549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd2519-e236-41e3-ac0d-8b7e7ade6d1e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:10.719933 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd2519-e236-41e3-ac0d-8b7e7ade6d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:10.720312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd2519-e236-41e3-ac0d-8b7e7ade6d1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:10.721279 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd2519-e236-41e3-ac0d-8b7e7ade6d1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:10.723428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd2519-e236-41e3-ac0d-8b7e7ade6d1e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:10.782500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b425b6-984c-45a0-896e-05188dd504d2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:10.801812 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb8abb-d375-4130-bf46-284a1fb7d507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:10.802777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb8abb-d375-4130-bf46-284a1fb7d507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:10.803038 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb8abb-d375-4130-bf46-284a1fb7d507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:10.803338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb8abb-d375-4130-bf46-284a1fb7d507 admin admin] PATH_INFO: `/v3/projects/c976e2576e7841fdb39f8b8825caa68b/users/0ed76163fa02423a89676a7f54c7c499/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:10.807062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb8abb-d375-4130-bf46-284a1fb7d507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c976e2576e7841fdb39f8b8825caa68b, user_id=0ed76163fa02423a89676a7f54c7c499, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:10.809807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb8abb-d375-4130-bf46-284a1fb7d507 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:10.850450 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 872/1754] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:10 2022] PUT /identity/v3/projects/c976e2576e7841fdb39f8b8825caa68b/users/0ed76163fa02423a89676a7f54c7c499/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:10.863955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9ebac-9e3d-48a8-8607-ccfd9653740a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:10.864374 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9ebac-9e3d-48a8-8607-ccfd9653740a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:10.865026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9ebac-9e3d-48a8-8607-ccfd9653740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:10.872556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 883/1755] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:10 2022] POST /identity/v3/projects => generated 371 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:10.875107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd2519-e236-41e3-ac0d-8b7e7ade6d1e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:10.954892 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7eb9ebac-9e3d-48a8-8607-ccfd9653740a None None] MFA Rules not processed for user `7eb207b48c6e4322a19af8db3631cc0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:10.958769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7eb9ebac-9e3d-48a8-8607-ccfd9653740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:11.016226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd2519-e236-41e3-ac0d-8b7e7ade6d1e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:11.023248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367b7b3-2beb-4ce3-b8ee-ef0b8682e235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:11.024357 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367b7b3-2beb-4ce3-b8ee-ef0b8682e235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:11.024763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367b7b3-2beb-4ce3-b8ee-ef0b8682e235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:11.025223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367b7b3-2beb-4ce3-b8ee-ef0b8682e235 admin admin] PATH_INFO: `/v3/projects/10f639c8d1f74e0fa27d08adced09c9f/users/78f2e4aa363d47aea923bc23c1e6eefe/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:11.050093 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367b7b3-2beb-4ce3-b8ee-ef0b8682e235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f639c8d1f74e0fa27d08adced09c9f, user_id=78f2e4aa363d47aea923bc23c1e6eefe, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:11.053099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367b7b3-2beb-4ce3-b8ee-ef0b8682e235 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:11.111897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 873/1756] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:10 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:11.113395 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f39bd-fd8a-49fe-b2da-0148d797a7a2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:11.113725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f39bd-fd8a-49fe-b2da-0148d797a7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:11.114010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f39bd-fd8a-49fe-b2da-0148d797a7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:11.142865 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 884/1757] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:10 2022] PUT /identity/v3/projects/10f639c8d1f74e0fa27d08adced09c9f/users/78f2e4aa363d47aea923bc23c1e6eefe/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:11.145073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367b7b3-2beb-4ce3-b8ee-ef0b8682e235 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:11.181732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fa3f39bd-fd8a-49fe-b2da-0148d797a7a2 None None] MFA Rules not processed for user `0ed76163fa02423a89676a7f54c7c499`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:11.182983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fa3f39bd-fd8a-49fe-b2da-0148d797a7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:11.320945 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367b7b3-2beb-4ce3-b8ee-ef0b8682e235 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:11.334195 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b3574-786e-44d9-ad1f-6a9d3abc6ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:11.334916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b3574-786e-44d9-ad1f-6a9d3abc6ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:11.335232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b3574-786e-44d9-ad1f-6a9d3abc6ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:11.335597 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b3574-786e-44d9-ad1f-6a9d3abc6ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:11.336264 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b3574-786e-44d9-ad1f-6a9d3abc6ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:11.347138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b3574-786e-44d9-ad1f-6a9d3abc6ed9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:11.378386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 874/1758] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:11.386666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c3731-c70d-45de-a6c8-a717c1dc36c3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:11.395388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c3731-c70d-45de-a6c8-a717c1dc36c3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:11.396923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c3731-c70d-45de-a6c8-a717c1dc36c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:11.443137 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ad2c3731-c70d-45de-a6c8-a717c1dc36c3 None None] MFA Rules not processed for user `baed8aff24b64c788f40e6d7dd1f99c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:11.444813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ad2c3731-c70d-45de-a6c8-a717c1dc36c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:11.458956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 885/1759] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:11 2022] POST /identity/v3/users => generated 292 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:11.459923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b3574-786e-44d9-ad1f-6a9d3abc6ed9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:11.462792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9a0b3574-786e-44d9-ad1f-6a9d3abc6ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:11.554078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 875/1760] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:11.561683 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483eb95e-a605-4254-abe3-a4275fc26072 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:11.562182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483eb95e-a605-4254-abe3-a4275fc26072 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:11.562676 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483eb95e-a605-4254-abe3-a4275fc26072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:11.610839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b3574-786e-44d9-ad1f-6a9d3abc6ed9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:11.621482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-483eb95e-a605-4254-abe3-a4275fc26072 None None] MFA Rules not processed for user `78f2e4aa363d47aea923bc23c1e6eefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:11.626314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce9440-aafe-41c5-a260-ceef97635438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:11.626545 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-483eb95e-a605-4254-abe3-a4275fc26072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:11.627006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce9440-aafe-41c5-a260-ceef97635438 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:11.627331 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce9440-aafe-41c5-a260-ceef97635438 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:11.627661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce9440-aafe-41c5-a260-ceef97635438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:11.757898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce9440-aafe-41c5-a260-ceef97635438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:11.760487 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce9440-aafe-41c5-a260-ceef97635438 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:11.774481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 886/1761] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:11 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:11.775885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce9440-aafe-41c5-a260-ceef97635438 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:11.777407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4dce9440-aafe-41c5-a260-ceef97635438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:11.791010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce9440-aafe-41c5-a260-ceef97635438 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:11.797415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 876/1762] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:11.801279 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483eb95e-a605-4254-abe3-a4275fc26072 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:11.801964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35937d36-bde1-4075-ae0e-3d919d97be37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:11.804088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35937d36-bde1-4075-ae0e-3d919d97be37 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:11.805934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35937d36-bde1-4075-ae0e-3d919d97be37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:11.806480 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35937d36-bde1-4075-ae0e-3d919d97be37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:11.820061 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483eb95e-a605-4254-abe3-a4275fc26072 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:11.837950 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35937d36-bde1-4075-ae0e-3d919d97be37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:11.838169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef15007-c459-46b3-9681-60a28cfa066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:11.838703 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15007-c459-46b3-9681-60a28cfa066d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:11.847460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15007-c459-46b3-9681-60a28cfa066d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:11.847460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef15007-c459-46b3-9681-60a28cfa066d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:11.847460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef15007-c459-46b3-9681-60a28cfa066d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:11.848413 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35937d36-bde1-4075-ae0e-3d919d97be37 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:11.848508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef15007-c459-46b3-9681-60a28cfa066d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:11.867313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 887/1763] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:11.867980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35937d36-bde1-4075-ae0e-3d919d97be37 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:11.882182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 877/1764] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:11.897459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35937d36-bde1-4075-ae0e-3d919d97be37 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:11.898084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef15007-c459-46b3-9681-60a28cfa066d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:11.907596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab2b40-78f7-457a-b9a4-5b698493e6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:11.908447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab2b40-78f7-457a-b9a4-5b698493e6ec admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:11.909025 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab2b40-78f7-457a-b9a4-5b698493e6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:11.909444 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab2b40-78f7-457a-b9a4-5b698493e6ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:11.910317 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab2b40-78f7-457a-b9a4-5b698493e6ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:11.914406 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab2b40-78f7-457a-b9a4-5b698493e6ec admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:11.960281 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef15007-c459-46b3-9681-60a28cfa066d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:11.972078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ce0c5-490f-4fdd-b85f-95e387ab287d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:11.973006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ce0c5-490f-4fdd-b85f-95e387ab287d admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:11.973290 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ce0c5-490f-4fdd-b85f-95e387ab287d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:11.973594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ce0c5-490f-4fdd-b85f-95e387ab287d admin admin] PATH_INFO: `/v3/projects/e8632715666f41f48639c9433b76b88a/users/e98a6a51e43b4517b5f119d84c9db54b/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:12.035454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ce0c5-490f-4fdd-b85f-95e387ab287d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8632715666f41f48639c9433b76b88a, user_id=e98a6a51e43b4517b5f119d84c9db54b, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:12.038440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ce0c5-490f-4fdd-b85f-95e387ab287d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:12.334453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 888/1765] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:11 2022] POST /identity/v3/projects => generated 381 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:12.335492 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab2b40-78f7-457a-b9a4-5b698493e6ec admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:12.360155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 878/1766] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:11 2022] PUT /identity/v3/projects/e8632715666f41f48639c9433b76b88a/users/e98a6a51e43b4517b5f119d84c9db54b/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:12.361200 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ce0c5-490f-4fdd-b85f-95e387ab287d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:12.499562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab2b40-78f7-457a-b9a4-5b698493e6ec admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:12.544139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ce0c5-490f-4fdd-b85f-95e387ab287d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:12.557995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129ebce-e3bc-43c1-b0cf-63446de8ea07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:12.558354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129ebce-e3bc-43c1-b0cf-63446de8ea07 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:12.560236 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129ebce-e3bc-43c1-b0cf-63446de8ea07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:12.560639 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129ebce-e3bc-43c1-b0cf-63446de8ea07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:12.643346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d5418-52cf-4edb-96aa-7ea9bc2697d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:12.644136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d5418-52cf-4edb-96aa-7ea9bc2697d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:12.644429 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d5418-52cf-4edb-96aa-7ea9bc2697d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:12.644704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d5418-52cf-4edb-96aa-7ea9bc2697d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:12.645449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d5418-52cf-4edb-96aa-7ea9bc2697d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:12.651099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d5418-52cf-4edb-96aa-7ea9bc2697d4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:12.705049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129ebce-e3bc-43c1-b0cf-63446de8ea07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:12.707186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129ebce-e3bc-43c1-b0cf-63446de8ea07 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:12.719324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 879/1767] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:12.720119 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129ebce-e3bc-43c1-b0cf-63446de8ea07 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:12.736845 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129ebce-e3bc-43c1-b0cf-63446de8ea07 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:12.740547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656258dc-ed9f-4864-a5b1-d76d861a6380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:12.741425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656258dc-ed9f-4864-a5b1-d76d861a6380 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:12.741960 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656258dc-ed9f-4864-a5b1-d76d861a6380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:12.742353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656258dc-ed9f-4864-a5b1-d76d861a6380 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:12.743422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656258dc-ed9f-4864-a5b1-d76d861a6380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:12.746093 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656258dc-ed9f-4864-a5b1-d76d861a6380 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:12.761212 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 880/1768] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:12.762715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba90d9-f52d-4403-bd76-e6645a7da2c1 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:12.765250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba90d9-f52d-4403-bd76-e6645a7da2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:12.765250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba90d9-f52d-4403-bd76-e6645a7da2c1 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:12.765578 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 889/1769] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:12 2022] POST /identity/v3/users => generated 297 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:05:12.766043 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 881/1770] 10.222.0.35 () {54 vars in 912 bytes} [Wed May 11 21:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:05:12.766149 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d5418-52cf-4edb-96aa-7ea9bc2697d4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:12.769849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba90d9-f52d-4403-bd76-e6645a7da2c1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:12.786057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba90d9-f52d-4403-bd76-e6645a7da2c1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:12.787851 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d5418-52cf-4edb-96aa-7ea9bc2697d4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:12.792714 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2463b-eb4c-46c0-8156-d40dc3bbf393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:12.799573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2463b-eb4c-46c0-8156-d40dc3bbf393 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:12.799573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2463b-eb4c-46c0-8156-d40dc3bbf393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:12.799573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2463b-eb4c-46c0-8156-d40dc3bbf393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:12.800457 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc19ebb-a9bd-40b0-9974-2aab0514c268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:12.800573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2463b-eb4c-46c0-8156-d40dc3bbf393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:12.800660 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19ebb-a9bd-40b0-9974-2aab0514c268 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:12.800660 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19ebb-a9bd-40b0-9974-2aab0514c268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:12.800660 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19ebb-a9bd-40b0-9974-2aab0514c268 admin admin] PATH_INFO: `/v3/projects/e8632715666f41f48639c9433b76b88a/users/e98a6a51e43b4517b5f119d84c9db54b/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:12.800905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2463b-eb4c-46c0-8156-d40dc3bbf393 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:12.800996 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc19ebb-a9bd-40b0-9974-2aab0514c268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8632715666f41f48639c9433b76b88a, user_id=e98a6a51e43b4517b5f119d84c9db54b, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:12.803929 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc19ebb-a9bd-40b0-9974-2aab0514c268 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:12.810077 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 882/1771] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:12.811674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a3a9a-47f3-4da9-9881-8e60ac632705 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:12.812140 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a3a9a-47f3-4da9-9881-8e60ac632705 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:12.812578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a3a9a-47f3-4da9-9881-8e60ac632705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:12.814904 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 890/1772] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:12 2022] PUT /identity/v3/projects/e8632715666f41f48639c9433b76b88a/users/e98a6a51e43b4517b5f119d84c9db54b/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:12.815841 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc19ebb-a9bd-40b0-9974-2aab0514c268 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:12.838691 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-188a3a9a-47f3-4da9-9881-8e60ac632705 None None] MFA Rules not processed for user `8aa998f15cd543338cd0fc8b5a501066`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:12.840020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-188a3a9a-47f3-4da9-9881-8e60ac632705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:12.896759 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 883/1773] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 21:05:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:12.896935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc19ebb-a9bd-40b0-9974-2aab0514c268 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:12.897293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e954375-ef1c-437b-9ceb-b35d2257dea3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:12.897946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e954375-ef1c-437b-9ceb-b35d2257dea3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:12.898315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e954375-ef1c-437b-9ceb-b35d2257dea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:12.901910 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86487483-b7ad-4f10-9452-cf00918c4347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:12.902932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86487483-b7ad-4f10-9452-cf00918c4347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:12.903293 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86487483-b7ad-4f10-9452-cf00918c4347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:12.903627 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86487483-b7ad-4f10-9452-cf00918c4347 admin admin] PATH_INFO: `/v3/projects/276057cdefed4b94b4d689fd54f3b007/users/354aba52e7e4414a91e8272bfe20465d/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:12.922249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86487483-b7ad-4f10-9452-cf00918c4347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276057cdefed4b94b4d689fd54f3b007, user_id=354aba52e7e4414a91e8272bfe20465d, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:12.925483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86487483-b7ad-4f10-9452-cf00918c4347 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:12.934967 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1e954375-ef1c-437b-9ceb-b35d2257dea3 None None] MFA Rules not processed for user `e98a6a51e43b4517b5f119d84c9db54b`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:12.937326 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1e954375-ef1c-437b-9ceb-b35d2257dea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:13.008692 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 884/1774] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:12 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:13.010548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c0031-37af-48ca-afe3-73772366d3b8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:13.011170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c0031-37af-48ca-afe3-73772366d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:13.011170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c0031-37af-48ca-afe3-73772366d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:13.034067 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 891/1775] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:12 2022] PUT /identity/v3/projects/276057cdefed4b94b4d689fd54f3b007/users/354aba52e7e4414a91e8272bfe20465d/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:13.035197 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86487483-b7ad-4f10-9452-cf00918c4347 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:13.037233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-86487483-b7ad-4f10-9452-cf00918c4347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:13.037440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cd7c0031-37af-48ca-afe3-73772366d3b8 None None] MFA Rules not processed for user `d7666a6299cc4c44ac7495ed00f137dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:13.038773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cd7c0031-37af-48ca-afe3-73772366d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:13.097319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 885/1776] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:13.098289 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c0031-37af-48ca-afe3-73772366d3b8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:13.106237 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86487483-b7ad-4f10-9452-cf00918c4347 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:13.110038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a4ab1-5bd4-4ef7-ae11-a371731d2b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:13.110700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a4ab1-5bd4-4ef7-ae11-a371731d2b29 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:13.110985 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a4ab1-5bd4-4ef7-ae11-a371731d2b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:13.111260 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a4ab1-5bd4-4ef7-ae11-a371731d2b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:13.119195 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a4ab1-5bd4-4ef7-ae11-a371731d2b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:13.123889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a4ab1-5bd4-4ef7-ae11-a371731d2b29 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:13.135400 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 892/1777] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:13.136949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a4ab1-5bd4-4ef7-ae11-a371731d2b29 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:13.228819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c0031-37af-48ca-afe3-73772366d3b8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:13.244745 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7fb0e-4a95-4070-952d-d47322f6d5de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:13.250472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7fb0e-4a95-4070-952d-d47322f6d5de service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:13.252375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7fb0e-4a95-4070-952d-d47322f6d5de service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:13.253389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7fb0e-4a95-4070-952d-d47322f6d5de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:13.260285 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a4ab1-5bd4-4ef7-ae11-a371731d2b29 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:13.286203 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e036e5-4ac2-4fd5-acb9-c479286ea1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:13.286876 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e036e5-4ac2-4fd5-acb9-c479286ea1ff admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:13.287218 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e036e5-4ac2-4fd5-acb9-c479286ea1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:13.287504 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e036e5-4ac2-4fd5-acb9-c479286ea1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:13.289674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e036e5-4ac2-4fd5-acb9-c479286ea1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:13.292740 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e036e5-4ac2-4fd5-acb9-c479286ea1ff admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:13.317143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 893/1778] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:13.321398 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e036e5-4ac2-4fd5-acb9-c479286ea1ff admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:13.346163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7fb0e-4a95-4070-952d-d47322f6d5de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:13.347654 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7fb0e-4a95-4070-952d-d47322f6d5de service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:13.356586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e036e5-4ac2-4fd5-acb9-c479286ea1ff admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:13.375247 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 886/1779] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:13 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:13.375560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeea76d-dd41-4745-b8de-f8a02d9f1730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:13.376463 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea76d-dd41-4745-b8de-f8a02d9f1730 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:13.376749 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea76d-dd41-4745-b8de-f8a02d9f1730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:13.377024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea76d-dd41-4745-b8de-f8a02d9f1730 admin admin] PATH_INFO: `/v3/projects/276057cdefed4b94b4d689fd54f3b007/users/354aba52e7e4414a91e8272bfe20465d/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:13.379100 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeea76d-dd41-4745-b8de-f8a02d9f1730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276057cdefed4b94b4d689fd54f3b007, user_id=354aba52e7e4414a91e8272bfe20465d, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:13.382418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeea76d-dd41-4745-b8de-f8a02d9f1730 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:13.403649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 894/1780] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:13 2022] PUT /identity/v3/projects/276057cdefed4b94b4d689fd54f3b007/users/354aba52e7e4414a91e8272bfe20465d/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:13.415682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f7272-a786-46e0-a285-8a7d8cd40c0f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:13.416543 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f7272-a786-46e0-a285-8a7d8cd40c0f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:13.416543 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f7272-a786-46e0-a285-8a7d8cd40c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:13.450384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b60f7272-a786-46e0-a285-8a7d8cd40c0f None None] MFA Rules not processed for user `354aba52e7e4414a91e8272bfe20465d`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:13.451712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b60f7272-a786-46e0-a285-8a7d8cd40c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:13.576887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 887/1781] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:13.670895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeea76d-dd41-4745-b8de-f8a02d9f1730 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:13.672825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f7272-a786-46e0-a285-8a7d8cd40c0f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:13.799607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeea76d-dd41-4745-b8de-f8a02d9f1730 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:13.810319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b54d5-29ae-42fd-a740-d251e2935804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:13.811742 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b54d5-29ae-42fd-a740-d251e2935804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:13.812290 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b54d5-29ae-42fd-a740-d251e2935804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:13.812781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b54d5-29ae-42fd-a740-d251e2935804 admin admin] PATH_INFO: `/v3/users/1995309e781f43e1aa8ca7aa15718f63` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:13.814898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b54d5-29ae-42fd-a740-d251e2935804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1995309e781f43e1aa8ca7aa15718f63)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:13.817376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b54d5-29ae-42fd-a740-d251e2935804 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:13.817761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f7272-a786-46e0-a285-8a7d8cd40c0f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:13.827452 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7a823-f35f-4cfe-a895-4a0f1d2fff79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:13.828170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7a823-f35f-4cfe-a895-4a0f1d2fff79 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:13.828616 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7a823-f35f-4cfe-a895-4a0f1d2fff79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:13.828720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7a823-f35f-4cfe-a895-4a0f1d2fff79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:13.851430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7a823-f35f-4cfe-a895-4a0f1d2fff79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:13.855848 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7a823-f35f-4cfe-a895-4a0f1d2fff79 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:13.887155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 888/1782] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:13.888313 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7a823-f35f-4cfe-a895-4a0f1d2fff79 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:13.904878 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7a823-f35f-4cfe-a895-4a0f1d2fff79 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:13.913731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29a6dd-0f59-4540-9325-d93a6d10efa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:13.914329 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29a6dd-0f59-4540-9325-d93a6d10efa8 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:13.914619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29a6dd-0f59-4540-9325-d93a6d10efa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:13.914903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29a6dd-0f59-4540-9325-d93a6d10efa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:14.002370 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29a6dd-0f59-4540-9325-d93a6d10efa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:14.004021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29a6dd-0f59-4540-9325-d93a6d10efa8 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:14.015478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 889/1783] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:14.048647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed2b54d5-29ae-42fd-a740-d251e2935804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1995309e781f43e1aa8ca7aa15718f63'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:14.057098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed2b54d5-29ae-42fd-a740-d251e2935804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1995309e781f43e1aa8ca7aa15718f63'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:14.122501 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed2b54d5-29ae-42fd-a740-d251e2935804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1995309e781f43e1aa8ca7aa15718f63'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:14.126121 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed2b54d5-29ae-42fd-a740-d251e2935804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1995309e781f43e1aa8ca7aa15718f63'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:14.126121 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed2b54d5-29ae-42fd-a740-d251e2935804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1995309e781f43e1aa8ca7aa15718f63'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:14.194381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 895/1784] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:13 2022] DELETE /identity/v3/users/1995309e781f43e1aa8ca7aa15718f63 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:14.199804 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17a72-2a42-4a74-99de-06b981f26fd7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:14.200257 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17a72-2a42-4a74-99de-06b981f26fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:14.200647 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17a72-2a42-4a74-99de-06b981f26fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:14.225251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-37a17a72-2a42-4a74-99de-06b981f26fd7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:14.226944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-37a17a72-2a42-4a74-99de-06b981f26fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:14.317488 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 890/1785] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:14.327048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b54d5-29ae-42fd-a740-d251e2935804 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:14.329182 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ed2b54d5-29ae-42fd-a740-d251e2935804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:14.392443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b54d5-29ae-42fd-a740-d251e2935804 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:14.396267 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7805b-cdce-4092-beed-235cfadcc13e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:14.396926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7805b-cdce-4092-beed-235cfadcc13e service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:14.397211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7805b-cdce-4092-beed-235cfadcc13e service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:14.397489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7805b-cdce-4092-beed-235cfadcc13e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:14.406405 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7805b-cdce-4092-beed-235cfadcc13e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:14.407840 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7805b-cdce-4092-beed-235cfadcc13e service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:14.417017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 896/1786] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:05:15.069992 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a17a72-2a42-4a74-99de-06b981f26fd7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:15.071766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-37a17a72-2a42-4a74-99de-06b981f26fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:15.088870 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a17a72-2a42-4a74-99de-06b981f26fd7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:15.097067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:15.097974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:15.098263 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:15.098536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] PATH_INFO: `/v3/projects/6a0b482c747a4034847a0fd358200082` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:15.099825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0b482c747a4034847a0fd358200082)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:15.101893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:15.176545 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7805b-cdce-4092-beed-235cfadcc13e service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:15.178047 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d1f7805b-cdce-4092-beed-235cfadcc13e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:15.240932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7805b-cdce-4092-beed-235cfadcc13e service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:15.245281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5c194-09e2-4ab3-8483-27b642f6a192 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '354aba52e7e4414a91e8272bfe20465d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '276057cdefed4b94b4d689fd54f3b007', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:15.245972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5c194-09e2-4ab3-8483-27b642f6a192 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:15.246258 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5c194-09e2-4ab3-8483-27b642f6a192 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:15.246586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5c194-09e2-4ab3-8483-27b642f6a192 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:15.247308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5c194-09e2-4ab3-8483-27b642f6a192 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:15.247614 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5c194-09e2-4ab3-8483-27b642f6a192 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:15.249270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5c194-09e2-4ab3-8483-27b642f6a192 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:15.261224 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 897/1787] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:05:15.273735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5c194-09e2-4ab3-8483-27b642f6a192 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:15.281854 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5c194-09e2-4ab3-8483-27b642f6a192 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:15.292619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0b482c747a4034847a0fd358200082', 'request_id': 'req-21b3f572-5f56-4df2-977b-48536c9070d2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.312101 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0b482c747a4034847a0fd358200082', 'request_id': 'req-21b3f572-5f56-4df2-977b-48536c9070d2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.318311 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0b482c747a4034847a0fd358200082', 'request_id': 'req-21b3f572-5f56-4df2-977b-48536c9070d2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.339631 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18597d4d-b497-4f1e-8a06-58fd1e542d81 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '354aba52e7e4414a91e8272bfe20465d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '276057cdefed4b94b4d689fd54f3b007', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:15.340355 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597d4d-b497-4f1e-8a06-58fd1e542d81 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:15.340652 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597d4d-b497-4f1e-8a06-58fd1e542d81 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:15.340936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18597d4d-b497-4f1e-8a06-58fd1e542d81 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:15.342648 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18597d4d-b497-4f1e-8a06-58fd1e542d81 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:15.344257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18597d4d-b497-4f1e-8a06-58fd1e542d81 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:15.413306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] The token cache is being invalidate because project 6a0b482c747a4034847a0fd358200082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:15.413629 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.414305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.416097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 891/1788] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:15 2022] DELETE /identity/v3/projects/6a0b482c747a4034847a0fd358200082 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:15.419898 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:15.421356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:15.471518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 898/1789] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:15 2022] POST /identity/v3/projects => generated 355 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:05:15.476840 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18597d4d-b497-4f1e-8a06-58fd1e542d81 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:15.479343 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-18597d4d-b497-4f1e-8a06-58fd1e542d81 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:15.497238 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3f572-5f56-4df2-977b-48536c9070d2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:15.591696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18597d4d-b497-4f1e-8a06-58fd1e542d81 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:15.597553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0cc3c-2ebd-4fd8-9ca3-c40ed14e9664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:15.598845 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0cc3c-2ebd-4fd8-9ca3-c40ed14e9664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:15.599329 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0cc3c-2ebd-4fd8-9ca3-c40ed14e9664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:15.599518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e93b5e-b4d4-40c1-8f57-011fe2a256b2 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '354aba52e7e4414a91e8272bfe20465d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '276057cdefed4b94b4d689fd54f3b007', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:15.599995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0cc3c-2ebd-4fd8-9ca3-c40ed14e9664 admin admin] PATH_INFO: `/v3/users/0ed76163fa02423a89676a7f54c7c499` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:15.600146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e93b5e-b4d4-40c1-8f57-011fe2a256b2 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:15.600413 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e93b5e-b4d4-40c1-8f57-011fe2a256b2 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:15.600696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e93b5e-b4d4-40c1-8f57-011fe2a256b2 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:15.602133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e93b5e-b4d4-40c1-8f57-011fe2a256b2 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:15.602535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e93b5e-b4d4-40c1-8f57-011fe2a256b2 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:15.602634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0cc3c-2ebd-4fd8-9ca3-c40ed14e9664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ed76163fa02423a89676a7f54c7c499)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:15.604388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e93b5e-b4d4-40c1-8f57-011fe2a256b2 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:15.604732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0cc3c-2ebd-4fd8-9ca3-c40ed14e9664 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:15.616649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 899/1790] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:05:15.665573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e93b5e-b4d4-40c1-8f57-011fe2a256b2 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:15.676393 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e93b5e-b4d4-40c1-8f57-011fe2a256b2 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:15.681149 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '354aba52e7e4414a91e8272bfe20465d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '276057cdefed4b94b4d689fd54f3b007', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:15.682033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:15.682315 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:15.682591 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] PATH_INFO: `/v3/projects/17d57256dc5c4921ba681824a37438a0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:15.683787 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] RBAC: Authorizing `identity:delete_project(project_id=17d57256dc5c4921ba681824a37438a0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:15.685764 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:15.793309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-54a0cc3c-2ebd-4fd8-9ca3-c40ed14e9664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ed76163fa02423a89676a7f54c7c499'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.801038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d57256dc5c4921ba681824a37438a0', 'request_id': 'req-72d88493-c1bc-4f83-8fb6-32042003c557'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.809074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d57256dc5c4921ba681824a37438a0', 'request_id': 'req-72d88493-c1bc-4f83-8fb6-32042003c557'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.815387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d57256dc5c4921ba681824a37438a0', 'request_id': 'req-72d88493-c1bc-4f83-8fb6-32042003c557'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.908844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-54a0cc3c-2ebd-4fd8-9ca3-c40ed14e9664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ed76163fa02423a89676a7f54c7c499'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.916857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-54a0cc3c-2ebd-4fd8-9ca3-c40ed14e9664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ed76163fa02423a89676a7f54c7c499'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.917586 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-54a0cc3c-2ebd-4fd8-9ca3-c40ed14e9664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ed76163fa02423a89676a7f54c7c499'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.918650 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-54a0cc3c-2ebd-4fd8-9ca3-c40ed14e9664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ed76163fa02423a89676a7f54c7c499'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.949202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 892/1791] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:15 2022] DELETE /identity/v3/users/0ed76163fa02423a89676a7f54c7c499 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:15.972585 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] The token cache is being invalidate because project 17d57256dc5c4921ba681824a37438a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:15.972891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.973667 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:15.976561 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 900/1792] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:15 2022] DELETE /identity/v3/projects/17d57256dc5c4921ba681824a37438a0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:16.662193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0cc3c-2ebd-4fd8-9ca3-c40ed14e9664 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:16.663579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-54a0cc3c-2ebd-4fd8-9ca3-c40ed14e9664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:16.752552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0cc3c-2ebd-4fd8-9ca3-c40ed14e9664 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:16.786337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754cebd-0f1c-4706-9a90-0242088fab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:16.787698 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754cebd-0f1c-4706-9a90-0242088fab4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:16.788055 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754cebd-0f1c-4706-9a90-0242088fab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:16.788416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754cebd-0f1c-4706-9a90-0242088fab4b admin admin] PATH_INFO: `/v3/projects/c976e2576e7841fdb39f8b8825caa68b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:16.789779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754cebd-0f1c-4706-9a90-0242088fab4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c976e2576e7841fdb39f8b8825caa68b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:16.791765 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754cebd-0f1c-4706-9a90-0242088fab4b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:16.895176 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:16.897452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:16.972448 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6754cebd-0f1c-4706-9a90-0242088fab4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c976e2576e7841fdb39f8b8825caa68b', 'request_id': 'req-6754cebd-0f1c-4706-9a90-0242088fab4b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:16.985824 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6754cebd-0f1c-4706-9a90-0242088fab4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c976e2576e7841fdb39f8b8825caa68b', 'request_id': 'req-6754cebd-0f1c-4706-9a90-0242088fab4b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:17.013450 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6754cebd-0f1c-4706-9a90-0242088fab4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c976e2576e7841fdb39f8b8825caa68b', 'request_id': 'req-6754cebd-0f1c-4706-9a90-0242088fab4b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:17.072500 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d88493-c1bc-4f83-8fb6-32042003c557 tempest-VolumeQuotaClassesTest-2015336031 tempest-VolumeQuotaClassesTest-2015336031-project-admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:17.088230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6754cebd-0f1c-4706-9a90-0242088fab4b admin admin] The token cache is being invalidate because project c976e2576e7841fdb39f8b8825caa68b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:17.088922 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6754cebd-0f1c-4706-9a90-0242088fab4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:17.089256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6754cebd-0f1c-4706-9a90-0242088fab4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:17.091189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 893/1793] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:16 2022] DELETE /identity/v3/projects/c976e2576e7841fdb39f8b8825caa68b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:17.097488 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5807f3-0d6d-4d85-b8d7-374df258746e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:17.097488 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5807f3-0d6d-4d85-b8d7-374df258746e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:17.097488 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5807f3-0d6d-4d85-b8d7-374df258746e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:17.149934 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fb5807f3-0d6d-4d85-b8d7-374df258746e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:17.151223 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fb5807f3-0d6d-4d85-b8d7-374df258746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:17.206828 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45700e15-cf61-4240-baf7-c417cc6dbb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:17.206828 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45700e15-cf61-4240-baf7-c417cc6dbb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:17.206828 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45700e15-cf61-4240-baf7-c417cc6dbb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:17.206828 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45700e15-cf61-4240-baf7-c417cc6dbb77 admin admin] PATH_INFO: `/v3/users/78f2e4aa363d47aea923bc23c1e6eefe` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:17.207219 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45700e15-cf61-4240-baf7-c417cc6dbb77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f2e4aa363d47aea923bc23c1e6eefe)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:17.209647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45700e15-cf61-4240-baf7-c417cc6dbb77 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:17.317159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 894/1794] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:17.318735 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f837084-6d83-4064-b4ef-8176144c9e50 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:17.319037 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f837084-6d83-4064-b4ef-8176144c9e50 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:17.319329 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f837084-6d83-4064-b4ef-8176144c9e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:17.478855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7f837084-6d83-4064-b4ef-8176144c9e50 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:17.478855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7f837084-6d83-4064-b4ef-8176144c9e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:17.478855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 895/1795] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:17.482749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f837084-6d83-4064-b4ef-8176144c9e50 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:17.496017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f837084-6d83-4064-b4ef-8176144c9e50 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:17.501755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b918522-72bc-42d8-a5b8-4bccf31087f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:17.502560 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918522-72bc-42d8-a5b8-4bccf31087f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:17.503033 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918522-72bc-42d8-a5b8-4bccf31087f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:17.506553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b918522-72bc-42d8-a5b8-4bccf31087f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:17.510793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b918522-72bc-42d8-a5b8-4bccf31087f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:17.511208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b918522-72bc-42d8-a5b8-4bccf31087f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:17.513260 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b918522-72bc-42d8-a5b8-4bccf31087f3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:17.554040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 896/1796] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:05:17.555278 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b918522-72bc-42d8-a5b8-4bccf31087f3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:17.568247 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b918522-72bc-42d8-a5b8-4bccf31087f3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:17.574680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40e939-ac59-47a2-b327-7dd83cc1c56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:17.577052 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40e939-ac59-47a2-b327-7dd83cc1c56c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:17.577477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40e939-ac59-47a2-b327-7dd83cc1c56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:17.577802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40e939-ac59-47a2-b327-7dd83cc1c56c admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:17.578507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40e939-ac59-47a2-b327-7dd83cc1c56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:17.580889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40e939-ac59-47a2-b327-7dd83cc1c56c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:18.113678 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 897/1797] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:17 2022] POST /identity/v3/projects => generated 387 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:18.117991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40e939-ac59-47a2-b327-7dd83cc1c56c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:18.257029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40e939-ac59-47a2-b327-7dd83cc1c56c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:18.276147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3a714-6f3b-4754-bf43-948ecba1d2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:18.276846 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3a714-6f3b-4754-bf43-948ecba1d2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:18.276960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45700e15-cf61-4240-baf7-c417cc6dbb77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f2e4aa363d47aea923bc23c1e6eefe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:18.277376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3a714-6f3b-4754-bf43-948ecba1d2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:18.277376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3a714-6f3b-4754-bf43-948ecba1d2b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:18.281094 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3a714-6f3b-4754-bf43-948ecba1d2b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:18.285129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3a714-6f3b-4754-bf43-948ecba1d2b2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:18.296500 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45700e15-cf61-4240-baf7-c417cc6dbb77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f2e4aa363d47aea923bc23c1e6eefe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:18.436405 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45700e15-cf61-4240-baf7-c417cc6dbb77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f2e4aa363d47aea923bc23c1e6eefe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:18.441691 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 898/1798] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:18 2022] POST /identity/v3/users => generated 294 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:18.442507 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45700e15-cf61-4240-baf7-c417cc6dbb77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f2e4aa363d47aea923bc23c1e6eefe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:18.444625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45700e15-cf61-4240-baf7-c417cc6dbb77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f2e4aa363d47aea923bc23c1e6eefe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:18.459401 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3a714-6f3b-4754-bf43-948ecba1d2b2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:18.471915 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a7a3a714-6f3b-4754-bf43-948ecba1d2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:18.509936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 901/1799] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:16 2022] DELETE /identity/v3/users/78f2e4aa363d47aea923bc23c1e6eefe => generated 0 bytes in 1613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:18.514959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5724e7d-f95b-4b27-8c94-6e57db41605d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:18.515255 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5724e7d-f95b-4b27-8c94-6e57db41605d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:18.515560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5724e7d-f95b-4b27-8c94-6e57db41605d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:18.515990 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3a714-6f3b-4754-bf43-948ecba1d2b2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:18.555977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d5724e7d-f95b-4b27-8c94-6e57db41605d None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:18.557211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d5724e7d-f95b-4b27-8c94-6e57db41605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:18.668530 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336f9d1-5970-4627-b1cf-30cd4948f36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:18.669250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336f9d1-5970-4627-b1cf-30cd4948f36d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:18.669680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336f9d1-5970-4627-b1cf-30cd4948f36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:18.670528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336f9d1-5970-4627-b1cf-30cd4948f36d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:18.671287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336f9d1-5970-4627-b1cf-30cd4948f36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:18.673099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336f9d1-5970-4627-b1cf-30cd4948f36d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:18.699127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 899/1800] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:18.702543 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336f9d1-5970-4627-b1cf-30cd4948f36d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:18.719740 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 902/1801] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:18.731454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5724e7d-f95b-4b27-8c94-6e57db41605d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:18.737085 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d5724e7d-f95b-4b27-8c94-6e57db41605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:18.742586 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336f9d1-5970-4627-b1cf-30cd4948f36d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:18.757657 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eccc22-5787-4431-aafd-62e326f6facc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:18.758558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eccc22-5787-4431-aafd-62e326f6facc admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:18.758946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eccc22-5787-4431-aafd-62e326f6facc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:18.759721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eccc22-5787-4431-aafd-62e326f6facc admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:18.760569 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eccc22-5787-4431-aafd-62e326f6facc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:18.782664 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eccc22-5787-4431-aafd-62e326f6facc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:18.804506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 900/1802] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:18.810604 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eccc22-5787-4431-aafd-62e326f6facc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:18.833837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5724e7d-f95b-4b27-8c94-6e57db41605d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:18.839046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a69d13-a7b6-415b-9e13-55439c7f96fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:18.839737 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69d13-a7b6-415b-9e13-55439c7f96fa service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:18.841156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69d13-a7b6-415b-9e13-55439c7f96fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:18.842063 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69d13-a7b6-415b-9e13-55439c7f96fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:18.842228 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eccc22-5787-4431-aafd-62e326f6facc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:18.854251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cd2d1-d0da-44d8-9a63-403624f9ba0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:18.855058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a69d13-a7b6-415b-9e13-55439c7f96fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:18.855235 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cd2d1-d0da-44d8-9a63-403624f9ba0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:18.855531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cd2d1-d0da-44d8-9a63-403624f9ba0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:18.855813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cd2d1-d0da-44d8-9a63-403624f9ba0a admin admin] PATH_INFO: `/v3/projects/fb3d2632997346538ac8bccdd74e35c0/users/d55939c958ba4417b576f98be68f8c05/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:18.856763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a69d13-a7b6-415b-9e13-55439c7f96fa service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:18.871806 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 903/1803] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:18.882371 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cd2d1-d0da-44d8-9a63-403624f9ba0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3d2632997346538ac8bccdd74e35c0, user_id=d55939c958ba4417b576f98be68f8c05, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:18.886205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cd2d1-d0da-44d8-9a63-403624f9ba0a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:18.973279 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 901/1804] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:18 2022] PUT /identity/v3/projects/fb3d2632997346538ac8bccdd74e35c0/users/d55939c958ba4417b576f98be68f8c05/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:18.984265 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47902-a404-4fa9-a50d-35d70bc968f3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:18.984713 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47902-a404-4fa9-a50d-35d70bc968f3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:18.985170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47902-a404-4fa9-a50d-35d70bc968f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:19.048007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e1d47902-a404-4fa9-a50d-35d70bc968f3 None None] MFA Rules not processed for user `d55939c958ba4417b576f98be68f8c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:19.049724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e1d47902-a404-4fa9-a50d-35d70bc968f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:19.176436 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 904/1805] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:19.180464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cd2d1-d0da-44d8-9a63-403624f9ba0a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:19.250722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cd2d1-d0da-44d8-9a63-403624f9ba0a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:19.256566 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17e565-63fa-4183-9ee7-2d974cc8c84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:19.257261 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e565-63fa-4183-9ee7-2d974cc8c84e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:19.257656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e565-63fa-4183-9ee7-2d974cc8c84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:19.259117 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17e565-63fa-4183-9ee7-2d974cc8c84e admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:19.259820 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17e565-63fa-4183-9ee7-2d974cc8c84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:19.261783 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17e565-63fa-4183-9ee7-2d974cc8c84e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:19.351155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 902/1806] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:19 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:19.360033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d47902-a404-4fa9-a50d-35d70bc968f3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:19.371396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d47902-a404-4fa9-a50d-35d70bc968f3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:19.429346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30148adb-76e2-49d9-a836-e02cb768bff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:19.429982 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30148adb-76e2-49d9-a836-e02cb768bff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:19.430271 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30148adb-76e2-49d9-a836-e02cb768bff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:19.430536 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30148adb-76e2-49d9-a836-e02cb768bff7 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:19.437166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30148adb-76e2-49d9-a836-e02cb768bff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:19.437166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30148adb-76e2-49d9-a836-e02cb768bff7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:19.526788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17e565-63fa-4183-9ee7-2d974cc8c84e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:19.528706 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6b17e565-63fa-4183-9ee7-2d974cc8c84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:19.555217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 905/1807] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:19 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:19.567474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30148adb-76e2-49d9-a836-e02cb768bff7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:19.581489 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17e565-63fa-4183-9ee7-2d974cc8c84e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:19.587797 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30148adb-76e2-49d9-a836-e02cb768bff7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:19.588127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:19.589269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:19.589814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:19.590302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] PATH_INFO: `/v3/projects/10f639c8d1f74e0fa27d08adced09c9f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:19.591875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f639c8d1f74e0fa27d08adced09c9f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:19.593341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2caf5d-092f-459f-9877-d60f3b4b4ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:19.594146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2caf5d-092f-459f-9877-d60f3b4b4ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:19.594266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:19.594679 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2caf5d-092f-459f-9877-d60f3b4b4ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:19.594953 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2caf5d-092f-459f-9877-d60f3b4b4ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:19.595873 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2caf5d-092f-459f-9877-d60f3b4b4ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:19.598543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2caf5d-092f-459f-9877-d60f3b4b4ca7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:19.612003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 906/1808] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:05:19.615694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2caf5d-092f-459f-9877-d60f3b4b4ca7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:19.640898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2caf5d-092f-459f-9877-d60f3b4b4ca7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:19.649215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed196a3-6da3-45b8-8c5f-06e12dca31ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:19.654487 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed196a3-6da3-45b8-8c5f-06e12dca31ff admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:19.654487 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed196a3-6da3-45b8-8c5f-06e12dca31ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:19.654487 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed196a3-6da3-45b8-8c5f-06e12dca31ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:19.654487 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed196a3-6da3-45b8-8c5f-06e12dca31ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:19.654487 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed196a3-6da3-45b8-8c5f-06e12dca31ff admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:19.682961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 907/1809] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:19.688620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed196a3-6da3-45b8-8c5f-06e12dca31ff admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:19.699808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed196a3-6da3-45b8-8c5f-06e12dca31ff admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:19.711115 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0f3c0-8e42-4128-a154-2fc980192d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:19.711998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f3c0-8e42-4128-a154-2fc980192d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:19.712502 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f3c0-8e42-4128-a154-2fc980192d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:19.712788 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f3c0-8e42-4128-a154-2fc980192d3e admin admin] PATH_INFO: `/v3/projects/0a0c1891995f4579b256c14d0c19c61b/users/1e91e944a503490682bf742dda5fcfc2/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:19.735532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f639c8d1f74e0fa27d08adced09c9f', 'request_id': 'req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:19.743007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0f3c0-8e42-4128-a154-2fc980192d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0c1891995f4579b256c14d0c19c61b, user_id=1e91e944a503490682bf742dda5fcfc2, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:19.745866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0f3c0-8e42-4128-a154-2fc980192d3e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:19.746436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f639c8d1f74e0fa27d08adced09c9f', 'request_id': 'req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:19.757504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f639c8d1f74e0fa27d08adced09c9f', 'request_id': 'req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:20.021801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 908/1810] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:19 2022] PUT /identity/v3/projects/0a0c1891995f4579b256c14d0c19c61b/users/1e91e944a503490682bf742dda5fcfc2/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:20.021801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dc480-a364-4807-a3c3-5b12e59add64 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:20.021801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dc480-a364-4807-a3c3-5b12e59add64 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:20.021801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812dc480-a364-4807-a3c3-5b12e59add64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:20.022882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] The token cache is being invalidate because project 10f639c8d1f74e0fa27d08adced09c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:20.022882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:20.022882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:20.022882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 903/1811] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:19 2022] DELETE /identity/v3/projects/10f639c8d1f74e0fa27d08adced09c9f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:20.022882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:20.023373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:20.023448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-812dc480-a364-4807-a3c3-5b12e59add64 None None] MFA Rules not processed for user `1e91e944a503490682bf742dda5fcfc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:20.023448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-812dc480-a364-4807-a3c3-5b12e59add64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:20.023580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cd0d5-eedf-4e57-9a8c-5a9a3c7a768f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:20.023661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 909/1812] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:20.023661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dc480-a364-4807-a3c3-5b12e59add64 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:20.023661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-812dc480-a364-4807-a3c3-5b12e59add64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:20.046202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589b543-7bb4-45de-8834-942287749378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:20.047309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589b543-7bb4-45de-8834-942287749378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:20.047439 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589b543-7bb4-45de-8834-942287749378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:20.047659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589b543-7bb4-45de-8834-942287749378 admin admin] PATH_INFO: `/v3/users/354aba52e7e4414a91e8272bfe20465d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:20.049073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589b543-7bb4-45de-8834-942287749378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=354aba52e7e4414a91e8272bfe20465d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:20.051457 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589b543-7bb4-45de-8834-942287749378 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:20.086581 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812dc480-a364-4807-a3c3-5b12e59add64 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:20.091532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3f799-5306-400f-b2e7-b897b2429644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:20.092229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3f799-5306-400f-b2e7-b897b2429644 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:20.092521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3f799-5306-400f-b2e7-b897b2429644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:20.092783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3f799-5306-400f-b2e7-b897b2429644 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:20.093498 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3f799-5306-400f-b2e7-b897b2429644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:20.095520 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3f799-5306-400f-b2e7-b897b2429644 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:20.198273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 910/1813] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:20 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:05:20.208713 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3f799-5306-400f-b2e7-b897b2429644 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:20.302355 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3f799-5306-400f-b2e7-b897b2429644 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:20.306941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451a226-f6f3-4edc-8a33-78a82adf50d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:20.307620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451a226-f6f3-4edc-8a33-78a82adf50d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:20.307902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451a226-f6f3-4edc-8a33-78a82adf50d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:20.308179 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451a226-f6f3-4edc-8a33-78a82adf50d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:20.308872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451a226-f6f3-4edc-8a33-78a82adf50d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:20.310870 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451a226-f6f3-4edc-8a33-78a82adf50d5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:20.368072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7589b543-7bb4-45de-8834-942287749378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '354aba52e7e4414a91e8272bfe20465d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:20.427129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 911/1814] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:20 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:20.431275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451a226-f6f3-4edc-8a33-78a82adf50d5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:20.441084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451a226-f6f3-4edc-8a33-78a82adf50d5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:20.446052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecb654-68ce-4e7b-a60a-5c03fbcc6f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:20.446949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecb654-68ce-4e7b-a60a-5c03fbcc6f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:20.447384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecb654-68ce-4e7b-a60a-5c03fbcc6f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:20.447809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecb654-68ce-4e7b-a60a-5c03fbcc6f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:20.448699 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecb654-68ce-4e7b-a60a-5c03fbcc6f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:20.450770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecb654-68ce-4e7b-a60a-5c03fbcc6f7d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:20.463646 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 912/1815] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:20.471821 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecb654-68ce-4e7b-a60a-5c03fbcc6f7d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:20.481754 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecb654-68ce-4e7b-a60a-5c03fbcc6f7d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:20.487248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5faea-bed4-4604-9532-766f9df1008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:20.488136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5faea-bed4-4604-9532-766f9df1008c admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:20.488416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5faea-bed4-4604-9532-766f9df1008c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:20.488683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5faea-bed4-4604-9532-766f9df1008c admin admin] PATH_INFO: `/v3/projects/1bc100d6cf224c3f9b89478c62efe1bc/users/2c7ebe8feec54adc94274d95baa79f7d/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:20.488818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7589b543-7bb4-45de-8834-942287749378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '354aba52e7e4414a91e8272bfe20465d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:20.498868 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7589b543-7bb4-45de-8834-942287749378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '354aba52e7e4414a91e8272bfe20465d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:20.503338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7589b543-7bb4-45de-8834-942287749378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '354aba52e7e4414a91e8272bfe20465d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:20.503338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7589b543-7bb4-45de-8834-942287749378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '354aba52e7e4414a91e8272bfe20465d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:20.505686 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5faea-bed4-4604-9532-766f9df1008c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc100d6cf224c3f9b89478c62efe1bc, user_id=2c7ebe8feec54adc94274d95baa79f7d, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:20.508934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5faea-bed4-4604-9532-766f9df1008c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:20.532038 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 904/1816] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:19 2022] DELETE /identity/v3/users/354aba52e7e4414a91e8272bfe20465d => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:20.597808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 913/1817] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:20 2022] PUT /identity/v3/projects/1bc100d6cf224c3f9b89478c62efe1bc/users/2c7ebe8feec54adc94274d95baa79f7d/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:20.601825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589b543-7bb4-45de-8834-942287749378 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:20.603293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7589b543-7bb4-45de-8834-942287749378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:20.665148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589b543-7bb4-45de-8834-942287749378 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:20.717931 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a1a74-bb6a-4cbb-9ea6-c05ad200d0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:20.718646 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a1a74-bb6a-4cbb-9ea6-c05ad200d0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:20.718888 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a1a74-bb6a-4cbb-9ea6-c05ad200d0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:20.719172 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a1a74-bb6a-4cbb-9ea6-c05ad200d0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:20.719904 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a1a74-bb6a-4cbb-9ea6-c05ad200d0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:20.721571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a1a74-bb6a-4cbb-9ea6-c05ad200d0a5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:20.732040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 905/1818] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:20.736254 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5faea-bed4-4604-9532-766f9df1008c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:20.746738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5faea-bed4-4604-9532-766f9df1008c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:20.751819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bb461-51e9-4c26-8ff4-fdc3fa751523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:20.752726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb461-51e9-4c26-8ff4-fdc3fa751523 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:20.753090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb461-51e9-4c26-8ff4-fdc3fa751523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:20.753371 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bb461-51e9-4c26-8ff4-fdc3fa751523 admin admin] PATH_INFO: `/v3/projects/1bc100d6cf224c3f9b89478c62efe1bc/users/2c7ebe8feec54adc94274d95baa79f7d/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:20.755446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bb461-51e9-4c26-8ff4-fdc3fa751523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc100d6cf224c3f9b89478c62efe1bc, user_id=2c7ebe8feec54adc94274d95baa79f7d, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:20.758973 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bb461-51e9-4c26-8ff4-fdc3fa751523 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:20.770450 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 914/1819] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:20 2022] PUT /identity/v3/projects/1bc100d6cf224c3f9b89478c62efe1bc/users/2c7ebe8feec54adc94274d95baa79f7d/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:20.781652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa2f47-3cf5-432d-a135-d35e17143f63 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:20.781954 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa2f47-3cf5-432d-a135-d35e17143f63 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:20.782239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa2f47-3cf5-432d-a135-d35e17143f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:20.807986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e1aa2f47-3cf5-432d-a135-d35e17143f63 None None] MFA Rules not processed for user `2c7ebe8feec54adc94274d95baa79f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:20.809131 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e1aa2f47-3cf5-432d-a135-d35e17143f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:20.888924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 906/1820] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:20.895457 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bb461-51e9-4c26-8ff4-fdc3fa751523 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:20.897391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cb0bb461-51e9-4c26-8ff4-fdc3fa751523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:20.939808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa2f47-3cf5-432d-a135-d35e17143f63 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:20.942456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e1aa2f47-3cf5-432d-a135-d35e17143f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:20.965342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bb461-51e9-4c26-8ff4-fdc3fa751523 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:20.969380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d2f16-8fb3-49bb-8743-3506b2c4c4fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:20.970071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2f16-8fb3-49bb-8743-3506b2c4c4fe service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:20.971229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2f16-8fb3-49bb-8743-3506b2c4c4fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:20.971506 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d2f16-8fb3-49bb-8743-3506b2c4c4fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:20.990400 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d2f16-8fb3-49bb-8743-3506b2c4c4fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:20.992184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d2f16-8fb3-49bb-8743-3506b2c4c4fe service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:21.003853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 915/1821] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:21.012999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa2f47-3cf5-432d-a135-d35e17143f63 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:21.018182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e0b8f-2b54-412c-ad10-920c30f552b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:21.019090 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e0b8f-2b54-412c-ad10-920c30f552b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:21.019350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e0b8f-2b54-412c-ad10-920c30f552b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:21.019627 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e0b8f-2b54-412c-ad10-920c30f552b2 admin admin] PATH_INFO: `/v3/projects/276057cdefed4b94b4d689fd54f3b007` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:21.021226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e0b8f-2b54-412c-ad10-920c30f552b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=276057cdefed4b94b4d689fd54f3b007)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:21.023014 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e0b8f-2b54-412c-ad10-920c30f552b2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:21.148060 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-168e0b8f-2b54-412c-ad10-920c30f552b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276057cdefed4b94b4d689fd54f3b007', 'request_id': 'req-168e0b8f-2b54-412c-ad10-920c30f552b2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:21.154164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-168e0b8f-2b54-412c-ad10-920c30f552b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276057cdefed4b94b4d689fd54f3b007', 'request_id': 'req-168e0b8f-2b54-412c-ad10-920c30f552b2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:21.159543 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-168e0b8f-2b54-412c-ad10-920c30f552b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276057cdefed4b94b4d689fd54f3b007', 'request_id': 'req-168e0b8f-2b54-412c-ad10-920c30f552b2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:21.237086 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-168e0b8f-2b54-412c-ad10-920c30f552b2 admin admin] The token cache is being invalidate because project 276057cdefed4b94b4d689fd54f3b007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:21.237383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-168e0b8f-2b54-412c-ad10-920c30f552b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:21.238070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-168e0b8f-2b54-412c-ad10-920c30f552b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:21.239869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 907/1822] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:20 2022] DELETE /identity/v3/projects/276057cdefed4b94b4d689fd54f3b007 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:21.244737 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9844aa2-ea65-4e6c-b02a-90e600c1bf6f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:21.245037 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9844aa2-ea65-4e6c-b02a-90e600c1bf6f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:21.245322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9844aa2-ea65-4e6c-b02a-90e600c1bf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:21.267688 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b9844aa2-ea65-4e6c-b02a-90e600c1bf6f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:21.268932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b9844aa2-ea65-4e6c-b02a-90e600c1bf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:21.330912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 916/1823] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:21.338817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d99e-32d5-49d5-bcb5-e0b6705e162a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:21.343185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d99e-32d5-49d5-bcb5-e0b6705e162a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:21.343185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7d99e-32d5-49d5-bcb5-e0b6705e162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:21.358863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-59f7d99e-32d5-49d5-bcb5-e0b6705e162a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:21.360562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-59f7d99e-32d5-49d5-bcb5-e0b6705e162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:21.370272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 908/1824] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:21.375053 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9844aa2-ea65-4e6c-b02a-90e600c1bf6f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:21.387532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9844aa2-ea65-4e6c-b02a-90e600c1bf6f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:21.393020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c6aca-716f-456a-a4ff-795710d6fc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:21.393791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c6aca-716f-456a-a4ff-795710d6fc4e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:21.394027 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c6aca-716f-456a-a4ff-795710d6fc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:21.394335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c6aca-716f-456a-a4ff-795710d6fc4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:21.395037 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c6aca-716f-456a-a4ff-795710d6fc4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:21.395353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c6aca-716f-456a-a4ff-795710d6fc4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:21.397262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c6aca-716f-456a-a4ff-795710d6fc4e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:21.413861 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 917/1825] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:05:21.414589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7d99e-32d5-49d5-bcb5-e0b6705e162a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:21.424868 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7d99e-32d5-49d5-bcb5-e0b6705e162a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:21.430563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfc286-d00d-42b9-8a7b-4d02c0829b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:21.431240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfc286-d00d-42b9-8a7b-4d02c0829b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:21.431532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfc286-d00d-42b9-8a7b-4d02c0829b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:21.431869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfc286-d00d-42b9-8a7b-4d02c0829b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:21.432522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfc286-d00d-42b9-8a7b-4d02c0829b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:21.434532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfc286-d00d-42b9-8a7b-4d02c0829b47 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:21.545445 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 909/1826] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:21 2022] POST /identity/v3/projects => generated 393 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:05:21.548097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c6aca-716f-456a-a4ff-795710d6fc4e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:21.558364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c6aca-716f-456a-a4ff-795710d6fc4e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:21.620137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0f7b0-766a-4ab9-ae6b-64d8ab0fddd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:21.620820 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0f7b0-766a-4ab9-ae6b-64d8ab0fddd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:21.621106 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0f7b0-766a-4ab9-ae6b-64d8ab0fddd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:21.621385 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0f7b0-766a-4ab9-ae6b-64d8ab0fddd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:21.622256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0f7b0-766a-4ab9-ae6b-64d8ab0fddd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:21.625065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0f7b0-766a-4ab9-ae6b-64d8ab0fddd2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:21.748908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 918/1827] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:21 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:21.753217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfc286-d00d-42b9-8a7b-4d02c0829b47 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:21.764389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfc286-d00d-42b9-8a7b-4d02c0829b47 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:21.773861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6dd5a-d382-452e-b879-872a10e1e5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:21.774631 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6dd5a-d382-452e-b879-872a10e1e5cf admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:21.774924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6dd5a-d382-452e-b879-872a10e1e5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:21.775201 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6dd5a-d382-452e-b879-872a10e1e5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:21.775947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6dd5a-d382-452e-b879-872a10e1e5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:21.777592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6dd5a-d382-452e-b879-872a10e1e5cf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:21.793758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 910/1828] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:05:21.798103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0f7b0-766a-4ab9-ae6b-64d8ab0fddd2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:21.810709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0f7b0-766a-4ab9-ae6b-64d8ab0fddd2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:21.816602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc2f21-73bb-48f8-b106-3183c1e08f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:21.817137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc2f21-73bb-48f8-b106-3183c1e08f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:21.817423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc2f21-73bb-48f8-b106-3183c1e08f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:21.818704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc2f21-73bb-48f8-b106-3183c1e08f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:21.819571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc2f21-73bb-48f8-b106-3183c1e08f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:21.822954 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc2f21-73bb-48f8-b106-3183c1e08f96 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:21.834607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 919/1829] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:21.838836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6dd5a-d382-452e-b879-872a10e1e5cf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:21.864999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6dd5a-d382-452e-b879-872a10e1e5cf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:21.876979 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce0198-92b3-4563-97b9-7c983ae04cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:21.888072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0198-92b3-4563-97b9-7c983ae04cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:21.889193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0198-92b3-4563-97b9-7c983ae04cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:21.889696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce0198-92b3-4563-97b9-7c983ae04cbf admin admin] PATH_INFO: `/v3/projects/cb915dc2619b459f8462d19f62039e67/users/90fd913fd5004af294e85462c260655b/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:21.909643 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce0198-92b3-4563-97b9-7c983ae04cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb915dc2619b459f8462d19f62039e67, user_id=90fd913fd5004af294e85462c260655b, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:21.913718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce0198-92b3-4563-97b9-7c983ae04cbf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:22.004687 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 911/1830] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:21 2022] PUT /identity/v3/projects/cb915dc2619b459f8462d19f62039e67/users/90fd913fd5004af294e85462c260655b/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:22.017013 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e72a0-5cfe-458b-a4dd-8a0bbb4542cd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:22.017306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e72a0-5cfe-458b-a4dd-8a0bbb4542cd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:22.021246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e72a0-5cfe-458b-a4dd-8a0bbb4542cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:22.049949 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41be91-cbea-47bf-a211-c87fe2da0f1e None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:22.051011 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41be91-cbea-47bf-a211-c87fe2da0f1e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:22.051451 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41be91-cbea-47bf-a211-c87fe2da0f1e None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:22.052323 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-128e72a0-5cfe-458b-a4dd-8a0bbb4542cd None None] MFA Rules not processed for user `90fd913fd5004af294e85462c260655b`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:22.053026 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-128e72a0-5cfe-458b-a4dd-8a0bbb4542cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:22.053393 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 912/1831] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 11 21:05:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:05:22.084086 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f291dbf-ce62-49e3-8a47-c49a01fbf5f5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:22.084473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f291dbf-ce62-49e3-8a47-c49a01fbf5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:22.084660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f291dbf-ce62-49e3-8a47-c49a01fbf5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:22.118261 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1f291dbf-ce62-49e3-8a47-c49a01fbf5f5 None None] MFA Rules not processed for user `f400b94d3fbc40bdace4860fe83a0891`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:22.121640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1f291dbf-ce62-49e3-8a47-c49a01fbf5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:22.157517 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 920/1832] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:22.161608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e72a0-5cfe-458b-a4dd-8a0bbb4542cd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:22.304048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 913/1833] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 11 21:05:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:22.320725 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e72a0-5cfe-458b-a4dd-8a0bbb4542cd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:22.321128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f291dbf-ce62-49e3-8a47-c49a01fbf5f5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:22.323351 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1f291dbf-ce62-49e3-8a47-c49a01fbf5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:22.326376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770ec41-0925-49b8-8661-3e8e7d7bdcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:22.327046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770ec41-0925-49b8-8661-3e8e7d7bdcdf admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:22.327331 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770ec41-0925-49b8-8661-3e8e7d7bdcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:22.327607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770ec41-0925-49b8-8661-3e8e7d7bdcdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:22.328969 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770ec41-0925-49b8-8661-3e8e7d7bdcdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:22.330500 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770ec41-0925-49b8-8661-3e8e7d7bdcdf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:22.343981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f291dbf-ce62-49e3-8a47-c49a01fbf5f5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:22.352577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39437766-1216-4c31-8e02-24a55f7fd007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:22.353418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39437766-1216-4c31-8e02-24a55f7fd007 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:22.354222 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39437766-1216-4c31-8e02-24a55f7fd007 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:22.354579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39437766-1216-4c31-8e02-24a55f7fd007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:22.366722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39437766-1216-4c31-8e02-24a55f7fd007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:22.369119 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39437766-1216-4c31-8e02-24a55f7fd007 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:22.391822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 914/1834] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:22.392761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39437766-1216-4c31-8e02-24a55f7fd007 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:22.394255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-39437766-1216-4c31-8e02-24a55f7fd007 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:22.468134 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 921/1835] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:22 2022] POST /identity/v3/projects => generated 393 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:05:22.469483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770ec41-0925-49b8-8661-3e8e7d7bdcdf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:22.482856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39437766-1216-4c31-8e02-24a55f7fd007 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:22.562695 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770ec41-0925-49b8-8661-3e8e7d7bdcdf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:22.563592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c768b9-3da8-4e6c-908f-ee1556b9ec92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:22.564555 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c768b9-3da8-4e6c-908f-ee1556b9ec92 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:22.565064 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c768b9-3da8-4e6c-908f-ee1556b9ec92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:22.565412 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c768b9-3da8-4e6c-908f-ee1556b9ec92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:22.567484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-98c768b9-3da8-4e6c-908f-ee1556b9ec92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:22.569320 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb076310-d6c9-43b3-988a-0843e1539c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:22.570122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb076310-d6c9-43b3-988a-0843e1539c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:22.570483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb076310-d6c9-43b3-988a-0843e1539c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:22.571060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb076310-d6c9-43b3-988a-0843e1539c7c admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:22.571831 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb076310-d6c9-43b3-988a-0843e1539c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:22.575539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb076310-d6c9-43b3-988a-0843e1539c7c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:22.642085 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c768b9-3da8-4e6c-908f-ee1556b9ec92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:22.643540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c768b9-3da8-4e6c-908f-ee1556b9ec92 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:22.652479 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 915/1836] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:22.669329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 922/1837] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:22 2022] POST /identity/v3/users => generated 303 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:22.669865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c768b9-3da8-4e6c-908f-ee1556b9ec92 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:22.680131 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c768b9-3da8-4e6c-908f-ee1556b9ec92 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:22.684760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969252b3-6592-49c0-aba6-b44c2b21ce90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:22.685969 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969252b3-6592-49c0-aba6-b44c2b21ce90 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:22.686330 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969252b3-6592-49c0-aba6-b44c2b21ce90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:22.686536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969252b3-6592-49c0-aba6-b44c2b21ce90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:22.687253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969252b3-6592-49c0-aba6-b44c2b21ce90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:22.688821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969252b3-6592-49c0-aba6-b44c2b21ce90 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:22.698347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 916/1838] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:22.703954 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb076310-d6c9-43b3-988a-0843e1539c7c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:22.713818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb076310-d6c9-43b3-988a-0843e1539c7c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:22.718452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b77cca-86fc-4d0d-98a8-e4cf17164e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:22.719326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b77cca-86fc-4d0d-98a8-e4cf17164e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:22.719610 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b77cca-86fc-4d0d-98a8-e4cf17164e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:22.719903 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b77cca-86fc-4d0d-98a8-e4cf17164e4f admin admin] PATH_INFO: `/v3/projects/3a3d294c08ba4012b8f61ebdf463cc73/users/6521bbeecc994b82b09259a637586f75/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:22.736125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b77cca-86fc-4d0d-98a8-e4cf17164e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d294c08ba4012b8f61ebdf463cc73, user_id=6521bbeecc994b82b09259a637586f75, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:22.738891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b77cca-86fc-4d0d-98a8-e4cf17164e4f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:22.841236 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 923/1839] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:22 2022] PUT /identity/v3/projects/3a3d294c08ba4012b8f61ebdf463cc73/users/6521bbeecc994b82b09259a637586f75/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:22.842004 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969252b3-6592-49c0-aba6-b44c2b21ce90 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:22.848613 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969252b3-6592-49c0-aba6-b44c2b21ce90 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:22.984455 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8cedf-73e0-4275-a642-0d1ecfda8d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:22.985214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8cedf-73e0-4275-a642-0d1ecfda8d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:22.997153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8cedf-73e0-4275-a642-0d1ecfda8d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:22.997153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8cedf-73e0-4275-a642-0d1ecfda8d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:22.997153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8cedf-73e0-4275-a642-0d1ecfda8d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:22.997153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8cedf-73e0-4275-a642-0d1ecfda8d12 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:23.016885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 917/1840] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:05:23.021340 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b77cca-86fc-4d0d-98a8-e4cf17164e4f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:23.032622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b77cca-86fc-4d0d-98a8-e4cf17164e4f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:23.044975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50123a0-5379-48d0-a132-cccc07a608a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:23.046209 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50123a0-5379-48d0-a132-cccc07a608a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:23.046496 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50123a0-5379-48d0-a132-cccc07a608a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:23.046776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50123a0-5379-48d0-a132-cccc07a608a0 admin admin] PATH_INFO: `/v3/projects/3a3d294c08ba4012b8f61ebdf463cc73/users/6521bbeecc994b82b09259a637586f75/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:23.049522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50123a0-5379-48d0-a132-cccc07a608a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3d294c08ba4012b8f61ebdf463cc73, user_id=6521bbeecc994b82b09259a637586f75, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:23.054474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50123a0-5379-48d0-a132-cccc07a608a0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:23.083314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 924/1841] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:23 2022] PUT /identity/v3/projects/3a3d294c08ba4012b8f61ebdf463cc73/users/6521bbeecc994b82b09259a637586f75/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:23.094126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca76685-678b-4170-8505-4b0ebb428c8d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:23.094126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca76685-678b-4170-8505-4b0ebb428c8d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:23.094126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca76685-678b-4170-8505-4b0ebb428c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:23.145233 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1ca76685-678b-4170-8505-4b0ebb428c8d None None] MFA Rules not processed for user `6521bbeecc994b82b09259a637586f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:23.146778 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1ca76685-678b-4170-8505-4b0ebb428c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:23.219680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 918/1842] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:23.330062 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50123a0-5379-48d0-a132-cccc07a608a0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:23.387502 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50123a0-5379-48d0-a132-cccc07a608a0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:23.391449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd28a24-633b-4197-88ab-59ea4e41a408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:23.392132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd28a24-633b-4197-88ab-59ea4e41a408 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:23.392417 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd28a24-633b-4197-88ab-59ea4e41a408 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:23.392695 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd28a24-633b-4197-88ab-59ea4e41a408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:23.403273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd28a24-633b-4197-88ab-59ea4e41a408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:23.404751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd28a24-633b-4197-88ab-59ea4e41a408 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:23.414322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 925/1843] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:23.492471 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71884932-f540-45fe-a66c-1a11b2dccac3 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:23.492974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71884932-f540-45fe-a66c-1a11b2dccac3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:23.493297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71884932-f540-45fe-a66c-1a11b2dccac3 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:23.494790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 919/1844] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 11 21:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:05:23.523424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e2ebf-c03d-4b39-9f82-404e3b57c718 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:23.523804 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e2ebf-c03d-4b39-9f82-404e3b57c718 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:23.524094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e2ebf-c03d-4b39-9f82-404e3b57c718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:23.563041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ce5e2ebf-c03d-4b39-9f82-404e3b57c718 None None] MFA Rules not processed for user `f400b94d3fbc40bdace4860fe83a0891`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:23.568192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ce5e2ebf-c03d-4b39-9f82-404e3b57c718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:23.613687 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71884932-f540-45fe-a66c-1a11b2dccac3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:23.637559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71884932-f540-45fe-a66c-1a11b2dccac3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:23.669043 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee130ea1-2d11-45e7-b96e-58ed03bafa11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:23.669986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee130ea1-2d11-45e7-b96e-58ed03bafa11 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:23.670373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee130ea1-2d11-45e7-b96e-58ed03bafa11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:23.670755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee130ea1-2d11-45e7-b96e-58ed03bafa11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:23.766722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 926/1845] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 11 21:05:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:23.810948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee130ea1-2d11-45e7-b96e-58ed03bafa11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:23.816355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee130ea1-2d11-45e7-b96e-58ed03bafa11 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:23.843869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 920/1846] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:23.947643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e2ebf-c03d-4b39-9f82-404e3b57c718 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:23.959866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e2ebf-c03d-4b39-9f82-404e3b57c718 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:23.967365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b21a21-bc69-4c7d-a2fd-20cd100bb8db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:23.970937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b21a21-bc69-4c7d-a2fd-20cd100bb8db service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:23.970937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b21a21-bc69-4c7d-a2fd-20cd100bb8db service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:23.970937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b21a21-bc69-4c7d-a2fd-20cd100bb8db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:23.980291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b21a21-bc69-4c7d-a2fd-20cd100bb8db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:23.981927 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b21a21-bc69-4c7d-a2fd-20cd100bb8db service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:23.998590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 927/1847] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:29.294779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee130ea1-2d11-45e7-b96e-58ed03bafa11 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:29.324349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee130ea1-2d11-45e7-b96e-58ed03bafa11 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:29.337616 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e002f-3006-4c08-a997-68dafc04787a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:29.338679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e002f-3006-4c08-a997-68dafc04787a service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:29.339154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e002f-3006-4c08-a997-68dafc04787a service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:29.339633 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e002f-3006-4c08-a997-68dafc04787a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:29.345812 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c01e002f-3006-4c08-a997-68dafc04787a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:29.443270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e002f-3006-4c08-a997-68dafc04787a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:29.445025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e002f-3006-4c08-a997-68dafc04787a service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:29.459913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 921/1848] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:30.255052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b21a21-bc69-4c7d-a2fd-20cd100bb8db service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:30.338995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b21a21-bc69-4c7d-a2fd-20cd100bb8db service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:30.344583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a8e41-64fe-4a34-8add-d78ea50c6e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:30.345462 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a8e41-64fe-4a34-8add-d78ea50c6e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:30.345819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a8e41-64fe-4a34-8add-d78ea50c6e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:30.346216 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a8e41-64fe-4a34-8add-d78ea50c6e04 admin admin] PATH_INFO: `/v3/users/90fd913fd5004af294e85462c260655b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:30.347411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a8e41-64fe-4a34-8add-d78ea50c6e04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90fd913fd5004af294e85462c260655b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:30.349380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a8e41-64fe-4a34-8add-d78ea50c6e04 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:30.581056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c99a8e41-64fe-4a34-8add-d78ea50c6e04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90fd913fd5004af294e85462c260655b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:30.593854 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c99a8e41-64fe-4a34-8add-d78ea50c6e04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90fd913fd5004af294e85462c260655b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:30.696082 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c99a8e41-64fe-4a34-8add-d78ea50c6e04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90fd913fd5004af294e85462c260655b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:30.696778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c99a8e41-64fe-4a34-8add-d78ea50c6e04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90fd913fd5004af294e85462c260655b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:30.697407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c99a8e41-64fe-4a34-8add-d78ea50c6e04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90fd913fd5004af294e85462c260655b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:30.730959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 928/1849] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:30 2022] DELETE /identity/v3/users/90fd913fd5004af294e85462c260655b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:30.735750 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aeab0-39ae-42ab-a838-0cd6be9d9dd2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:30.736278 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aeab0-39ae-42ab-a838-0cd6be9d9dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:30.736368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aeab0-39ae-42ab-a838-0cd6be9d9dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:30.763137 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-115aeab0-39ae-42ab-a838-0cd6be9d9dd2 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:30.763137 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-115aeab0-39ae-42ab-a838-0cd6be9d9dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:30.845797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 922/1850] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:30.854192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a8e41-64fe-4a34-8add-d78ea50c6e04 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:30.855887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c99a8e41-64fe-4a34-8add-d78ea50c6e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:30.925025 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a8e41-64fe-4a34-8add-d78ea50c6e04 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:30.929513 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0fefe-0ad1-47ab-a0d4-cc708acfa73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:30.933693 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0fefe-0ad1-47ab-a0d4-cc708acfa73b service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:30.933693 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0fefe-0ad1-47ab-a0d4-cc708acfa73b service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:30.933693 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0fefe-0ad1-47ab-a0d4-cc708acfa73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:30.942592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0fefe-0ad1-47ab-a0d4-cc708acfa73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:30.944484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0fefe-0ad1-47ab-a0d4-cc708acfa73b service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:30.954537 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 929/1851] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:31.564523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115aeab0-39ae-42ab-a838-0cd6be9d9dd2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:31.566217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-115aeab0-39ae-42ab-a838-0cd6be9d9dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:31.581258 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115aeab0-39ae-42ab-a838-0cd6be9d9dd2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:31.586071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:31.587167 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:31.587604 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:31.588028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] PATH_INFO: `/v3/projects/cb915dc2619b459f8462d19f62039e67` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:31.589387 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb915dc2619b459f8462d19f62039e67)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:31.591581 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:31.738351 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb915dc2619b459f8462d19f62039e67', 'request_id': 'req-ef0e157f-70e5-4f24-8366-f30b4e711a31'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:31.746428 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb915dc2619b459f8462d19f62039e67', 'request_id': 'req-ef0e157f-70e5-4f24-8366-f30b4e711a31'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:31.755094 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb915dc2619b459f8462d19f62039e67', 'request_id': 'req-ef0e157f-70e5-4f24-8366-f30b4e711a31'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:31.850101 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] The token cache is being invalidate because project cb915dc2619b459f8462d19f62039e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:31.850399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:31.851073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:31.852865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 923/1852] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:31 2022] DELETE /identity/v3/projects/cb915dc2619b459f8462d19f62039e67 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:31.857011 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0fefe-0ad1-47ab-a0d4-cc708acfa73b service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:31.873758 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0fefe-0ad1-47ab-a0d4-cc708acfa73b service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:31.971738 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:31.973285 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:31.999013 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74f8c2-4e91-46d4-ab77-28398f3e0f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:31.999946 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74f8c2-4e91-46d4-ab77-28398f3e0f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:32.000236 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74f8c2-4e91-46d4-ab77-28398f3e0f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:32.000543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74f8c2-4e91-46d4-ab77-28398f3e0f4c admin admin] PATH_INFO: `/v3/users/6521bbeecc994b82b09259a637586f75` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:32.002347 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74f8c2-4e91-46d4-ab77-28398f3e0f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6521bbeecc994b82b09259a637586f75)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:32.005131 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74f8c2-4e91-46d4-ab77-28398f3e0f4c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:32.083453 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e157f-70e5-4f24-8366-f30b4e711a31 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:32.088672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a6559-63f0-455f-a34a-97a333cbeb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:32.089778 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a6559-63f0-455f-a34a-97a333cbeb3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:32.089989 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a6559-63f0-455f-a34a-97a333cbeb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:32.090267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a6559-63f0-455f-a34a-97a333cbeb3a admin admin] PATH_INFO: `/v3/users/83686c3cce074976849dbf415b016772` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:32.091491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a6559-63f0-455f-a34a-97a333cbeb3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=83686c3cce074976849dbf415b016772)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:32.093441 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a6559-63f0-455f-a34a-97a333cbeb3a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:32.230407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8b74f8c2-4e91-46d4-ab77-28398f3e0f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6521bbeecc994b82b09259a637586f75'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:32.255327 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8b74f8c2-4e91-46d4-ab77-28398f3e0f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6521bbeecc994b82b09259a637586f75'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:32.262771 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a59a6559-63f0-455f-a34a-97a333cbeb3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83686c3cce074976849dbf415b016772'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:32.381954 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8b74f8c2-4e91-46d4-ab77-28398f3e0f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6521bbeecc994b82b09259a637586f75'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:32.382603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8b74f8c2-4e91-46d4-ab77-28398f3e0f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6521bbeecc994b82b09259a637586f75'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:32.383215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8b74f8c2-4e91-46d4-ab77-28398f3e0f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6521bbeecc994b82b09259a637586f75'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:32.401616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 930/1853] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:31 2022] DELETE /identity/v3/users/6521bbeecc994b82b09259a637586f75 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:32.455899 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a59a6559-63f0-455f-a34a-97a333cbeb3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83686c3cce074976849dbf415b016772'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:32.463932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a59a6559-63f0-455f-a34a-97a333cbeb3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83686c3cce074976849dbf415b016772'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:32.464828 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a59a6559-63f0-455f-a34a-97a333cbeb3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83686c3cce074976849dbf415b016772'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:32.465438 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a59a6559-63f0-455f-a34a-97a333cbeb3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83686c3cce074976849dbf415b016772'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:32.483255 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 924/1854] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:31 2022] DELETE /identity/v3/users/83686c3cce074976849dbf415b016772 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:32.488303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631528d-aa9e-4d1b-af01-43ee2428c05d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:32.488600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631528d-aa9e-4d1b-af01-43ee2428c05d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:32.491619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631528d-aa9e-4d1b-af01-43ee2428c05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:32.507743 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c631528d-aa9e-4d1b-af01-43ee2428c05d None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:32.508943 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c631528d-aa9e-4d1b-af01-43ee2428c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:32.568750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 931/1855] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:32.580313 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a6559-63f0-455f-a34a-97a333cbeb3a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:32.581750 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a59a6559-63f0-455f-a34a-97a333cbeb3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:32.651572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a6559-63f0-455f-a34a-97a333cbeb3a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:32.655940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7f2d-1e82-4f16-a583-23db97c7845e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:32.656760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7f2d-1e82-4f16-a583-23db97c7845e service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:32.657236 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7f2d-1e82-4f16-a583-23db97c7845e service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:32.657618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7f2d-1e82-4f16-a583-23db97c7845e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:32.667608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc7f2d-1e82-4f16-a583-23db97c7845e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:32.669468 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc7f2d-1e82-4f16-a583-23db97c7845e service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:32.702334 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 925/1856] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:32.869088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631528d-aa9e-4d1b-af01-43ee2428c05d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:32.870532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c631528d-aa9e-4d1b-af01-43ee2428c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:32.885374 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631528d-aa9e-4d1b-af01-43ee2428c05d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:32.890964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f887b0-d31d-4db6-83c9-825f3d6653a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:32.892276 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f887b0-d31d-4db6-83c9-825f3d6653a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:32.892677 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f887b0-d31d-4db6-83c9-825f3d6653a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:32.892972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f887b0-d31d-4db6-83c9-825f3d6653a7 admin admin] PATH_INFO: `/v3/projects/3a3d294c08ba4012b8f61ebdf463cc73` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:32.895475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f887b0-d31d-4db6-83c9-825f3d6653a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3d294c08ba4012b8f61ebdf463cc73)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:32.899426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f887b0-d31d-4db6-83c9-825f3d6653a7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:33.024489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a7f887b0-d31d-4db6-83c9-825f3d6653a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3d294c08ba4012b8f61ebdf463cc73', 'request_id': 'req-a7f887b0-d31d-4db6-83c9-825f3d6653a7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.034227 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a7f887b0-d31d-4db6-83c9-825f3d6653a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3d294c08ba4012b8f61ebdf463cc73', 'request_id': 'req-a7f887b0-d31d-4db6-83c9-825f3d6653a7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.044010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a7f887b0-d31d-4db6-83c9-825f3d6653a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3d294c08ba4012b8f61ebdf463cc73', 'request_id': 'req-a7f887b0-d31d-4db6-83c9-825f3d6653a7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.146253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a7f887b0-d31d-4db6-83c9-825f3d6653a7 admin admin] The token cache is being invalidate because project 3a3d294c08ba4012b8f61ebdf463cc73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:33.146253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a7f887b0-d31d-4db6-83c9-825f3d6653a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.146496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7f2d-1e82-4f16-a583-23db97c7845e service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:33.146905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a7f887b0-d31d-4db6-83c9-825f3d6653a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.146986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dddc7f2d-1e82-4f16-a583-23db97c7845e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:33.148279 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 932/1857] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:32 2022] DELETE /identity/v3/projects/3a3d294c08ba4012b8f61ebdf463cc73 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:33.154765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1242b-cbfe-4faf-a9ed-a44a632a3e63 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:33.156103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1242b-cbfe-4faf-a9ed-a44a632a3e63 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:33.156537 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1242b-cbfe-4faf-a9ed-a44a632a3e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:33.161733 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7f2d-1e82-4f16-a583-23db97c7845e service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:33.180055 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-eda1242b-cbfe-4faf-a9ed-a44a632a3e63 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:33.181329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eda1242b-cbfe-4faf-a9ed-a44a632a3e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:33.249732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:33.250755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:33.251026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:33.251509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] PATH_INFO: `/v3/projects/5235dc9cf70d4bf5b9f6e77a9b4d7927` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:33.253700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5235dc9cf70d4bf5b9f6e77a9b4d7927)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:33.256008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:33.274602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 933/1858] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:33.282558 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb9ec1-63b1-4495-9500-d9739e83ff39 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:33.282850 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb9ec1-63b1-4495-9500-d9739e83ff39 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:33.283314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb9ec1-63b1-4495-9500-d9739e83ff39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:33.308650 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d8eb9ec1-63b1-4495-9500-d9739e83ff39 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:33.309890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d8eb9ec1-63b1-4495-9500-d9739e83ff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:33.319284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 934/1859] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:33.327257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb9ec1-63b1-4495-9500-d9739e83ff39 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:33.340122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb9ec1-63b1-4495-9500-d9739e83ff39 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:33.347236 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858e66d-805b-45e3-811a-8a757e8ac34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:33.348006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858e66d-805b-45e3-811a-8a757e8ac34a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:33.348510 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858e66d-805b-45e3-811a-8a757e8ac34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:33.348997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858e66d-805b-45e3-811a-8a757e8ac34a admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:33.349834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858e66d-805b-45e3-811a-8a757e8ac34a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:33.350347 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858e66d-805b-45e3-811a-8a757e8ac34a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:33.352127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858e66d-805b-45e3-811a-8a757e8ac34a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:33.369689 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 935/1860] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:05:33.374028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858e66d-805b-45e3-811a-8a757e8ac34a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:33.377337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5235dc9cf70d4bf5b9f6e77a9b4d7927', 'request_id': 'req-4eb070e6-cb4c-4736-a8f8-07a16632622e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.384713 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858e66d-805b-45e3-811a-8a757e8ac34a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:33.385950 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5235dc9cf70d4bf5b9f6e77a9b4d7927', 'request_id': 'req-4eb070e6-cb4c-4736-a8f8-07a16632622e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.399253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5235dc9cf70d4bf5b9f6e77a9b4d7927', 'request_id': 'req-4eb070e6-cb4c-4736-a8f8-07a16632622e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.500195 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fabde-9187-487c-9251-10c68ff900d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:33.500972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fabde-9187-487c-9251-10c68ff900d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:33.501174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fabde-9187-487c-9251-10c68ff900d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:33.501564 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fabde-9187-487c-9251-10c68ff900d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:33.502178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fabde-9187-487c-9251-10c68ff900d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:33.504678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fabde-9187-487c-9251-10c68ff900d7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:33.523302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] The token cache is being invalidate because project 5235dc9cf70d4bf5b9f6e77a9b4d7927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:33.523769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.525217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.527301 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 926/1861] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:33 2022] DELETE /identity/v3/projects/5235dc9cf70d4bf5b9f6e77a9b4d7927 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:33.531568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:33.533912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:33.556351 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb070e6-cb4c-4736-a8f8-07a16632622e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:33.563221 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d4c71-d418-4d26-941c-2b3247833b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:33.564007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d4c71-d418-4d26-941c-2b3247833b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:33.564289 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d4c71-d418-4d26-941c-2b3247833b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:33.564568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d4c71-d418-4d26-941c-2b3247833b1d admin admin] PATH_INFO: `/v3/users/7eb207b48c6e4322a19af8db3631cc0f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:33.565797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d4c71-d418-4d26-941c-2b3247833b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb207b48c6e4322a19af8db3631cc0f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:33.567768 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d4c71-d418-4d26-941c-2b3247833b1d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:33.636391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 936/1862] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:33 2022] POST /identity/v3/projects => generated 383 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:33.637660 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fabde-9187-487c-9251-10c68ff900d7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:33.639371 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-df9fabde-9187-487c-9251-10c68ff900d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:33.700990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fabde-9187-487c-9251-10c68ff900d7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:33.706326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde0531-cca2-432e-afa0-89299b3a5bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:33.706985 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde0531-cca2-432e-afa0-89299b3a5bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:33.707263 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde0531-cca2-432e-afa0-89299b3a5bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:33.707534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde0531-cca2-432e-afa0-89299b3a5bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:33.708208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde0531-cca2-432e-afa0-89299b3a5bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:33.710148 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde0531-cca2-432e-afa0-89299b3a5bb3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:33.767386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f21d4c71-d418-4d26-941c-2b3247833b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb207b48c6e4322a19af8db3631cc0f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.814001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 937/1863] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:33 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:33.815087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde0531-cca2-432e-afa0-89299b3a5bb3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:33.825573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde0531-cca2-432e-afa0-89299b3a5bb3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:33.830948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf5b8b-931a-4579-be08-e4f1fde3efe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:33.831664 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf5b8b-931a-4579-be08-e4f1fde3efe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:33.831946 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf5b8b-931a-4579-be08-e4f1fde3efe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:33.832223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf5b8b-931a-4579-be08-e4f1fde3efe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:33.832980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf5b8b-931a-4579-be08-e4f1fde3efe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:33.834691 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf5b8b-931a-4579-be08-e4f1fde3efe8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:33.851971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 938/1864] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:33.853121 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf5b8b-931a-4579-be08-e4f1fde3efe8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:33.862850 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf5b8b-931a-4579-be08-e4f1fde3efe8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:33.870894 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f2df8-d202-4a7b-8d77-7217e1902115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:33.871584 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2df8-d202-4a7b-8d77-7217e1902115 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:33.871870 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2df8-d202-4a7b-8d77-7217e1902115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:33.872186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2df8-d202-4a7b-8d77-7217e1902115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:33.872883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f2df8-d202-4a7b-8d77-7217e1902115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:33.874691 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f21d4c71-d418-4d26-941c-2b3247833b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb207b48c6e4322a19af8db3631cc0f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.875054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f2df8-d202-4a7b-8d77-7217e1902115 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:33.883539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f21d4c71-d418-4d26-941c-2b3247833b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb207b48c6e4322a19af8db3631cc0f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.884476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f21d4c71-d418-4d26-941c-2b3247833b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb207b48c6e4322a19af8db3631cc0f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.885428 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f21d4c71-d418-4d26-941c-2b3247833b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb207b48c6e4322a19af8db3631cc0f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:33.885682 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 939/1865] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:33.895006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f2df8-d202-4a7b-8d77-7217e1902115 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:33.897727 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ae7f2df8-d202-4a7b-8d77-7217e1902115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:33.910081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 927/1866] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:33 2022] DELETE /identity/v3/users/7eb207b48c6e4322a19af8db3631cc0f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:33.928944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f2df8-d202-4a7b-8d77-7217e1902115 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:34.024132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71009e-7c5a-4447-96a4-4c6a310eaa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:34.025163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71009e-7c5a-4447-96a4-4c6a310eaa45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:34.025517 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71009e-7c5a-4447-96a4-4c6a310eaa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:34.025847 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71009e-7c5a-4447-96a4-4c6a310eaa45 admin admin] PATH_INFO: `/v3/projects/3fcbbd15ab1d4896a70f3da30c5c4544/users/a15759f48c6e47f286931297166bd182/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:34.046667 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71009e-7c5a-4447-96a4-4c6a310eaa45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fcbbd15ab1d4896a70f3da30c5c4544, user_id=a15759f48c6e47f286931297166bd182, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:34.049736 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71009e-7c5a-4447-96a4-4c6a310eaa45 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:34.147946 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 940/1867] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:33 2022] PUT /identity/v3/projects/3fcbbd15ab1d4896a70f3da30c5c4544/users/a15759f48c6e47f286931297166bd182/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:34.160659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dcea8-a700-4ae8-a79b-cb3f3510f466 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:34.161121 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dcea8-a700-4ae8-a79b-cb3f3510f466 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:34.161210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dcea8-a700-4ae8-a79b-cb3f3510f466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:34.189194 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5d8dcea8-a700-4ae8-a79b-cb3f3510f466 None None] MFA Rules not processed for user `a15759f48c6e47f286931297166bd182`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:34.190463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5d8dcea8-a700-4ae8-a79b-cb3f3510f466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:34.265629 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 928/1868] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:34.276028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71009e-7c5a-4447-96a4-4c6a310eaa45 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:34.395172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71009e-7c5a-4447-96a4-4c6a310eaa45 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:34.401351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8597f1f-a172-44a4-9f7e-13078a35ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:34.402045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8597f1f-a172-44a4-9f7e-13078a35ef19 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:34.402335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8597f1f-a172-44a4-9f7e-13078a35ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:34.402644 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8597f1f-a172-44a4-9f7e-13078a35ef19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:34.403350 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8597f1f-a172-44a4-9f7e-13078a35ef19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:34.405301 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8597f1f-a172-44a4-9f7e-13078a35ef19 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:34.513449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 941/1869] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:34 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:05:34.519409 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dcea8-a700-4ae8-a79b-cb3f3510f466 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:34.531783 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dcea8-a700-4ae8-a79b-cb3f3510f466 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:34.603107 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0b4f5-c161-4423-8860-3578c1e2b4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:34.603831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0b4f5-c161-4423-8860-3578c1e2b4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:34.604113 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0b4f5-c161-4423-8860-3578c1e2b4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:34.604386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0b4f5-c161-4423-8860-3578c1e2b4a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:34.605099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0b4f5-c161-4423-8860-3578c1e2b4a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:34.607063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0b4f5-c161-4423-8860-3578c1e2b4a0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:34.643762 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8597f1f-a172-44a4-9f7e-13078a35ef19 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:34.646554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d8597f1f-a172-44a4-9f7e-13078a35ef19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:34.662128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8597f1f-a172-44a4-9f7e-13078a35ef19 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:34.669492 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:34.670107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:34.676409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:34.676409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102 admin admin] PATH_INFO: `/v3/projects/e2eaec42d9284f888dac14659fee3418` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:34.676409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2eaec42d9284f888dac14659fee3418)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:34.676409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:34.723839 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 929/1870] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:34 2022] POST /identity/v3/users => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:34.728100 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0b4f5-c161-4423-8860-3578c1e2b4a0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:34.737845 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0b4f5-c161-4423-8860-3578c1e2b4a0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:34.742375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb6d72-3d2d-45cd-af48-551ac066edb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:34.743069 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb6d72-3d2d-45cd-af48-551ac066edb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:34.743352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb6d72-3d2d-45cd-af48-551ac066edb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:34.743632 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb6d72-3d2d-45cd-af48-551ac066edb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:34.744373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb6d72-3d2d-45cd-af48-551ac066edb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:34.746007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb6d72-3d2d-45cd-af48-551ac066edb7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:34.755718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 930/1871] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:34.759801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb6d72-3d2d-45cd-af48-551ac066edb7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:34.770334 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb6d72-3d2d-45cd-af48-551ac066edb7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:34.777000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3318f79-fe63-4f1a-9b96-3f633f7306a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:34.778030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3318f79-fe63-4f1a-9b96-3f633f7306a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:34.778348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3318f79-fe63-4f1a-9b96-3f633f7306a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:34.783379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3318f79-fe63-4f1a-9b96-3f633f7306a4 admin admin] PATH_INFO: `/v3/projects/5619e400dbac4f5a835647048ab93365/users/484374cf81b94e50bec1d9e48b7d950b/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:34.794626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2eaec42d9284f888dac14659fee3418', 'request_id': 'req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:34.796525 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3318f79-fe63-4f1a-9b96-3f633f7306a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5619e400dbac4f5a835647048ab93365, user_id=484374cf81b94e50bec1d9e48b7d950b, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:34.799688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3318f79-fe63-4f1a-9b96-3f633f7306a4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:34.807022 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2eaec42d9284f888dac14659fee3418', 'request_id': 'req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:34.828626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2eaec42d9284f888dac14659fee3418', 'request_id': 'req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:34.907246 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 931/1872] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:34 2022] PUT /identity/v3/projects/5619e400dbac4f5a835647048ab93365/users/484374cf81b94e50bec1d9e48b7d950b/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:34.911446 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3318f79-fe63-4f1a-9b96-3f633f7306a4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:34.978686 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102 admin admin] The token cache is being invalidate because project e2eaec42d9284f888dac14659fee3418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:34.979406 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:34.979913 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e7722f0d-3ddb-4ffa-ba3b-4f98d65fc102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:34.982549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 942/1873] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:34 2022] DELETE /identity/v3/projects/e2eaec42d9284f888dac14659fee3418 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:34.987923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945168ad-3234-49a0-9b53-03ef2c65b396 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:34.988215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945168ad-3234-49a0-9b53-03ef2c65b396 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:34.988499 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945168ad-3234-49a0-9b53-03ef2c65b396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:35.008494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3318f79-fe63-4f1a-9b96-3f633f7306a4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:35.008804 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-945168ad-3234-49a0-9b53-03ef2c65b396 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:35.010068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-945168ad-3234-49a0-9b53-03ef2c65b396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:35.013818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b009f45-370b-422f-9c4f-0a8e0e2c9a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:35.014588 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b009f45-370b-422f-9c4f-0a8e0e2c9a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:35.015395 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b009f45-370b-422f-9c4f-0a8e0e2c9a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:35.015839 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b009f45-370b-422f-9c4f-0a8e0e2c9a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:35.016613 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b009f45-370b-422f-9c4f-0a8e0e2c9a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:35.018511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b009f45-370b-422f-9c4f-0a8e0e2c9a1c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:35.019750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 943/1874] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:35.034726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 932/1875] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:35.034948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4f2ba-6c7c-4067-ba78-4ed39206b3ff None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:35.034948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4f2ba-6c7c-4067-ba78-4ed39206b3ff None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:35.034948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4f2ba-6c7c-4067-ba78-4ed39206b3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:35.037573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b009f45-370b-422f-9c4f-0a8e0e2c9a1c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:35.039223 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7b009f45-370b-422f-9c4f-0a8e0e2c9a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:35.052810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-aef4f2ba-6c7c-4067-ba78-4ed39206b3ff None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:35.054064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-aef4f2ba-6c7c-4067-ba78-4ed39206b3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:35.055688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b009f45-370b-422f-9c4f-0a8e0e2c9a1c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:35.064659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52001712-bdda-427f-848f-4cb4e365c0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:35.065708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52001712-bdda-427f-848f-4cb4e365c0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:35.066130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52001712-bdda-427f-848f-4cb4e365c0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:35.066466 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52001712-bdda-427f-848f-4cb4e365c0fb admin admin] PATH_INFO: `/v3/projects/5619e400dbac4f5a835647048ab93365/users/484374cf81b94e50bec1d9e48b7d950b/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:35.068710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 944/1876] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:35.068895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52001712-bdda-427f-848f-4cb4e365c0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5619e400dbac4f5a835647048ab93365, user_id=484374cf81b94e50bec1d9e48b7d950b, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:35.069749 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4f2ba-6c7c-4067-ba78-4ed39206b3ff None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:35.071637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52001712-bdda-427f-848f-4cb4e365c0fb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:35.081626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4f2ba-6c7c-4067-ba78-4ed39206b3ff None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:35.085359 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 933/1877] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:35 2022] PUT /identity/v3/projects/5619e400dbac4f5a835647048ab93365/users/484374cf81b94e50bec1d9e48b7d950b/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:35.095509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cc924-c271-4110-bfed-09b756962332 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:35.095792 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cc924-c271-4110-bfed-09b756962332 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:35.096211 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526cc924-c271-4110-bfed-09b756962332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:35.126982 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-526cc924-c271-4110-bfed-09b756962332 None None] MFA Rules not processed for user `484374cf81b94e50bec1d9e48b7d950b`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:35.128444 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-526cc924-c271-4110-bfed-09b756962332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:35.152836 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f97fc7-c556-4f56-97e1-21b34431b41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:35.153507 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f97fc7-c556-4f56-97e1-21b34431b41b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:35.153820 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f97fc7-c556-4f56-97e1-21b34431b41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:35.154094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f97fc7-c556-4f56-97e1-21b34431b41b admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:35.154987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f97fc7-c556-4f56-97e1-21b34431b41b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:35.155297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f97fc7-c556-4f56-97e1-21b34431b41b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:35.156916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f97fc7-c556-4f56-97e1-21b34431b41b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:35.171414 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 945/1878] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:05:35.172264 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f97fc7-c556-4f56-97e1-21b34431b41b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:35.174553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d2f97fc7-c556-4f56-97e1-21b34431b41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:35.187585 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f97fc7-c556-4f56-97e1-21b34431b41b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:35.193197 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f59452-11f1-4ea2-8664-1df222ef0064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:35.194195 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f59452-11f1-4ea2-8664-1df222ef0064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:35.194618 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f59452-11f1-4ea2-8664-1df222ef0064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:35.194896 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f59452-11f1-4ea2-8664-1df222ef0064 admin admin] PATH_INFO: `/v3/users/d55939c958ba4417b576f98be68f8c05` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:35.196164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f59452-11f1-4ea2-8664-1df222ef0064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55939c958ba4417b576f98be68f8c05)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:35.198167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f59452-11f1-4ea2-8664-1df222ef0064 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:35.211441 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 934/1879] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:35.212957 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cc924-c271-4110-bfed-09b756962332 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:35.228730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526cc924-c271-4110-bfed-09b756962332 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:35.235801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e8f2e-5edd-4c9f-9360-0cda34ae85f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:35.236600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8f2e-5edd-4c9f-9360-0cda34ae85f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:35.236950 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8f2e-5edd-4c9f-9360-0cda34ae85f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:35.237251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8f2e-5edd-4c9f-9360-0cda34ae85f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:35.238028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e8f2e-5edd-4c9f-9360-0cda34ae85f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:35.239931 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e8f2e-5edd-4c9f-9360-0cda34ae85f9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:35.336938 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 935/1880] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:35 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:35.340629 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e8f2e-5edd-4c9f-9360-0cda34ae85f9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:35.340629 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bc8e8f2e-5edd-4c9f-9360-0cda34ae85f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:35.380866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f5f59452-11f1-4ea2-8664-1df222ef0064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55939c958ba4417b576f98be68f8c05'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:35.389674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f5f59452-11f1-4ea2-8664-1df222ef0064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55939c958ba4417b576f98be68f8c05'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:35.427618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e8f2e-5edd-4c9f-9360-0cda34ae85f9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:35.433250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b870c7-da05-4626-8755-b77addbd0d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:35.434154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b870c7-da05-4626-8755-b77addbd0d07 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:35.434509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b870c7-da05-4626-8755-b77addbd0d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:35.434908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b870c7-da05-4626-8755-b77addbd0d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:35.501880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b870c7-da05-4626-8755-b77addbd0d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:35.503882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b870c7-da05-4626-8755-b77addbd0d07 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:35.514445 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 936/1881] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:35.515436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b870c7-da05-4626-8755-b77addbd0d07 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:35.543289 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f5f59452-11f1-4ea2-8664-1df222ef0064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55939c958ba4417b576f98be68f8c05'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:35.545227 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f5f59452-11f1-4ea2-8664-1df222ef0064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55939c958ba4417b576f98be68f8c05'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:35.548877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f5f59452-11f1-4ea2-8664-1df222ef0064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55939c958ba4417b576f98be68f8c05'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:35.586567 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 946/1882] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:35 2022] DELETE /identity/v3/users/d55939c958ba4417b576f98be68f8c05 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:35.588391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a121-602b-470b-81d2-f8e1c81cf7e7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:35.588900 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a121-602b-470b-81d2-f8e1c81cf7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:35.589471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a121-602b-470b-81d2-f8e1c81cf7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:35.607535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-faf2a121-602b-470b-81d2-f8e1c81cf7e7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:35.609907 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-faf2a121-602b-470b-81d2-f8e1c81cf7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:35.620668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b870c7-da05-4626-8755-b77addbd0d07 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:35.693268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c92f0-ce90-4ddc-a72b-07067f13706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:35.694546 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c92f0-ce90-4ddc-a72b-07067f13706b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:35.694839 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c92f0-ce90-4ddc-a72b-07067f13706b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:35.695182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c92f0-ce90-4ddc-a72b-07067f13706b admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:35.696170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c92f0-ce90-4ddc-a72b-07067f13706b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:35.698457 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c92f0-ce90-4ddc-a72b-07067f13706b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:35.701830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 947/1883] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:35.702910 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a121-602b-470b-81d2-f8e1c81cf7e7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:35.705959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-faf2a121-602b-470b-81d2-f8e1c81cf7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:35.773755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a121-602b-470b-81d2-f8e1c81cf7e7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:35.778704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8a03f-e014-4eec-8e30-79be2c0339d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:35.779522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8a03f-e014-4eec-8e30-79be2c0339d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:35.779809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8a03f-e014-4eec-8e30-79be2c0339d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:35.780137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8a03f-e014-4eec-8e30-79be2c0339d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:35.783453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-67e8a03f-e014-4eec-8e30-79be2c0339d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:35.810869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 937/1884] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:35 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:35.812276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c92f0-ce90-4ddc-a72b-07067f13706b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:35.815945 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b84c92f0-ce90-4ddc-a72b-07067f13706b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:35.890135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c92f0-ce90-4ddc-a72b-07067f13706b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:35.894146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737e4df-7fda-41ff-85da-56bc01916d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:35.894818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737e4df-7fda-41ff-85da-56bc01916d62 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:35.895070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737e4df-7fda-41ff-85da-56bc01916d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:35.895345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737e4df-7fda-41ff-85da-56bc01916d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:35.901114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8a03f-e014-4eec-8e30-79be2c0339d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:35.902944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8a03f-e014-4eec-8e30-79be2c0339d6 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:35.905177 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737e4df-7fda-41ff-85da-56bc01916d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:35.907640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737e4df-7fda-41ff-85da-56bc01916d62 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:35.917029 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 948/1885] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:35.918033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8a03f-e014-4eec-8e30-79be2c0339d6 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:35.919472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 938/1886] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:35.919815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-67e8a03f-e014-4eec-8e30-79be2c0339d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:35.937117 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8a03f-e014-4eec-8e30-79be2c0339d6 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:35.943526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d20a4-29fc-452f-88ab-bf85efb042f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:35.944417 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d20a4-29fc-452f-88ab-bf85efb042f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:35.944798 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d20a4-29fc-452f-88ab-bf85efb042f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:35.945366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d20a4-29fc-452f-88ab-bf85efb042f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:35.962754 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d20a4-29fc-452f-88ab-bf85efb042f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:35.971018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d20a4-29fc-452f-88ab-bf85efb042f9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:35.987220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 949/1887] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:35.991064 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737e4df-7fda-41ff-85da-56bc01916d62 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:36.006441 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737e4df-7fda-41ff-85da-56bc01916d62 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:36.014157 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7583b-9bb8-4086-b119-39427f61322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:36.015099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7583b-9bb8-4086-b119-39427f61322d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:36.015447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7583b-9bb8-4086-b119-39427f61322d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:36.017675 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7583b-9bb8-4086-b119-39427f61322d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:36.018283 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7583b-9bb8-4086-b119-39427f61322d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:36.022114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7583b-9bb8-4086-b119-39427f61322d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:36.045656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 939/1888] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:36.051155 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d20a4-29fc-452f-88ab-bf85efb042f9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:36.066951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d20a4-29fc-452f-88ab-bf85efb042f9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:36.077286 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c694453-6020-4290-908c-b0de0bf7a086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:36.082103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694453-6020-4290-908c-b0de0bf7a086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:36.084253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694453-6020-4290-908c-b0de0bf7a086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:36.084754 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c694453-6020-4290-908c-b0de0bf7a086 admin admin] PATH_INFO: `/v3/projects/4f7c4f9a54ac476c8fc8697c8dbd967b/users/3816b5165bfc4a22944af6cb81dd6c5a/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:36.149331 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c694453-6020-4290-908c-b0de0bf7a086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7c4f9a54ac476c8fc8697c8dbd967b, user_id=3816b5165bfc4a22944af6cb81dd6c5a, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:36.160564 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c694453-6020-4290-908c-b0de0bf7a086 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:36.334646 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 950/1889] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:36 2022] PUT /identity/v3/projects/4f7c4f9a54ac476c8fc8697c8dbd967b/users/3816b5165bfc4a22944af6cb81dd6c5a/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:36.346731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32b83-9a35-4603-9a75-de7f20639479 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:36.347377 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32b83-9a35-4603-9a75-de7f20639479 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:36.347377 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32b83-9a35-4603-9a75-de7f20639479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:36.380401 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f6b32b83-9a35-4603-9a75-de7f20639479 None None] MFA Rules not processed for user `3816b5165bfc4a22944af6cb81dd6c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:36.381803 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f6b32b83-9a35-4603-9a75-de7f20639479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:36.463981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 940/1890] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:36.470114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c694453-6020-4290-908c-b0de0bf7a086 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:36.641185 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c694453-6020-4290-908c-b0de0bf7a086 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:36.646441 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b19e31-6dfe-4c5b-aadb-5b0905e43259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:36.648392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b19e31-6dfe-4c5b-aadb-5b0905e43259 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:36.648392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b19e31-6dfe-4c5b-aadb-5b0905e43259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:36.648392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b19e31-6dfe-4c5b-aadb-5b0905e43259 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:36.648392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b19e31-6dfe-4c5b-aadb-5b0905e43259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:36.653747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b19e31-6dfe-4c5b-aadb-5b0905e43259 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:36.784522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 951/1891] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:36 2022] POST /identity/v3/projects => generated 365 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:05:36.787423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b32b83-9a35-4603-9a75-de7f20639479 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:36.819302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b32b83-9a35-4603-9a75-de7f20639479 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:36.939274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b19e31-6dfe-4c5b-aadb-5b0905e43259 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:36.942128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-32b19e31-6dfe-4c5b-aadb-5b0905e43259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:36.973901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425d7de-4259-4c4d-86b8-5546d22407cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:36.975774 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d7de-4259-4c4d-86b8-5546d22407cc admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:36.976459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d7de-4259-4c4d-86b8-5546d22407cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:36.979599 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d7de-4259-4c4d-86b8-5546d22407cc admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:36.981867 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425d7de-4259-4c4d-86b8-5546d22407cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:36.989799 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425d7de-4259-4c4d-86b8-5546d22407cc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:37.087819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b19e31-6dfe-4c5b-aadb-5b0905e43259 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:37.095088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:37.096781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:37.097292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:37.097830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] PATH_INFO: `/v3/projects/fb3d2632997346538ac8bccdd74e35c0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:37.099692 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3d2632997346538ac8bccdd74e35c0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:37.103959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:37.129285 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 941/1892] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:36 2022] POST /identity/v3/users => generated 289 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:37.130918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425d7de-4259-4c4d-86b8-5546d22407cc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:37.158438 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425d7de-4259-4c4d-86b8-5546d22407cc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:37.165756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50218f8-a991-4ebc-8f66-0dbd917a3107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:37.166351 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50218f8-a991-4ebc-8f66-0dbd917a3107 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:37.166641 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50218f8-a991-4ebc-8f66-0dbd917a3107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:37.166925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50218f8-a991-4ebc-8f66-0dbd917a3107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:37.167665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50218f8-a991-4ebc-8f66-0dbd917a3107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:37.169423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50218f8-a991-4ebc-8f66-0dbd917a3107 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:37.186708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 942/1893] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:05:37.186708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50218f8-a991-4ebc-8f66-0dbd917a3107 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:37.188955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f50218f8-a991-4ebc-8f66-0dbd917a3107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:37.204053 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50218f8-a991-4ebc-8f66-0dbd917a3107 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:37.210840 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7207c-af56-463e-86bb-92bd24bea91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:37.211977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7207c-af56-463e-86bb-92bd24bea91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:37.212408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7207c-af56-463e-86bb-92bd24bea91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:37.212877 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7207c-af56-463e-86bb-92bd24bea91e admin admin] PATH_INFO: `/v3/users/a15759f48c6e47f286931297166bd182` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:37.215102 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7207c-af56-463e-86bb-92bd24bea91e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a15759f48c6e47f286931297166bd182)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:37.217243 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7207c-af56-463e-86bb-92bd24bea91e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:37.231637 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3d2632997346538ac8bccdd74e35c0', 'request_id': 'req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:37.243077 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3d2632997346538ac8bccdd74e35c0', 'request_id': 'req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:37.251913 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3d2632997346538ac8bccdd74e35c0', 'request_id': 'req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:37.366018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] The token cache is being invalidate because project fb3d2632997346538ac8bccdd74e35c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:37.366018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:37.366018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:37.367544 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 952/1894] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:36 2022] DELETE /identity/v3/projects/fb3d2632997346538ac8bccdd74e35c0 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:37.368655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:37.369880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:37.440040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecbc36-2b48-4c5a-ac2d-9571e776f084 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:37.445396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff5889-3d9a-43f6-a59d-422126d332ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:37.446520 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff5889-3d9a-43f6-a59d-422126d332ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:37.446811 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff5889-3d9a-43f6-a59d-422126d332ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:37.452272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff5889-3d9a-43f6-a59d-422126d332ca admin admin] PATH_INFO: `/v3/projects/92f93b7664204b8eb25f98d926a8b146/users/312dcd0265cb43618cf5dfb858ef1458/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:37.465918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff5889-3d9a-43f6-a59d-422126d332ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f93b7664204b8eb25f98d926a8b146, user_id=312dcd0265cb43618cf5dfb858ef1458, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:37.469440 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff5889-3d9a-43f6-a59d-422126d332ca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:37.524552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3eb7207c-af56-463e-86bb-92bd24bea91e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a15759f48c6e47f286931297166bd182'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:37.623525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 953/1895] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:37 2022] PUT /identity/v3/projects/92f93b7664204b8eb25f98d926a8b146/users/312dcd0265cb43618cf5dfb858ef1458/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:37.626581 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff5889-3d9a-43f6-a59d-422126d332ca admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:37.628396 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f5ff5889-3d9a-43f6-a59d-422126d332ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:37.670596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3eb7207c-af56-463e-86bb-92bd24bea91e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a15759f48c6e47f286931297166bd182'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:37.679381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3eb7207c-af56-463e-86bb-92bd24bea91e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a15759f48c6e47f286931297166bd182'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:37.681068 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3eb7207c-af56-463e-86bb-92bd24bea91e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a15759f48c6e47f286931297166bd182'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:37.684765 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-3eb7207c-af56-463e-86bb-92bd24bea91e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a15759f48c6e47f286931297166bd182'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:37.717019 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 943/1896] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:37 2022] DELETE /identity/v3/users/a15759f48c6e47f286931297166bd182 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:37.719484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7207c-af56-463e-86bb-92bd24bea91e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:37.721359 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3eb7207c-af56-463e-86bb-92bd24bea91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:37.737587 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff5889-3d9a-43f6-a59d-422126d332ca admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:37.824868 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7207c-af56-463e-86bb-92bd24bea91e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:37.832659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803f9dd-3591-4bb1-bb9e-c37f9c5d052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:37.833654 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803f9dd-3591-4bb1-bb9e-c37f9c5d052f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:37.834040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a72606-5eb2-4ad4-879c-b877b1e56e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:37.834192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803f9dd-3591-4bb1-bb9e-c37f9c5d052f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:37.834514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803f9dd-3591-4bb1-bb9e-c37f9c5d052f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:37.835385 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803f9dd-3591-4bb1-bb9e-c37f9c5d052f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:37.835499 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72606-5eb2-4ad4-879c-b877b1e56e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:37.836146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72606-5eb2-4ad4-879c-b877b1e56e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:37.836581 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a72606-5eb2-4ad4-879c-b877b1e56e22 admin admin] PATH_INFO: `/v3/users/1e91e944a503490682bf742dda5fcfc2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:37.837394 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803f9dd-3591-4bb1-bb9e-c37f9c5d052f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:37.838559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a72606-5eb2-4ad4-879c-b877b1e56e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e91e944a503490682bf742dda5fcfc2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:37.840994 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a72606-5eb2-4ad4-879c-b877b1e56e22 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:37.863227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 944/1897] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:37.863227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279cb82-80d6-469b-84b1-d3d8950e02f9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:37.863592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279cb82-80d6-469b-84b1-d3d8950e02f9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:37.864148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279cb82-80d6-469b-84b1-d3d8950e02f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:37.890582 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6279cb82-80d6-469b-84b1-d3d8950e02f9 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:37.892473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6279cb82-80d6-469b-84b1-d3d8950e02f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:37.901760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 945/1898] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:37.902450 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279cb82-80d6-469b-84b1-d3d8950e02f9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:37.912413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279cb82-80d6-469b-84b1-d3d8950e02f9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:37.920699 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae7f7e-e143-4685-a7d8-aa350123c2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:37.927030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae7f7e-e143-4685-a7d8-aa350123c2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:37.927030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae7f7e-e143-4685-a7d8-aa350123c2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:37.927030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae7f7e-e143-4685-a7d8-aa350123c2bf admin admin] PATH_INFO: `/v3/projects/92f93b7664204b8eb25f98d926a8b146/users/312dcd0265cb43618cf5dfb858ef1458/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:37.929281 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae7f7e-e143-4685-a7d8-aa350123c2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f93b7664204b8eb25f98d926a8b146, user_id=312dcd0265cb43618cf5dfb858ef1458, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:37.933232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae7f7e-e143-4685-a7d8-aa350123c2bf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:37.948521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 946/1899] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:37 2022] PUT /identity/v3/projects/92f93b7664204b8eb25f98d926a8b146/users/312dcd0265cb43618cf5dfb858ef1458/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:37.949449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae7f7e-e143-4685-a7d8-aa350123c2bf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:37.956852 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e9ae7f7e-e143-4685-a7d8-aa350123c2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:38.044225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae7f7e-e143-4685-a7d8-aa350123c2bf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:38.047821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196848c-cbe1-4c61-b0f5-bc8b1f005001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:38.048700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196848c-cbe1-4c61-b0f5-bc8b1f005001 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:38.049310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196848c-cbe1-4c61-b0f5-bc8b1f005001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:38.049433 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196848c-cbe1-4c61-b0f5-bc8b1f005001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:38.070747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b6a72606-5eb2-4ad4-879c-b877b1e56e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e91e944a503490682bf742dda5fcfc2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:38.078681 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b6a72606-5eb2-4ad4-879c-b877b1e56e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e91e944a503490682bf742dda5fcfc2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:38.123650 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196848c-cbe1-4c61-b0f5-bc8b1f005001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:38.125828 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196848c-cbe1-4c61-b0f5-bc8b1f005001 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:38.144510 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 947/1900] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:38.157506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c135a-dce4-4ab9-a0a7-f0babd95d0ee None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:38.157925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c135a-dce4-4ab9-a0a7-f0babd95d0ee None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:38.158217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c135a-dce4-4ab9-a0a7-f0babd95d0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:38.170013 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b6a72606-5eb2-4ad4-879c-b877b1e56e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e91e944a503490682bf742dda5fcfc2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:38.171385 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b6a72606-5eb2-4ad4-879c-b877b1e56e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e91e944a503490682bf742dda5fcfc2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:38.172675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b6a72606-5eb2-4ad4-879c-b877b1e56e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e91e944a503490682bf742dda5fcfc2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:38.208513 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 954/1901] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:37 2022] DELETE /identity/v3/users/1e91e944a503490682bf742dda5fcfc2 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:38.229168 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-661c135a-dce4-4ab9-a0a7-f0babd95d0ee None None] MFA Rules not processed for user `312dcd0265cb43618cf5dfb858ef1458`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:38.230709 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-661c135a-dce4-4ab9-a0a7-f0babd95d0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:38.325336 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 948/1902] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:38.338477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a72606-5eb2-4ad4-879c-b877b1e56e22 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:38.340194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b6a72606-5eb2-4ad4-879c-b877b1e56e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:38.444399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a72606-5eb2-4ad4-879c-b877b1e56e22 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:38.448691 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b6627-3ed9-4ae3-87bd-6e8ce78ef820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:38.449504 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b6627-3ed9-4ae3-87bd-6e8ce78ef820 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:38.449942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b6627-3ed9-4ae3-87bd-6e8ce78ef820 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:38.450384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b6627-3ed9-4ae3-87bd-6e8ce78ef820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:38.462132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b6627-3ed9-4ae3-87bd-6e8ce78ef820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:38.463936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b6627-3ed9-4ae3-87bd-6e8ce78ef820 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:38.477571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 955/1903] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:38.754685 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c135a-dce4-4ab9-a0a7-f0babd95d0ee None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:38.771389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c135a-dce4-4ab9-a0a7-f0babd95d0ee None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:38.775968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b28854-1022-4e51-ac8b-9bc2d89a2835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:38.776638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b28854-1022-4e51-ac8b-9bc2d89a2835 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:38.776927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b28854-1022-4e51-ac8b-9bc2d89a2835 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:38.777206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b28854-1022-4e51-ac8b-9bc2d89a2835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:38.780340 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-87b28854-1022-4e51-ac8b-9bc2d89a2835 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:38.878900 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b28854-1022-4e51-ac8b-9bc2d89a2835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:38.880654 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b28854-1022-4e51-ac8b-9bc2d89a2835 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:38.891390 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 949/1904] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:39.124780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b6627-3ed9-4ae3-87bd-6e8ce78ef820 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:39.126346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a43b6627-3ed9-4ae3-87bd-6e8ce78ef820 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:39.157513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b28854-1022-4e51-ac8b-9bc2d89a2835 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:39.160274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-87b28854-1022-4e51-ac8b-9bc2d89a2835 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:39.291010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b6627-3ed9-4ae3-87bd-6e8ce78ef820 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:39.308066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:39.310038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:39.310341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:39.311645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] PATH_INFO: `/v3/projects/3fcbbd15ab1d4896a70f3da30c5c4544` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:39.313800 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b28854-1022-4e51-ac8b-9bc2d89a2835 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:39.315745 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fcbbd15ab1d4896a70f3da30c5c4544)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:39.317872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:39.332602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:39.333716 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:39.334147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:39.336520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] PATH_INFO: `/v3/projects/0a0c1891995f4579b256c14d0c19c61b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:39.339109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0c1891995f4579b256c14d0c19c61b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:39.342024 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:39.532500 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fcbbd15ab1d4896a70f3da30c5c4544', 'request_id': 'req-4526be60-d2dd-4309-a563-2064575e76de'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:39.547037 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fcbbd15ab1d4896a70f3da30c5c4544', 'request_id': 'req-4526be60-d2dd-4309-a563-2064575e76de'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:39.548754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0c1891995f4579b256c14d0c19c61b', 'request_id': 'req-f9edf87a-891c-4754-86c8-652764b6a66e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:39.565833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0c1891995f4579b256c14d0c19c61b', 'request_id': 'req-f9edf87a-891c-4754-86c8-652764b6a66e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:39.570203 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fcbbd15ab1d4896a70f3da30c5c4544', 'request_id': 'req-4526be60-d2dd-4309-a563-2064575e76de'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:39.578511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0c1891995f4579b256c14d0c19c61b', 'request_id': 'req-f9edf87a-891c-4754-86c8-652764b6a66e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:39.640419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] The token cache is being invalidate because project 3fcbbd15ab1d4896a70f3da30c5c4544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:39.641111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:39.643128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:39.646872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 956/1905] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:39 2022] DELETE /identity/v3/projects/3fcbbd15ab1d4896a70f3da30c5c4544 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:39.650006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:39.651939 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:39.724636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] The token cache is being invalidate because project 0a0c1891995f4579b256c14d0c19c61b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:39.725077 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:39.725894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:39.727985 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 950/1906] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:39 2022] DELETE /identity/v3/projects/0a0c1891995f4579b256c14d0c19c61b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:39.736473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:39.738202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:39.787183 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526be60-d2dd-4309-a563-2064575e76de admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:39.853642 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edf87a-891c-4754-86c8-652764b6a66e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:39.863145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1c1b3-4b17-4acb-a3ae-fac8d4bfc442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:39.864380 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c1b3-4b17-4acb-a3ae-fac8d4bfc442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:39.888905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c1b3-4b17-4acb-a3ae-fac8d4bfc442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:39.889983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c1b3-4b17-4acb-a3ae-fac8d4bfc442 admin admin] PATH_INFO: `/v3/users/2c7ebe8feec54adc94274d95baa79f7d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:39.893401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d791f-d5af-487f-b3f1-550a538533b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:39.894446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d791f-d5af-487f-b3f1-550a538533b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:39.894749 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d791f-d5af-487f-b3f1-550a538533b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:39.895040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d791f-d5af-487f-b3f1-550a538533b7 admin admin] PATH_INFO: `/v3/users/484374cf81b94e50bec1d9e48b7d950b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:39.895645 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1c1b3-4b17-4acb-a3ae-fac8d4bfc442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7ebe8feec54adc94274d95baa79f7d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:39.897307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d791f-d5af-487f-b3f1-550a538533b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=484374cf81b94e50bec1d9e48b7d950b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:39.899382 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d791f-d5af-487f-b3f1-550a538533b7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:39.899841 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1c1b3-4b17-4acb-a3ae-fac8d4bfc442 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:40.099809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-866d791f-d5af-487f-b3f1-550a538533b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '484374cf81b94e50bec1d9e48b7d950b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:40.107092 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-866d791f-d5af-487f-b3f1-550a538533b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '484374cf81b94e50bec1d9e48b7d950b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:40.147585 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0ad1c1b3-4b17-4acb-a3ae-fac8d4bfc442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7ebe8feec54adc94274d95baa79f7d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:40.230615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-866d791f-d5af-487f-b3f1-550a538533b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '484374cf81b94e50bec1d9e48b7d950b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:40.231196 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-866d791f-d5af-487f-b3f1-550a538533b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '484374cf81b94e50bec1d9e48b7d950b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:40.231800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-866d791f-d5af-487f-b3f1-550a538533b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '484374cf81b94e50bec1d9e48b7d950b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:40.251593 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 957/1907] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:39 2022] DELETE /identity/v3/users/484374cf81b94e50bec1d9e48b7d950b => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:40.293062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0ad1c1b3-4b17-4acb-a3ae-fac8d4bfc442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7ebe8feec54adc94274d95baa79f7d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:40.301155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0ad1c1b3-4b17-4acb-a3ae-fac8d4bfc442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7ebe8feec54adc94274d95baa79f7d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:40.301814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0ad1c1b3-4b17-4acb-a3ae-fac8d4bfc442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7ebe8feec54adc94274d95baa79f7d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:40.302445 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0ad1c1b3-4b17-4acb-a3ae-fac8d4bfc442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7ebe8feec54adc94274d95baa79f7d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:40.325853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 951/1908] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:39 2022] DELETE /identity/v3/users/2c7ebe8feec54adc94274d95baa79f7d => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:40.760261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d791f-d5af-487f-b3f1-550a538533b7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:40.764100 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-866d791f-d5af-487f-b3f1-550a538533b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:40.817600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1c1b3-4b17-4acb-a3ae-fac8d4bfc442 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:40.828522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0ad1c1b3-4b17-4acb-a3ae-fac8d4bfc442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:40.844020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d791f-d5af-487f-b3f1-550a538533b7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:40.925495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5820bb-054f-409d-acbb-1381b1310922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:40.926389 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5820bb-054f-409d-acbb-1381b1310922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:40.926665 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5820bb-054f-409d-acbb-1381b1310922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:40.926937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5820bb-054f-409d-acbb-1381b1310922 admin admin] PATH_INFO: `/v3/projects/5619e400dbac4f5a835647048ab93365` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:40.928159 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5820bb-054f-409d-acbb-1381b1310922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5619e400dbac4f5a835647048ab93365)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:40.930051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1c1b3-4b17-4acb-a3ae-fac8d4bfc442 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:40.930539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5820bb-054f-409d-acbb-1381b1310922 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:40.944464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb5d14-121d-4a7f-a0f0-02c943a76d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:40.944464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb5d14-121d-4a7f-a0f0-02c943a76d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:40.944464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb5d14-121d-4a7f-a0f0-02c943a76d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:40.944464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb5d14-121d-4a7f-a0f0-02c943a76d71 admin admin] PATH_INFO: `/v3/projects/1bc100d6cf224c3f9b89478c62efe1bc` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:40.944842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb5d14-121d-4a7f-a0f0-02c943a76d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc100d6cf224c3f9b89478c62efe1bc)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:40.944842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb5d14-121d-4a7f-a0f0-02c943a76d71 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:41.043806 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ef5820bb-054f-409d-acbb-1381b1310922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5619e400dbac4f5a835647048ab93365', 'request_id': 'req-ef5820bb-054f-409d-acbb-1381b1310922'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:41.050040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ef5820bb-054f-409d-acbb-1381b1310922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5619e400dbac4f5a835647048ab93365', 'request_id': 'req-ef5820bb-054f-409d-acbb-1381b1310922'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:41.055373 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ef5820bb-054f-409d-acbb-1381b1310922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5619e400dbac4f5a835647048ab93365', 'request_id': 'req-ef5820bb-054f-409d-acbb-1381b1310922'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:41.080191 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-44cb5d14-121d-4a7f-a0f0-02c943a76d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc100d6cf224c3f9b89478c62efe1bc', 'request_id': 'req-44cb5d14-121d-4a7f-a0f0-02c943a76d71'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:41.086918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-44cb5d14-121d-4a7f-a0f0-02c943a76d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc100d6cf224c3f9b89478c62efe1bc', 'request_id': 'req-44cb5d14-121d-4a7f-a0f0-02c943a76d71'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:41.093806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-44cb5d14-121d-4a7f-a0f0-02c943a76d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc100d6cf224c3f9b89478c62efe1bc', 'request_id': 'req-44cb5d14-121d-4a7f-a0f0-02c943a76d71'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:41.152741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ef5820bb-054f-409d-acbb-1381b1310922 admin admin] The token cache is being invalidate because project 5619e400dbac4f5a835647048ab93365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:41.153036 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ef5820bb-054f-409d-acbb-1381b1310922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:41.153708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ef5820bb-054f-409d-acbb-1381b1310922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:41.155283 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 958/1909] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:40 2022] DELETE /identity/v3/projects/5619e400dbac4f5a835647048ab93365 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:41.159990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfadef8-9259-4fb6-8a9b-9e40825aecd2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.160283 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfadef8-9259-4fb6-8a9b-9e40825aecd2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.160571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfadef8-9259-4fb6-8a9b-9e40825aecd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.177889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2bfadef8-9259-4fb6-8a9b-9e40825aecd2 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:41.179085 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2bfadef8-9259-4fb6-8a9b-9e40825aecd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:41.235189 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 959/1910] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:41.243126 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651fb44-f10e-42dc-8626-f56ea5e0799e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.243422 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651fb44-f10e-42dc-8626-f56ea5e0799e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.243708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651fb44-f10e-42dc-8626-f56ea5e0799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.266299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-44cb5d14-121d-4a7f-a0f0-02c943a76d71 admin admin] The token cache is being invalidate because project 1bc100d6cf224c3f9b89478c62efe1bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:41.266299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-44cb5d14-121d-4a7f-a0f0-02c943a76d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:41.266299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-44cb5d14-121d-4a7f-a0f0-02c943a76d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:41.266299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 952/1911] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:40 2022] DELETE /identity/v3/projects/1bc100d6cf224c3f9b89478c62efe1bc => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:41.266670 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0651fb44-f10e-42dc-8626-f56ea5e0799e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:41.267844 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0651fb44-f10e-42dc-8626-f56ea5e0799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:41.271342 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e129f-b986-41b7-bcbe-a62b7603837e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.271637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e129f-b986-41b7-bcbe-a62b7603837e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.272059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e129f-b986-41b7-bcbe-a62b7603837e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.277004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 960/1912] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:41.281154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651fb44-f10e-42dc-8626-f56ea5e0799e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:41.291509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651fb44-f10e-42dc-8626-f56ea5e0799e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:41.292719 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-149e129f-b986-41b7-bcbe-a62b7603837e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:41.293981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-149e129f-b986-41b7-bcbe-a62b7603837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:41.296533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54117d-b4c4-4ee7-87e4-9b2cd6eaf8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:41.297194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54117d-b4c4-4ee7-87e4-9b2cd6eaf8ca admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.297628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54117d-b4c4-4ee7-87e4-9b2cd6eaf8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.297968 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54117d-b4c4-4ee7-87e4-9b2cd6eaf8ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.298696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54117d-b4c4-4ee7-87e4-9b2cd6eaf8ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:41.299010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54117d-b4c4-4ee7-87e4-9b2cd6eaf8ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:41.300609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54117d-b4c4-4ee7-87e4-9b2cd6eaf8ca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:41.302509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 953/1913] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:41.310667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c91d-8d65-41b2-9e30-e98d5b0c133e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.311078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c91d-8d65-41b2-9e30-e98d5b0c133e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.311879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926c91d-8d65-41b2-9e30-e98d5b0c133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.313114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 961/1914] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:05:41.317319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54117d-b4c4-4ee7-87e4-9b2cd6eaf8ca admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:41.327825 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54117d-b4c4-4ee7-87e4-9b2cd6eaf8ca admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:41.329958 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3926c91d-8d65-41b2-9e30-e98d5b0c133e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:41.331146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3926c91d-8d65-41b2-9e30-e98d5b0c133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:41.333008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db422e5b-fb35-4f13-a9ab-2b2621274f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:41.333685 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422e5b-fb35-4f13-a9ab-2b2621274f94 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.333978 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422e5b-fb35-4f13-a9ab-2b2621274f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.334258 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db422e5b-fb35-4f13-a9ab-2b2621274f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.334941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db422e5b-fb35-4f13-a9ab-2b2621274f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:41.336993 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db422e5b-fb35-4f13-a9ab-2b2621274f94 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:41.339619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 954/1915] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:41.343865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926c91d-8d65-41b2-9e30-e98d5b0c133e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:41.352924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926c91d-8d65-41b2-9e30-e98d5b0c133e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:41.357697 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440ba25-a070-4725-ad23-01e3ba490823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:41.358385 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440ba25-a070-4725-ad23-01e3ba490823 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.358667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440ba25-a070-4725-ad23-01e3ba490823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.358944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440ba25-a070-4725-ad23-01e3ba490823 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.359693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440ba25-a070-4725-ad23-01e3ba490823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:41.360000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440ba25-a070-4725-ad23-01e3ba490823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:41.364032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440ba25-a070-4725-ad23-01e3ba490823 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:41.380264 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 955/1916] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:05:41.384604 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440ba25-a070-4725-ad23-01e3ba490823 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:41.394784 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440ba25-a070-4725-ad23-01e3ba490823 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:41.399609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a072dc-035d-4f11-80a9-812edf36b1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:41.400246 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a072dc-035d-4f11-80a9-812edf36b1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.400532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a072dc-035d-4f11-80a9-812edf36b1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.400809 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a072dc-035d-4f11-80a9-812edf36b1d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.401494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a072dc-035d-4f11-80a9-812edf36b1d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:41.403411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a072dc-035d-4f11-80a9-812edf36b1d6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:41.430074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 962/1917] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:41 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:41.432865 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db422e5b-fb35-4f13-a9ab-2b2621274f94 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:41.492912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db422e5b-fb35-4f13-a9ab-2b2621274f94 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:41.498395 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d6a6f-8d49-441b-b684-c8aa484fb62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:41.499107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d6a6f-8d49-441b-b684-c8aa484fb62d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.499392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d6a6f-8d49-441b-b684-c8aa484fb62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.499669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d6a6f-8d49-441b-b684-c8aa484fb62d admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.500353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d6a6f-8d49-441b-b684-c8aa484fb62d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:41.502318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d6a6f-8d49-441b-b684-c8aa484fb62d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:41.508062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 956/1918] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:41 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:05:41.508934 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a072dc-035d-4f11-80a9-812edf36b1d6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:41.572476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a072dc-035d-4f11-80a9-812edf36b1d6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:41.577769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e468701-5d70-4e56-bc38-1a2ef1dd3a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:41.578442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468701-5d70-4e56-bc38-1a2ef1dd3a42 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.578728 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468701-5d70-4e56-bc38-1a2ef1dd3a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.579007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468701-5d70-4e56-bc38-1a2ef1dd3a42 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.579729 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e468701-5d70-4e56-bc38-1a2ef1dd3a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:41.581802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e468701-5d70-4e56-bc38-1a2ef1dd3a42 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:41.590696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 963/1919] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:41 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:05:41.595721 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d6a6f-8d49-441b-b684-c8aa484fb62d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:41.606541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d6a6f-8d49-441b-b684-c8aa484fb62d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:41.611221 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd9869-7631-46be-965b-9d5b694a7a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:41.611934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd9869-7631-46be-965b-9d5b694a7a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.612219 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd9869-7631-46be-965b-9d5b694a7a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.612501 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd9869-7631-46be-965b-9d5b694a7a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.613233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd9869-7631-46be-965b-9d5b694a7a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:41.614884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd9869-7631-46be-965b-9d5b694a7a2e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:41.625772 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 964/1920] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:05:41.629346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd9869-7631-46be-965b-9d5b694a7a2e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:41.639058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd9869-7631-46be-965b-9d5b694a7a2e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:41.644220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8a63e-c208-4489-be7b-3fbb7ab97485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:41.644873 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8a63e-c208-4489-be7b-3fbb7ab97485 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.645158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8a63e-c208-4489-be7b-3fbb7ab97485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.645460 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8a63e-c208-4489-be7b-3fbb7ab97485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.646562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8a63e-c208-4489-be7b-3fbb7ab97485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:41.648156 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8a63e-c208-4489-be7b-3fbb7ab97485 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:41.659886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 965/1921] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:05:41.664004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8a63e-c208-4489-be7b-3fbb7ab97485 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:41.673578 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8a63e-c208-4489-be7b-3fbb7ab97485 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:41.678149 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126ad51-4634-4487-b8b1-912a9b24756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:41.679006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ad51-4634-4487-b8b1-912a9b24756f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.679291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ad51-4634-4487-b8b1-912a9b24756f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.679688 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ad51-4634-4487-b8b1-912a9b24756f admin admin] PATH_INFO: `/v3/projects/4ef1b89918214facac105e73d7a5e275/users/b7a2fb33a4604a17bca3cff757fd5506/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.687643 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 957/1922] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:41 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:41.694378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e468701-5d70-4e56-bc38-1a2ef1dd3a42 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:41.696712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126ad51-4634-4487-b8b1-912a9b24756f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef1b89918214facac105e73d7a5e275, user_id=b7a2fb33a4604a17bca3cff757fd5506, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:41.699469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126ad51-4634-4487-b8b1-912a9b24756f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:41.705203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e468701-5d70-4e56-bc38-1a2ef1dd3a42 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:41.709889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32125ad2-f963-4523-a0bd-771b8c1b2dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:41.710551 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32125ad2-f963-4523-a0bd-771b8c1b2dfc admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.710836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32125ad2-f963-4523-a0bd-771b8c1b2dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.711130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32125ad2-f963-4523-a0bd-771b8c1b2dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.711841 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32125ad2-f963-4523-a0bd-771b8c1b2dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:41.713449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32125ad2-f963-4523-a0bd-771b8c1b2dfc admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:41.723797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 958/1923] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:41.727640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32125ad2-f963-4523-a0bd-771b8c1b2dfc admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:41.736911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32125ad2-f963-4523-a0bd-771b8c1b2dfc admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:41.742276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf66ebc-248c-4085-a05f-5a4b01273131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:41.752210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf66ebc-248c-4085-a05f-5a4b01273131 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.752210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf66ebc-248c-4085-a05f-5a4b01273131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.752210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf66ebc-248c-4085-a05f-5a4b01273131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.752210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf66ebc-248c-4085-a05f-5a4b01273131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:41.752210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf66ebc-248c-4085-a05f-5a4b01273131 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:41.756076 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 959/1924] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:05:41.759970 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf66ebc-248c-4085-a05f-5a4b01273131 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:41.770040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf66ebc-248c-4085-a05f-5a4b01273131 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:41.773494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 966/1925] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:41 2022] PUT /identity/v3/projects/4ef1b89918214facac105e73d7a5e275/users/b7a2fb33a4604a17bca3cff757fd5506/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:41.785597 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ba99b-5759-4a27-b1b5-0e75873bc6c8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.785903 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ba99b-5759-4a27-b1b5-0e75873bc6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.786260 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ba99b-5759-4a27-b1b5-0e75873bc6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.812687 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-061ba99b-5759-4a27-b1b5-0e75873bc6c8 None None] MFA Rules not processed for user `b7a2fb33a4604a17bca3cff757fd5506`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:41.813964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-061ba99b-5759-4a27-b1b5-0e75873bc6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:41.832627 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43b102-2238-4b03-87be-fc897e04c7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:41.833568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43b102-2238-4b03-87be-fc897e04c7b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.833856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43b102-2238-4b03-87be-fc897e04c7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.834136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43b102-2238-4b03-87be-fc897e04c7b6 admin admin] PATH_INFO: `/v3/projects/eda707a8db3b47bf831c03d7485a6db9/users/088b3b28795b4004a22938efcec84356/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.848439 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43b102-2238-4b03-87be-fc897e04c7b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eda707a8db3b47bf831c03d7485a6db9, user_id=088b3b28795b4004a22938efcec84356, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:41.851209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43b102-2238-4b03-87be-fc897e04c7b6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:41.882186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 967/1926] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:41.893993 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ba99b-5759-4a27-b1b5-0e75873bc6c8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:41.895585 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-061ba99b-5759-4a27-b1b5-0e75873bc6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:41.924317 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 960/1927] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:41 2022] PUT /identity/v3/projects/eda707a8db3b47bf831c03d7485a6db9/users/088b3b28795b4004a22938efcec84356/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:41.935883 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f88fe-faf2-4000-b200-d49ea4bf6506 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:41.937007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f88fe-faf2-4000-b200-d49ea4bf6506 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:41.937442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f88fe-faf2-4000-b200-d49ea4bf6506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:41.957039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ba99b-5759-4a27-b1b5-0e75873bc6c8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:41.963556 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-313f88fe-faf2-4000-b200-d49ea4bf6506 None None] MFA Rules not processed for user `088b3b28795b4004a22938efcec84356`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:41.964761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-313f88fe-faf2-4000-b200-d49ea4bf6506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:42.004622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13897c-08b1-41fe-9420-5a0c30714c42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce12ee27315460793dfedd294eb3c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:42.005293 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13897c-08b1-41fe-9420-5a0c30714c42 service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:42.005589 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13897c-08b1-41fe-9420-5a0c30714c42 service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:42.005979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13897c-08b1-41fe-9420-5a0c30714c42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:42.027152 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 961/1928] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:42.031636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f88fe-faf2-4000-b200-d49ea4bf6506 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:42.060515 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13897c-08b1-41fe-9420-5a0c30714c42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:42.062643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13897c-08b1-41fe-9420-5a0c30714c42 service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:42.071377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 968/1929] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:05:42.089465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f88fe-faf2-4000-b200-d49ea4bf6506 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:42.095984 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33103f7b-5b09-47eb-9094-9531cb7e7472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:42.096868 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103f7b-5b09-47eb-9094-9531cb7e7472 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:42.097362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103f7b-5b09-47eb-9094-9531cb7e7472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:42.097797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103f7b-5b09-47eb-9094-9531cb7e7472 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:42.098680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33103f7b-5b09-47eb-9094-9531cb7e7472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:42.100769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33103f7b-5b09-47eb-9094-9531cb7e7472 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:42.217565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 962/1930] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:42 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:05:42.222158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13897c-08b1-41fe-9420-5a0c30714c42 service glance] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:42.232883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13897c-08b1-41fe-9420-5a0c30714c42 service glance] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:42.289923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5a4c8-022f-46fb-abd2-2707d9900810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:42.290620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5a4c8-022f-46fb-abd2-2707d9900810 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:42.290903 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5a4c8-022f-46fb-abd2-2707d9900810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:42.291181 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5a4c8-022f-46fb-abd2-2707d9900810 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:42.291880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5a4c8-022f-46fb-abd2-2707d9900810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:42.294014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5a4c8-022f-46fb-abd2-2707d9900810 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:42.393515 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 969/1931] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:42 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:42.397732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33103f7b-5b09-47eb-9094-9531cb7e7472 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:42.407871 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33103f7b-5b09-47eb-9094-9531cb7e7472 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:42.412950 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6e2b3-3e96-46f8-826b-403afda97e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:42.413751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6e2b3-3e96-46f8-826b-403afda97e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:42.414718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6e2b3-3e96-46f8-826b-403afda97e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:42.414718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6e2b3-3e96-46f8-826b-403afda97e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:42.414891 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6e2b3-3e96-46f8-826b-403afda97e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:42.416495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6e2b3-3e96-46f8-826b-403afda97e7d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:42.428192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 963/1932] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:42.438346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5a4c8-022f-46fb-abd2-2707d9900810 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:42.442111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5a4c8-022f-46fb-abd2-2707d9900810 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:42.446646 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f715c-a883-4fdb-a030-ec488e59ca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:42.447513 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f715c-a883-4fdb-a030-ec488e59ca41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:42.447795 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f715c-a883-4fdb-a030-ec488e59ca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:42.448076 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f715c-a883-4fdb-a030-ec488e59ca41 admin admin] PATH_INFO: `/v3/projects/2c9fe0560cc1493997194971223e39ae/users/d0cb3145f623401b8eb0fbe68de4a137/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:42.462394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f715c-a883-4fdb-a030-ec488e59ca41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9fe0560cc1493997194971223e39ae, user_id=d0cb3145f623401b8eb0fbe68de4a137, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:42.465027 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f715c-a883-4fdb-a030-ec488e59ca41 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:42.609463 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 970/1933] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:42 2022] PUT /identity/v3/projects/2c9fe0560cc1493997194971223e39ae/users/d0cb3145f623401b8eb0fbe68de4a137/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:42.613639 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6e2b3-3e96-46f8-826b-403afda97e7d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:42.623763 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6e2b3-3e96-46f8-826b-403afda97e7d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:42.679670 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d69b7-56df-4c9e-9d78-1ebc3ae6c1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:42.680338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d69b7-56df-4c9e-9d78-1ebc3ae6c1da admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:42.680618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d69b7-56df-4c9e-9d78-1ebc3ae6c1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:42.680919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d69b7-56df-4c9e-9d78-1ebc3ae6c1da admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:42.681697 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d69b7-56df-4c9e-9d78-1ebc3ae6c1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:42.683277 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d69b7-56df-4c9e-9d78-1ebc3ae6c1da admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:42.696128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 964/1934] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:42.697134 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f715c-a883-4fdb-a030-ec488e59ca41 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:42.709007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f715c-a883-4fdb-a030-ec488e59ca41 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:42.713701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552aac8-d19d-439b-8fbb-bbc59e1a55e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:42.714629 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552aac8-d19d-439b-8fbb-bbc59e1a55e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:42.714909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552aac8-d19d-439b-8fbb-bbc59e1a55e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:42.715178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552aac8-d19d-439b-8fbb-bbc59e1a55e6 admin admin] PATH_INFO: `/v3/projects/2c9fe0560cc1493997194971223e39ae/users/d0cb3145f623401b8eb0fbe68de4a137/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:42.717139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552aac8-d19d-439b-8fbb-bbc59e1a55e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c9fe0560cc1493997194971223e39ae, user_id=d0cb3145f623401b8eb0fbe68de4a137, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:42.720485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552aac8-d19d-439b-8fbb-bbc59e1a55e6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:42.731098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 971/1935] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:42 2022] PUT /identity/v3/projects/2c9fe0560cc1493997194971223e39ae/users/d0cb3145f623401b8eb0fbe68de4a137/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:42.743669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bd3c3-e289-4c4c-b410-ccb447067b8a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:42.744011 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bd3c3-e289-4c4c-b410-ccb447067b8a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:42.744296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bd3c3-e289-4c4c-b410-ccb447067b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:42.772492 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9a8bd3c3-e289-4c4c-b410-ccb447067b8a None None] MFA Rules not processed for user `d0cb3145f623401b8eb0fbe68de4a137`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:42.773723 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9a8bd3c3-e289-4c4c-b410-ccb447067b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:42.841725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 965/1936] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:42.884124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552aac8-d19d-439b-8fbb-bbc59e1a55e6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:42.885879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0552aac8-d19d-439b-8fbb-bbc59e1a55e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:42.941150 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552aac8-d19d-439b-8fbb-bbc59e1a55e6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:42.944808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eccc3-7715-4643-9111-8ac746e1e907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:42.945449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eccc3-7715-4643-9111-8ac746e1e907 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:42.945779 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eccc3-7715-4643-9111-8ac746e1e907 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:42.946062 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630eccc3-7715-4643-9111-8ac746e1e907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:42.964160 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630eccc3-7715-4643-9111-8ac746e1e907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:42.965702 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630eccc3-7715-4643-9111-8ac746e1e907 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:42.984108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 972/1937] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:43.113882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bd3c3-e289-4c4c-b410-ccb447067b8a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:43.123298 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bd3c3-e289-4c4c-b410-ccb447067b8a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:43.127554 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bb88c-c9af-41e3-9a96-49678f88e264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:43.128227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bb88c-c9af-41e3-9a96-49678f88e264 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:43.128512 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bb88c-c9af-41e3-9a96-49678f88e264 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:43.128785 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bb88c-c9af-41e3-9a96-49678f88e264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:43.183776 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bb88c-c9af-41e3-9a96-49678f88e264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:43.185310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bb88c-c9af-41e3-9a96-49678f88e264 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:43.195127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 966/1938] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:05:52.133476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eccc3-7715-4643-9111-8ac746e1e907 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:52.134971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-630eccc3-7715-4643-9111-8ac746e1e907 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:52.195205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bb88c-c9af-41e3-9a96-49678f88e264 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:52.247416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630eccc3-7715-4643-9111-8ac746e1e907 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:52.262849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3944112-abbb-4919-98d8-c28fab228bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:52.262849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3944112-abbb-4919-98d8-c28fab228bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:52.262849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3944112-abbb-4919-98d8-c28fab228bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:52.262849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3944112-abbb-4919-98d8-c28fab228bfb admin admin] PATH_INFO: `/v3/users/3816b5165bfc4a22944af6cb81dd6c5a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:52.264236 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3944112-abbb-4919-98d8-c28fab228bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3816b5165bfc4a22944af6cb81dd6c5a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:52.264236 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3944112-abbb-4919-98d8-c28fab228bfb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:52.286706 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bb88c-c9af-41e3-9a96-49678f88e264 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:52.294494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7687adc-1eb0-4a30-a464-920a6d1fc0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:52.294494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7687adc-1eb0-4a30-a464-920a6d1fc0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:52.294494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7687adc-1eb0-4a30-a464-920a6d1fc0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:52.294494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7687adc-1eb0-4a30-a464-920a6d1fc0ad admin admin] PATH_INFO: `/v3/users/088b3b28795b4004a22938efcec84356` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:52.295699 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7687adc-1eb0-4a30-a464-920a6d1fc0ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=088b3b28795b4004a22938efcec84356)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:52.299625 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7687adc-1eb0-4a30-a464-920a6d1fc0ad admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:52.491065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3944112-abbb-4919-98d8-c28fab228bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3816b5165bfc4a22944af6cb81dd6c5a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:52.497844 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3944112-abbb-4919-98d8-c28fab228bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3816b5165bfc4a22944af6cb81dd6c5a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:52.558213 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7687adc-1eb0-4a30-a464-920a6d1fc0ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '088b3b28795b4004a22938efcec84356'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:52.586966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3944112-abbb-4919-98d8-c28fab228bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3816b5165bfc4a22944af6cb81dd6c5a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:52.587821 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3944112-abbb-4919-98d8-c28fab228bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3816b5165bfc4a22944af6cb81dd6c5a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:52.588641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b3944112-abbb-4919-98d8-c28fab228bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3816b5165bfc4a22944af6cb81dd6c5a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:52.606091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 973/1939] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:52 2022] DELETE /identity/v3/users/3816b5165bfc4a22944af6cb81dd6c5a => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:52.610729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a517da-0d44-447f-a56d-d30edfcb41e0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:52.611020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a517da-0d44-447f-a56d-d30edfcb41e0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:52.611376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a517da-0d44-447f-a56d-d30edfcb41e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:52.629857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a1a517da-0d44-447f-a56d-d30edfcb41e0 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:52.631082 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a1a517da-0d44-447f-a56d-d30edfcb41e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:52.670224 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7687adc-1eb0-4a30-a464-920a6d1fc0ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '088b3b28795b4004a22938efcec84356'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:52.680474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7687adc-1eb0-4a30-a464-920a6d1fc0ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '088b3b28795b4004a22938efcec84356'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:52.682072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7687adc-1eb0-4a30-a464-920a6d1fc0ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '088b3b28795b4004a22938efcec84356'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:52.685389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7687adc-1eb0-4a30-a464-920a6d1fc0ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '088b3b28795b4004a22938efcec84356'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:52.699115 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 974/1940] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:52.710383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a517da-0d44-447f-a56d-d30edfcb41e0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:52.712837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a1a517da-0d44-447f-a56d-d30edfcb41e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:52.722307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 967/1941] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:52 2022] DELETE /identity/v3/users/088b3b28795b4004a22938efcec84356 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:52.724476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6794b5-c5ef-4784-ba2f-c4c7a644f282 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:52.724775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6794b5-c5ef-4784-ba2f-c4c7a644f282 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:52.725879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6794b5-c5ef-4784-ba2f-c4c7a644f282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:52.754712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4a6794b5-c5ef-4784-ba2f-c4c7a644f282 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:52.756302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4a6794b5-c5ef-4784-ba2f-c4c7a644f282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:52.795297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a517da-0d44-447f-a56d-d30edfcb41e0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:52.839601 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 968/1942] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:52.852198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6794b5-c5ef-4784-ba2f-c4c7a644f282 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:52.873936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4385f25-ab3a-497c-affd-f91f263e0b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:52.874932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4385f25-ab3a-497c-affd-f91f263e0b79 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:52.875484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4385f25-ab3a-497c-affd-f91f263e0b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:52.875959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4385f25-ab3a-497c-affd-f91f263e0b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:52.895747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4385f25-ab3a-497c-affd-f91f263e0b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:52.899997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4385f25-ab3a-497c-affd-f91f263e0b79 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:52.910781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 975/1943] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:05:52.935217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6794b5-c5ef-4784-ba2f-c4c7a644f282 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:52.941398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aa241-dd75-4a25-ae09-1be80c8ef65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:52.942197 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aa241-dd75-4a25-ae09-1be80c8ef65c service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:52.945456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aa241-dd75-4a25-ae09-1be80c8ef65c service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:52.946572 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aa241-dd75-4a25-ae09-1be80c8ef65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:52.957196 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0aa241-dd75-4a25-ae09-1be80c8ef65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:52.958763 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0aa241-dd75-4a25-ae09-1be80c8ef65c service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:52.969787 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 969/1944] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:05:53.426058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4385f25-ab3a-497c-affd-f91f263e0b79 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:53.427982 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b4385f25-ab3a-497c-affd-f91f263e0b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:53.444503 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4385f25-ab3a-497c-affd-f91f263e0b79 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:53.450000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:53.451151 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:53.451527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:53.451830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] PATH_INFO: `/v3/projects/4f7c4f9a54ac476c8fc8697c8dbd967b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:53.453043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7c4f9a54ac476c8fc8697c8dbd967b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:53.455884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:53.537787 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aa241-dd75-4a25-ae09-1be80c8ef65c service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:53.539357 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fc0aa241-dd75-4a25-ae09-1be80c8ef65c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:53.555728 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aa241-dd75-4a25-ae09-1be80c8ef65c service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:53.560780 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:53.562910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:53.563196 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:53.563642 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] PATH_INFO: `/v3/projects/eda707a8db3b47bf831c03d7485a6db9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:53.565831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eda707a8db3b47bf831c03d7485a6db9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:53.568371 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:53.585999 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7c4f9a54ac476c8fc8697c8dbd967b', 'request_id': 'req-10957991-141b-40bc-a4a9-8dafeab9a191'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:53.592512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7c4f9a54ac476c8fc8697c8dbd967b', 'request_id': 'req-10957991-141b-40bc-a4a9-8dafeab9a191'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:53.599239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7c4f9a54ac476c8fc8697c8dbd967b', 'request_id': 'req-10957991-141b-40bc-a4a9-8dafeab9a191'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:53.677890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] The token cache is being invalidate because project 4f7c4f9a54ac476c8fc8697c8dbd967b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:53.678081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:53.678733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:53.680310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 976/1945] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:53 2022] DELETE /identity/v3/projects/4f7c4f9a54ac476c8fc8697c8dbd967b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:53.684157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:53.685454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:53.729236 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eda707a8db3b47bf831c03d7485a6db9', 'request_id': 'req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:53.735631 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eda707a8db3b47bf831c03d7485a6db9', 'request_id': 'req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:53.741134 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eda707a8db3b47bf831c03d7485a6db9', 'request_id': 'req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:53.750773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10957991-141b-40bc-a4a9-8dafeab9a191 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:53.805810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bca34-f235-4ab7-97ba-129e6ec9fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:53.806682 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bca34-f235-4ab7-97ba-129e6ec9fd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:53.806963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bca34-f235-4ab7-97ba-129e6ec9fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:53.807255 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bca34-f235-4ab7-97ba-129e6ec9fd16 admin admin] PATH_INFO: `/v3/users/312dcd0265cb43618cf5dfb858ef1458` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:53.808470 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bca34-f235-4ab7-97ba-129e6ec9fd16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=312dcd0265cb43618cf5dfb858ef1458)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:53.810419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bca34-f235-4ab7-97ba-129e6ec9fd16 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:53.826268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] The token cache is being invalidate because project eda707a8db3b47bf831c03d7485a6db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:53.826563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:53.827313 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:53.829820 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 970/1946] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:53 2022] DELETE /identity/v3/projects/eda707a8db3b47bf831c03d7485a6db9 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:53.833695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:53.835168 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:53.849314 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d88053-1ff5-4a90-8923-60ec89ecd9e9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:53.854166 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece81b8-8ffe-415a-b19d-ef98fcb1981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:53.859356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece81b8-8ffe-415a-b19d-ef98fcb1981f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:53.859356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece81b8-8ffe-415a-b19d-ef98fcb1981f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:53.859356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece81b8-8ffe-415a-b19d-ef98fcb1981f admin admin] PATH_INFO: `/v3/users/d0cb3145f623401b8eb0fbe68de4a137` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:53.859356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece81b8-8ffe-415a-b19d-ef98fcb1981f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0cb3145f623401b8eb0fbe68de4a137)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:53.859356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece81b8-8ffe-415a-b19d-ef98fcb1981f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:54.022871 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-db6bca34-f235-4ab7-97ba-129e6ec9fd16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312dcd0265cb43618cf5dfb858ef1458'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.029448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-db6bca34-f235-4ab7-97ba-129e6ec9fd16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312dcd0265cb43618cf5dfb858ef1458'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.049300 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1ece81b8-8ffe-415a-b19d-ef98fcb1981f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0cb3145f623401b8eb0fbe68de4a137'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.092521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-db6bca34-f235-4ab7-97ba-129e6ec9fd16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312dcd0265cb43618cf5dfb858ef1458'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.093143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-db6bca34-f235-4ab7-97ba-129e6ec9fd16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312dcd0265cb43618cf5dfb858ef1458'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.093781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-db6bca34-f235-4ab7-97ba-129e6ec9fd16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312dcd0265cb43618cf5dfb858ef1458'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.113084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 977/1947] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:53 2022] DELETE /identity/v3/users/312dcd0265cb43618cf5dfb858ef1458 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:54.175712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1ece81b8-8ffe-415a-b19d-ef98fcb1981f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0cb3145f623401b8eb0fbe68de4a137'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.183954 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1ece81b8-8ffe-415a-b19d-ef98fcb1981f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0cb3145f623401b8eb0fbe68de4a137'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.184909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1ece81b8-8ffe-415a-b19d-ef98fcb1981f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0cb3145f623401b8eb0fbe68de4a137'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.185321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1ece81b8-8ffe-415a-b19d-ef98fcb1981f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0cb3145f623401b8eb0fbe68de4a137'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.203064 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 971/1948] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:53 2022] DELETE /identity/v3/users/d0cb3145f623401b8eb0fbe68de4a137 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:54.653304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bca34-f235-4ab7-97ba-129e6ec9fd16 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:54.655346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-db6bca34-f235-4ab7-97ba-129e6ec9fd16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:54.731398 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bca34-f235-4ab7-97ba-129e6ec9fd16 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:54.748055 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece81b8-8ffe-415a-b19d-ef98fcb1981f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:54.748055 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1ece81b8-8ffe-415a-b19d-ef98fcb1981f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:54.794278 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09290e8-c347-4bc0-a873-bf98b6220f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:54.795077 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09290e8-c347-4bc0-a873-bf98b6220f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:54.795362 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09290e8-c347-4bc0-a873-bf98b6220f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:54.795640 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09290e8-c347-4bc0-a873-bf98b6220f02 admin admin] PATH_INFO: `/v3/projects/92f93b7664204b8eb25f98d926a8b146` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:54.796827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09290e8-c347-4bc0-a873-bf98b6220f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f93b7664204b8eb25f98d926a8b146)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:54.799467 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09290e8-c347-4bc0-a873-bf98b6220f02 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:54.823485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece81b8-8ffe-415a-b19d-ef98fcb1981f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:54.828250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:54.829278 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:54.829622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:54.831442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef admin admin] PATH_INFO: `/v3/projects/2c9fe0560cc1493997194971223e39ae` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:54.832810 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c9fe0560cc1493997194971223e39ae)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:54.834866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:54.927632 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b09290e8-c347-4bc0-a873-bf98b6220f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f93b7664204b8eb25f98d926a8b146', 'request_id': 'req-b09290e8-c347-4bc0-a873-bf98b6220f02'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.934667 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b09290e8-c347-4bc0-a873-bf98b6220f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f93b7664204b8eb25f98d926a8b146', 'request_id': 'req-b09290e8-c347-4bc0-a873-bf98b6220f02'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.940355 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b09290e8-c347-4bc0-a873-bf98b6220f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f93b7664204b8eb25f98d926a8b146', 'request_id': 'req-b09290e8-c347-4bc0-a873-bf98b6220f02'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.963627 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c9fe0560cc1493997194971223e39ae', 'request_id': 'req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.970122 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c9fe0560cc1493997194971223e39ae', 'request_id': 'req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:54.975324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c9fe0560cc1493997194971223e39ae', 'request_id': 'req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:55.018303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b09290e8-c347-4bc0-a873-bf98b6220f02 admin admin] The token cache is being invalidate because project 92f93b7664204b8eb25f98d926a8b146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:55.018588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b09290e8-c347-4bc0-a873-bf98b6220f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:55.019197 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b09290e8-c347-4bc0-a873-bf98b6220f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:55.021005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 978/1949] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:54 2022] DELETE /identity/v3/projects/92f93b7664204b8eb25f98d926a8b146 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:55.026368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caded26-c160-453a-b541-c965c0ae87f3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.026655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caded26-c160-453a-b541-c965c0ae87f3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.026934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caded26-c160-453a-b541-c965c0ae87f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.050188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8caded26-c160-453a-b541-c965c0ae87f3 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:55.050188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8caded26-c160-453a-b541-c965c0ae87f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:55.099030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef admin admin] The token cache is being invalidate because project 2c9fe0560cc1493997194971223e39ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:55.099030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:55.099544 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-fbfa7f49-06a9-4b9b-b7bf-14712937f6ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:55.101116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 972/1950] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:54 2022] DELETE /identity/v3/projects/2c9fe0560cc1493997194971223e39ae => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:55.106026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99462e3-4588-4d28-888d-92c387523c16 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.106318 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99462e3-4588-4d28-888d-92c387523c16 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.106600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99462e3-4588-4d28-888d-92c387523c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.106964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 979/1951] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:55.114032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207106f-9426-4cfe-8e5d-a86bb09a503a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.114319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207106f-9426-4cfe-8e5d-a86bb09a503a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.114599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207106f-9426-4cfe-8e5d-a86bb09a503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.130723 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a99462e3-4588-4d28-888d-92c387523c16 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:55.130723 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a99462e3-4588-4d28-888d-92c387523c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:55.134829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4207106f-9426-4cfe-8e5d-a86bb09a503a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:55.136005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4207106f-9426-4cfe-8e5d-a86bb09a503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:55.137098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 973/1952] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:55.144714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 980/1953] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:55.148273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffb23b-4c54-4ada-8ee1-3603e82f5da7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.148273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffb23b-4c54-4ada-8ee1-3603e82f5da7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.148273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffb23b-4c54-4ada-8ee1-3603e82f5da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.149017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207106f-9426-4cfe-8e5d-a86bb09a503a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:55.158639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207106f-9426-4cfe-8e5d-a86bb09a503a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:55.163327 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b832a-3ce3-4887-b170-4757ca15fc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:55.163974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b832a-3ce3-4887-b170-4757ca15fc65 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.164262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b832a-3ce3-4887-b170-4757ca15fc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.164543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b832a-3ce3-4887-b170-4757ca15fc65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.164783 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-90ffb23b-4c54-4ada-8ee1-3603e82f5da7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:55.165276 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b832a-3ce3-4887-b170-4757ca15fc65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:55.165615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b832a-3ce3-4887-b170-4757ca15fc65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:55.170722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-90ffb23b-4c54-4ada-8ee1-3603e82f5da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:55.170842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b832a-3ce3-4887-b170-4757ca15fc65 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:55.174385 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 974/1954] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:55.178383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffb23b-4c54-4ada-8ee1-3603e82f5da7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:55.182249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 981/1955] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:05:55.183246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b832a-3ce3-4887-b170-4757ca15fc65 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:55.188025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffb23b-4c54-4ada-8ee1-3603e82f5da7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:55.192728 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30998eb2-7454-4e16-8c0d-d4d0a2b5b91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:55.193214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b832a-3ce3-4887-b170-4757ca15fc65 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:55.193392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30998eb2-7454-4e16-8c0d-d4d0a2b5b91c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.193718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30998eb2-7454-4e16-8c0d-d4d0a2b5b91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.193997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30998eb2-7454-4e16-8c0d-d4d0a2b5b91c admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.194756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30998eb2-7454-4e16-8c0d-d4d0a2b5b91c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:55.195065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30998eb2-7454-4e16-8c0d-d4d0a2b5b91c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:55.196668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30998eb2-7454-4e16-8c0d-d4d0a2b5b91c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:55.198039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7221f-cfda-4b0a-8a31-465c501cdeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:55.198682 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7221f-cfda-4b0a-8a31-465c501cdeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.198965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7221f-cfda-4b0a-8a31-465c501cdeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.199243 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7221f-cfda-4b0a-8a31-465c501cdeb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.199920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7221f-cfda-4b0a-8a31-465c501cdeb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:55.201832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7221f-cfda-4b0a-8a31-465c501cdeb2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:55.209090 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 975/1956] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:05:55.213284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30998eb2-7454-4e16-8c0d-d4d0a2b5b91c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:55.224635 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30998eb2-7454-4e16-8c0d-d4d0a2b5b91c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:55.229686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0e653-8873-4ca0-9d6b-e0fea66473b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:55.233880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0e653-8873-4ca0-9d6b-e0fea66473b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.233880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0e653-8873-4ca0-9d6b-e0fea66473b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.233880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0e653-8873-4ca0-9d6b-e0fea66473b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.233880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0e653-8873-4ca0-9d6b-e0fea66473b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:55.233880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0e653-8873-4ca0-9d6b-e0fea66473b4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:55.320748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 982/1957] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:55 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:05:55.321806 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7221f-cfda-4b0a-8a31-465c501cdeb2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:55.325933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 976/1958] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:55 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:05:55.331632 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0e653-8873-4ca0-9d6b-e0fea66473b4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:55.386377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7221f-cfda-4b0a-8a31-465c501cdeb2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:55.391654 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda7958-1e42-4ab7-9366-97b9d85b8f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:55.392318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda7958-1e42-4ab7-9366-97b9d85b8f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.392454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0e653-8873-4ca0-9d6b-e0fea66473b4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:55.392601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda7958-1e42-4ab7-9366-97b9d85b8f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.392876 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda7958-1e42-4ab7-9366-97b9d85b8f1f admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.393589 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda7958-1e42-4ab7-9366-97b9d85b8f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:55.395604 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda7958-1e42-4ab7-9366-97b9d85b8f1f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:55.397556 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b4fdc-f978-447a-a69a-c665fe5b7a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:55.398219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b4fdc-f978-447a-a69a-c665fe5b7a0c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.398516 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b4fdc-f978-447a-a69a-c665fe5b7a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.399570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b4fdc-f978-447a-a69a-c665fe5b7a0c admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.399662 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b4fdc-f978-447a-a69a-c665fe5b7a0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:55.401946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b4fdc-f978-447a-a69a-c665fe5b7a0c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:55.522798 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 983/1959] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:55 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:05:55.526946 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda7958-1e42-4ab7-9366-97b9d85b8f1f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:55.536553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda7958-1e42-4ab7-9366-97b9d85b8f1f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:55.541353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a5c51-8680-4ab7-8558-86eb4c11bdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:55.542052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a5c51-8680-4ab7-8558-86eb4c11bdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.544020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a5c51-8680-4ab7-8558-86eb4c11bdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.544020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a5c51-8680-4ab7-8558-86eb4c11bdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.544020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a5c51-8680-4ab7-8558-86eb4c11bdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:55.547939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 977/1960] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:55 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:05:55.548087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a5c51-8680-4ab7-8558-86eb4c11bdb8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:55.548787 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b4fdc-f978-447a-a69a-c665fe5b7a0c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:55.558405 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 984/1961] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:05:55.558742 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b4fdc-f978-447a-a69a-c665fe5b7a0c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:55.559386 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a5c51-8680-4ab7-8558-86eb4c11bdb8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:55.568659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77547e9-26c6-4d21-a541-9a8797a6b6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:55.573091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77547e9-26c6-4d21-a541-9a8797a6b6cb admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.573091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77547e9-26c6-4d21-a541-9a8797a6b6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.573091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77547e9-26c6-4d21-a541-9a8797a6b6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.573091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77547e9-26c6-4d21-a541-9a8797a6b6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:55.574961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77547e9-26c6-4d21-a541-9a8797a6b6cb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:55.576204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a5c51-8680-4ab7-8558-86eb4c11bdb8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:55.582606 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bd840-81cc-42c5-b26a-e9ae8e9f0bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:55.583424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bd840-81cc-42c5-b26a-e9ae8e9f0bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.583818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bd840-81cc-42c5-b26a-e9ae8e9f0bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.584202 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bd840-81cc-42c5-b26a-e9ae8e9f0bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.585037 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bd840-81cc-42c5-b26a-e9ae8e9f0bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:55.586514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 978/1962] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:55.590032 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bd840-81cc-42c5-b26a-e9ae8e9f0bb8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:55.590425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77547e9-26c6-4d21-a541-9a8797a6b6cb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:55.607555 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77547e9-26c6-4d21-a541-9a8797a6b6cb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:55.607653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 985/1963] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:55.607756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733d586-076f-4334-a0f4-668a5c312ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:55.608284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733d586-076f-4334-a0f4-668a5c312ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.608667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733d586-076f-4334-a0f4-668a5c312ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.608957 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733d586-076f-4334-a0f4-668a5c312ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.609842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733d586-076f-4334-a0f4-668a5c312ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:55.611066 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bd840-81cc-42c5-b26a-e9ae8e9f0bb8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:55.611889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733d586-076f-4334-a0f4-668a5c312ab5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:55.623049 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bd840-81cc-42c5-b26a-e9ae8e9f0bb8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:55.623538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 979/1964] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:05:55.628217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733d586-076f-4334-a0f4-668a5c312ab5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:55.630561 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731863b-d9f9-441f-a059-e9dd911b1d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:55.631626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731863b-d9f9-441f-a059-e9dd911b1d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.632179 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731863b-d9f9-441f-a059-e9dd911b1d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.632539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731863b-d9f9-441f-a059-e9dd911b1d06 admin admin] PATH_INFO: `/v3/projects/67ef6dfe81ec4ed7852c602caceb8bc6/users/2853821b1f51496f97fa6b694c8136ae/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.637768 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733d586-076f-4334-a0f4-668a5c312ab5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:55.643267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32eb46-cd75-4b26-91b7-99a00ef85c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:55.644263 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32eb46-cd75-4b26-91b7-99a00ef85c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.644547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32eb46-cd75-4b26-91b7-99a00ef85c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.644826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32eb46-cd75-4b26-91b7-99a00ef85c7e admin admin] PATH_INFO: `/v3/projects/5d4ee06360f1482bbba3de75882f5056/users/3dd64a0d8db947128aa6e56e6d5d93d7/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.657472 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731863b-d9f9-441f-a059-e9dd911b1d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ef6dfe81ec4ed7852c602caceb8bc6, user_id=2853821b1f51496f97fa6b694c8136ae, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:55.660658 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731863b-d9f9-441f-a059-e9dd911b1d06 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:55.660984 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32eb46-cd75-4b26-91b7-99a00ef85c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4ee06360f1482bbba3de75882f5056, user_id=3dd64a0d8db947128aa6e56e6d5d93d7, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:55.664084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32eb46-cd75-4b26-91b7-99a00ef85c7e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:55.747466 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 986/1965] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:55 2022] PUT /identity/v3/projects/67ef6dfe81ec4ed7852c602caceb8bc6/users/2853821b1f51496f97fa6b694c8136ae/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:55.760537 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787877dd-cb4a-40d9-a409-e45dc5ba6f60 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.760829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787877dd-cb4a-40d9-a409-e45dc5ba6f60 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.761110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787877dd-cb4a-40d9-a409-e45dc5ba6f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.792429 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-787877dd-cb4a-40d9-a409-e45dc5ba6f60 None None] MFA Rules not processed for user `2853821b1f51496f97fa6b694c8136ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:55.793706 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-787877dd-cb4a-40d9-a409-e45dc5ba6f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:55.805109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 980/1966] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:55 2022] PUT /identity/v3/projects/5d4ee06360f1482bbba3de75882f5056/users/3dd64a0d8db947128aa6e56e6d5d93d7/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:55.819552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270fac-d2bd-47bf-82da-8bc99d63dba5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.820174 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270fac-d2bd-47bf-82da-8bc99d63dba5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.820807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270fac-d2bd-47bf-82da-8bc99d63dba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.849668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a1270fac-d2bd-47bf-82da-8bc99d63dba5 None None] MFA Rules not processed for user `3dd64a0d8db947128aa6e56e6d5d93d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:55.850888 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a1270fac-d2bd-47bf-82da-8bc99d63dba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:55.877278 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 987/1967] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:55.889096 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787877dd-cb4a-40d9-a409-e45dc5ba6f60 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:55.890895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-787877dd-cb4a-40d9-a409-e45dc5ba6f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:55.914909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 981/1968] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:55.919556 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1270fac-d2bd-47bf-82da-8bc99d63dba5 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:55.947923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787877dd-cb4a-40d9-a409-e45dc5ba6f60 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:55.983960 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1270fac-d2bd-47bf-82da-8bc99d63dba5 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:55.989028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e647db-0ce6-4f30-bc70-3c8d3eaad180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:55.989720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e647db-0ce6-4f30-bc70-3c8d3eaad180 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.990009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e647db-0ce6-4f30-bc70-3c8d3eaad180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.990377 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e647db-0ce6-4f30-bc70-3c8d3eaad180 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:55.991074 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e647db-0ce6-4f30-bc70-3c8d3eaad180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:55.993251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e647db-0ce6-4f30-bc70-3c8d3eaad180 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:55.997056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a57a2-60da-40ab-a014-f2d3c04e6ba3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:55.997740 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a57a2-60da-40ab-a014-f2d3c04e6ba3 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:55.998019 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a57a2-60da-40ab-a014-f2d3c04e6ba3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:55.998295 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a57a2-60da-40ab-a014-f2d3c04e6ba3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:56.060511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a57a2-60da-40ab-a014-f2d3c04e6ba3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:56.061973 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a57a2-60da-40ab-a014-f2d3c04e6ba3 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:56.072470 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 988/1969] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:05:56.115674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 982/1970] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:55 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:56.120974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a57a2-60da-40ab-a014-f2d3c04e6ba3 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:56.132104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a57a2-60da-40ab-a014-f2d3c04e6ba3 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:56.196416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bf4f6-d5d4-4d6e-8943-fcdd4eacda16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:56.197082 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bf4f6-d5d4-4d6e-8943-fcdd4eacda16 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:56.197364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bf4f6-d5d4-4d6e-8943-fcdd4eacda16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:56.197672 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bf4f6-d5d4-4d6e-8943-fcdd4eacda16 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:56.198389 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bf4f6-d5d4-4d6e-8943-fcdd4eacda16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:56.200320 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bf4f6-d5d4-4d6e-8943-fcdd4eacda16 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:56.305232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 989/1971] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:56 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:56.306742 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e647db-0ce6-4f30-bc70-3c8d3eaad180 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:56.317060 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e647db-0ce6-4f30-bc70-3c8d3eaad180 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:56.321740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be5c71-e213-41f6-9273-0b6f312cc740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:56.322462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be5c71-e213-41f6-9273-0b6f312cc740 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:56.322748 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be5c71-e213-41f6-9273-0b6f312cc740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:56.323029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be5c71-e213-41f6-9273-0b6f312cc740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:56.323791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be5c71-e213-41f6-9273-0b6f312cc740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:56.325485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be5c71-e213-41f6-9273-0b6f312cc740 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:56.336328 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 983/1972] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:56.340129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bf4f6-d5d4-4d6e-8943-fcdd4eacda16 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:56.350720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bf4f6-d5d4-4d6e-8943-fcdd4eacda16 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:56.355329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32919590-d354-4f08-a528-be0e9e4391a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:56.356245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32919590-d354-4f08-a528-be0e9e4391a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:56.356609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32919590-d354-4f08-a528-be0e9e4391a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:56.356886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32919590-d354-4f08-a528-be0e9e4391a5 admin admin] PATH_INFO: `/v3/projects/3b527074518b41928681014b649663b5/users/925ca3d16cb94e9283d4c50bae7b22c1/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:56.374303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32919590-d354-4f08-a528-be0e9e4391a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b527074518b41928681014b649663b5, user_id=925ca3d16cb94e9283d4c50bae7b22c1, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:56.377004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32919590-d354-4f08-a528-be0e9e4391a5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:56.527795 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 990/1973] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:56 2022] PUT /identity/v3/projects/3b527074518b41928681014b649663b5/users/925ca3d16cb94e9283d4c50bae7b22c1/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:56.532589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be5c71-e213-41f6-9273-0b6f312cc740 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:56.542705 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be5c71-e213-41f6-9273-0b6f312cc740 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:56.598425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8464e-cf32-4cf4-8873-2edc1318d391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:56.599080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8464e-cf32-4cf4-8873-2edc1318d391 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:56.599368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8464e-cf32-4cf4-8873-2edc1318d391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:56.599644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8464e-cf32-4cf4-8873-2edc1318d391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:56.600456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8464e-cf32-4cf4-8873-2edc1318d391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:56.602099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8464e-cf32-4cf4-8873-2edc1318d391 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:56.612274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 984/1974] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:05:56.616463 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32919590-d354-4f08-a528-be0e9e4391a5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:56.626978 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32919590-d354-4f08-a528-be0e9e4391a5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:56.632074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c8038-99f7-4008-baba-b3163adec2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:56.632973 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c8038-99f7-4008-baba-b3163adec2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:56.633307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c8038-99f7-4008-baba-b3163adec2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:56.633616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c8038-99f7-4008-baba-b3163adec2e4 admin admin] PATH_INFO: `/v3/projects/3b527074518b41928681014b649663b5/users/925ca3d16cb94e9283d4c50bae7b22c1/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:56.635715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c8038-99f7-4008-baba-b3163adec2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b527074518b41928681014b649663b5, user_id=925ca3d16cb94e9283d4c50bae7b22c1, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:56.638409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c8038-99f7-4008-baba-b3163adec2e4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:56.649743 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 991/1975] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:56 2022] PUT /identity/v3/projects/3b527074518b41928681014b649663b5/users/925ca3d16cb94e9283d4c50bae7b22c1/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:56.660342 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67439-4ed7-49a1-a749-b8e183cf803e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:56.660630 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67439-4ed7-49a1-a749-b8e183cf803e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:56.660907 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac67439-4ed7-49a1-a749-b8e183cf803e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:56.688381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fac67439-4ed7-49a1-a749-b8e183cf803e None None] MFA Rules not processed for user `925ca3d16cb94e9283d4c50bae7b22c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:56.690045 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fac67439-4ed7-49a1-a749-b8e183cf803e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:56.759582 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 985/1976] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:56.773497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c8038-99f7-4008-baba-b3163adec2e4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:56.780710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3d1c8038-99f7-4008-baba-b3163adec2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:56.844296 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c8038-99f7-4008-baba-b3163adec2e4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:56.848774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d12c9-2c66-43fd-b580-99143c95a8bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:56.849380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d12c9-2c66-43fd-b580-99143c95a8bd service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:56.849712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d12c9-2c66-43fd-b580-99143c95a8bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:56.849995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d12c9-2c66-43fd-b580-99143c95a8bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:56.859810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d12c9-2c66-43fd-b580-99143c95a8bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:56.861255 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d12c9-2c66-43fd-b580-99143c95a8bd service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:56.870638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 992/1977] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:57.003448 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac67439-4ed7-49a1-a749-b8e183cf803e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:57.065566 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac67439-4ed7-49a1-a749-b8e183cf803e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:57.070061 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb38a66-ef86-4082-8fae-494afa2f6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:57.070961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb38a66-ef86-4082-8fae-494afa2f6b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:57.071248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb38a66-ef86-4082-8fae-494afa2f6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:57.071514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb38a66-ef86-4082-8fae-494afa2f6b42 admin admin] PATH_INFO: `/v3/users/3dd64a0d8db947128aa6e56e6d5d93d7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:57.072687 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb38a66-ef86-4082-8fae-494afa2f6b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd64a0d8db947128aa6e56e6d5d93d7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:57.074766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb38a66-ef86-4082-8fae-494afa2f6b42 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:57.233346 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-feb38a66-ef86-4082-8fae-494afa2f6b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd64a0d8db947128aa6e56e6d5d93d7'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:57.313153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-feb38a66-ef86-4082-8fae-494afa2f6b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd64a0d8db947128aa6e56e6d5d93d7'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:57.321260 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-feb38a66-ef86-4082-8fae-494afa2f6b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd64a0d8db947128aa6e56e6d5d93d7'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:57.321961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-feb38a66-ef86-4082-8fae-494afa2f6b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd64a0d8db947128aa6e56e6d5d93d7'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:57.322602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-feb38a66-ef86-4082-8fae-494afa2f6b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd64a0d8db947128aa6e56e6d5d93d7'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:57.339717 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 986/1978] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:57 2022] DELETE /identity/v3/users/3dd64a0d8db947128aa6e56e6d5d93d7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:57.344401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3976613-f0f6-46ed-bbe7-aa56aed32d2b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:57.344779 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3976613-f0f6-46ed-bbe7-aa56aed32d2b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:57.345107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3976613-f0f6-46ed-bbe7-aa56aed32d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:57.365023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d3976613-f0f6-46ed-bbe7-aa56aed32d2b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:57.366154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d3976613-f0f6-46ed-bbe7-aa56aed32d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:57.433995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 993/1979] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:57.444404 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb38a66-ef86-4082-8fae-494afa2f6b42 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:57.445796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-feb38a66-ef86-4082-8fae-494afa2f6b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:57.501777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb38a66-ef86-4082-8fae-494afa2f6b42 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:57.506780 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da992418-384f-48fd-a8a4-6eba388d39d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:57.507246 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da992418-384f-48fd-a8a4-6eba388d39d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:57.507536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da992418-384f-48fd-a8a4-6eba388d39d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:57.507807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da992418-384f-48fd-a8a4-6eba388d39d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:57.519280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da992418-384f-48fd-a8a4-6eba388d39d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:57.520724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da992418-384f-48fd-a8a4-6eba388d39d0 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:57.532594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 987/1980] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:05:57.997029 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3976613-f0f6-46ed-bbe7-aa56aed32d2b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:57.998493 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d3976613-f0f6-46ed-bbe7-aa56aed32d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:58.012487 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3976613-f0f6-46ed-bbe7-aa56aed32d2b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:58.017306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13f253-9b53-4822-a91c-fdbb694c7aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:58.018902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f253-9b53-4822-a91c-fdbb694c7aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:58.019341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f253-9b53-4822-a91c-fdbb694c7aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:58.019899 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13f253-9b53-4822-a91c-fdbb694c7aa8 admin admin] PATH_INFO: `/v3/users/70ae8e6e3ec8401cbc7be32478ec7a89` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:58.020403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da992418-384f-48fd-a8a4-6eba388d39d0 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:58.022376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13f253-9b53-4822-a91c-fdbb694c7aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ae8e6e3ec8401cbc7be32478ec7a89)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:58.023756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-da992418-384f-48fd-a8a4-6eba388d39d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:58.024606 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13f253-9b53-4822-a91c-fdbb694c7aa8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:58.040372 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da992418-384f-48fd-a8a4-6eba388d39d0 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:58.051031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:58.051926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:58.052215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:58.052526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] PATH_INFO: `/v3/projects/5d4ee06360f1482bbba3de75882f5056` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:58.054151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4ee06360f1482bbba3de75882f5056)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:58.056130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:58.246663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4ee06360f1482bbba3de75882f5056', 'request_id': 'req-31767f5b-3366-4508-9000-554621d92fa6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.246914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f13f253-9b53-4822-a91c-fdbb694c7aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ae8e6e3ec8401cbc7be32478ec7a89'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.253444 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4ee06360f1482bbba3de75882f5056', 'request_id': 'req-31767f5b-3366-4508-9000-554621d92fa6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.254150 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f13f253-9b53-4822-a91c-fdbb694c7aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ae8e6e3ec8401cbc7be32478ec7a89'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.259469 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4ee06360f1482bbba3de75882f5056', 'request_id': 'req-31767f5b-3366-4508-9000-554621d92fa6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.318231 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f13f253-9b53-4822-a91c-fdbb694c7aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ae8e6e3ec8401cbc7be32478ec7a89'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.318869 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f13f253-9b53-4822-a91c-fdbb694c7aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ae8e6e3ec8401cbc7be32478ec7a89'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.319541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7f13f253-9b53-4822-a91c-fdbb694c7aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ae8e6e3ec8401cbc7be32478ec7a89'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.337168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 994/1981] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:57 2022] DELETE /identity/v3/users/70ae8e6e3ec8401cbc7be32478ec7a89 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:58.410003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] The token cache is being invalidate because project 5d4ee06360f1482bbba3de75882f5056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:58.410003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.410003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.410003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 988/1982] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:58 2022] DELETE /identity/v3/projects/5d4ee06360f1482bbba3de75882f5056 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:58.412803 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13f253-9b53-4822-a91c-fdbb694c7aa8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:58.414262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7f13f253-9b53-4822-a91c-fdbb694c7aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:58.481781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13f253-9b53-4822-a91c-fdbb694c7aa8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:58.487372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be76858-6b4b-4127-9b98-20ebf518aede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:58.488169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be76858-6b4b-4127-9b98-20ebf518aede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:58.488453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be76858-6b4b-4127-9b98-20ebf518aede admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:58.488762 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be76858-6b4b-4127-9b98-20ebf518aede admin admin] PATH_INFO: `/v3/users/925ca3d16cb94e9283d4c50bae7b22c1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:58.491621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be76858-6b4b-4127-9b98-20ebf518aede admin admin] RBAC: Authorizing `identity:delete_user(user_id=925ca3d16cb94e9283d4c50bae7b22c1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:58.493595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be76858-6b4b-4127-9b98-20ebf518aede admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:58.643548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:58.645072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:58.711205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767f5b-3366-4508-9000-554621d92fa6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:58.715840 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:58.716702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:58.716985 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:58.717261 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f admin admin] PATH_INFO: `/v3/projects/ba603b859ac34a119a85b6eaef862098` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:58.718524 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba603b859ac34a119a85b6eaef862098)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:58.721273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:58.746630 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3be76858-6b4b-4127-9b98-20ebf518aede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '925ca3d16cb94e9283d4c50bae7b22c1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.754277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3be76858-6b4b-4127-9b98-20ebf518aede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '925ca3d16cb94e9283d4c50bae7b22c1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.849816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3be76858-6b4b-4127-9b98-20ebf518aede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '925ca3d16cb94e9283d4c50bae7b22c1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.851280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3be76858-6b4b-4127-9b98-20ebf518aede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '925ca3d16cb94e9283d4c50bae7b22c1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.852284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3be76858-6b4b-4127-9b98-20ebf518aede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '925ca3d16cb94e9283d4c50bae7b22c1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.860265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba603b859ac34a119a85b6eaef862098', 'request_id': 'req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.866663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba603b859ac34a119a85b6eaef862098', 'request_id': 'req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.872568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba603b859ac34a119a85b6eaef862098', 'request_id': 'req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.874045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 995/1983] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:05:58 2022] DELETE /identity/v3/users/925ca3d16cb94e9283d4c50bae7b22c1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:05:58.959106 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f admin admin] The token cache is being invalidate because project ba603b859ac34a119a85b6eaef862098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:58.959607 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.960469 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5dc0984d-4d31-4bc3-b98e-3b74b07e0e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:58.962421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 989/1984] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:58 2022] DELETE /identity/v3/projects/ba603b859ac34a119a85b6eaef862098 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:58.967683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ba9cb-8cdb-4125-9a73-bd086023a72a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:58.968143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ba9cb-8cdb-4125-9a73-bd086023a72a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:58.968346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ba9cb-8cdb-4125-9a73-bd086023a72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:58.986777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fd8ba9cb-8cdb-4125-9a73-bd086023a72a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:58.988031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fd8ba9cb-8cdb-4125-9a73-bd086023a72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:59.047217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 996/1985] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:59.055385 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2dff4-fc0c-41f8-9638-73847f10c859 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:59.055844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2dff4-fc0c-41f8-9638-73847f10c859 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:59.055961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2dff4-fc0c-41f8-9638-73847f10c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:59.078943 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-34c2dff4-fc0c-41f8-9638-73847f10c859 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:59.080150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-34c2dff4-fc0c-41f8-9638-73847f10c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:59.089574 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 990/1986] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:59.093954 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ba9cb-8cdb-4125-9a73-bd086023a72a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:59.103367 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ba9cb-8cdb-4125-9a73-bd086023a72a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:59.107922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d6261-22cc-4ec2-b9d3-89cc578dde79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:59.108577 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d6261-22cc-4ec2-b9d3-89cc578dde79 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:59.108863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d6261-22cc-4ec2-b9d3-89cc578dde79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:59.109133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d6261-22cc-4ec2-b9d3-89cc578dde79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:59.109925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d6261-22cc-4ec2-b9d3-89cc578dde79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:59.110233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d6261-22cc-4ec2-b9d3-89cc578dde79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:59.111879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d6261-22cc-4ec2-b9d3-89cc578dde79 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:59.127864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 997/1987] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:05:59.129106 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2dff4-fc0c-41f8-9638-73847f10c859 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:59.139043 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2dff4-fc0c-41f8-9638-73847f10c859 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:59.145521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384b324-8c60-4659-9684-51b8fd7a7635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:59.146494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384b324-8c60-4659-9684-51b8fd7a7635 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:59.146949 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384b324-8c60-4659-9684-51b8fd7a7635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:59.147410 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384b324-8c60-4659-9684-51b8fd7a7635 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:59.148109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384b324-8c60-4659-9684-51b8fd7a7635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:59.150081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384b324-8c60-4659-9684-51b8fd7a7635 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:59.239749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 991/1988] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:59 2022] POST /identity/v3/projects => generated 391 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:59.244043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d6261-22cc-4ec2-b9d3-89cc578dde79 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:59.254309 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d6261-22cc-4ec2-b9d3-89cc578dde79 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:59.284557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384b324-8c60-4659-9684-51b8fd7a7635 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:59.288983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3384b324-8c60-4659-9684-51b8fd7a7635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:59.325818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43810e55-5075-4a94-924b-2ceb644ecc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:59.326509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43810e55-5075-4a94-924b-2ceb644ecc0b admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:59.346281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43810e55-5075-4a94-924b-2ceb644ecc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:59.346281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43810e55-5075-4a94-924b-2ceb644ecc0b admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:59.346281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43810e55-5075-4a94-924b-2ceb644ecc0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:59.346281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43810e55-5075-4a94-924b-2ceb644ecc0b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:59.370011 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384b324-8c60-4659-9684-51b8fd7a7635 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:59.375483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:59.376367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:59.376651 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:59.376925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3 admin admin] PATH_INFO: `/v3/projects/3b527074518b41928681014b649663b5` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:59.378161 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b527074518b41928681014b649663b5)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:59.380131 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:59.488098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 998/1989] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:59 2022] POST /identity/v3/users => generated 296 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:59.491980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43810e55-5075-4a94-924b-2ceb644ecc0b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:59.502097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43810e55-5075-4a94-924b-2ceb644ecc0b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:59.506708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3bd20-1ad4-41b5-b76c-33611a2abd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:59.507428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3bd20-1ad4-41b5-b76c-33611a2abd90 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:59.507712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3bd20-1ad4-41b5-b76c-33611a2abd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:59.508012 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3bd20-1ad4-41b5-b76c-33611a2abd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:59.508717 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3bd20-1ad4-41b5-b76c-33611a2abd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:59.510337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3bd20-1ad4-41b5-b76c-33611a2abd90 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:59.521015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 999/1990] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:05:59.524698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3bd20-1ad4-41b5-b76c-33611a2abd90 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:59.534398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b527074518b41928681014b649663b5', 'request_id': 'req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:59.534561 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3bd20-1ad4-41b5-b76c-33611a2abd90 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:59.540809 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b527074518b41928681014b649663b5', 'request_id': 'req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:59.546383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b527074518b41928681014b649663b5', 'request_id': 'req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:59.590142 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60f5fd-da29-4d53-9e66-b340a939e3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:59.590831 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60f5fd-da29-4d53-9e66-b340a939e3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:59.591100 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60f5fd-da29-4d53-9e66-b340a939e3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:59.591383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60f5fd-da29-4d53-9e66-b340a939e3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:59.592102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60f5fd-da29-4d53-9e66-b340a939e3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:59.593794 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60f5fd-da29-4d53-9e66-b340a939e3a2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:59.603409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1000/1991] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:05:59.607476 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60f5fd-da29-4d53-9e66-b340a939e3a2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:59.617312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60f5fd-da29-4d53-9e66-b340a939e3a2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:59.621961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ebe78-bb36-44d1-b324-a9272d299894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:59.628464 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ebe78-bb36-44d1-b324-a9272d299894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:59.628464 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ebe78-bb36-44d1-b324-a9272d299894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:59.628464 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ebe78-bb36-44d1-b324-a9272d299894 admin admin] PATH_INFO: `/v3/projects/838ec035db164e50bc335d2cf141d943/users/df9d6a9b73e64e31b014b5809912bbe8/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:59.639271 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ebe78-bb36-44d1-b324-a9272d299894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=838ec035db164e50bc335d2cf141d943, user_id=df9d6a9b73e64e31b014b5809912bbe8, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:59.641998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ebe78-bb36-44d1-b324-a9272d299894 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:59.664630 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3 admin admin] The token cache is being invalidate because project 3b527074518b41928681014b649663b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:05:59.664955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:59.665654 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-cff2eb45-5d7c-488a-b21d-f4c68201c6d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:05:59.667455 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 992/1992] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:05:59 2022] DELETE /identity/v3/projects/3b527074518b41928681014b649663b5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:59.672285 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc4530-a791-47dd-9168-4f655cd49c12 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:59.672639 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc4530-a791-47dd-9168-4f655cd49c12 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:59.673010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc4530-a791-47dd-9168-4f655cd49c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:59.697485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-65bc4530-a791-47dd-9168-4f655cd49c12 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:59.697485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-65bc4530-a791-47dd-9168-4f655cd49c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:59.701749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 993/1993] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:59.710596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245cb94-6958-4676-b8a5-8346805b99c9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:59.710888 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245cb94-6958-4676-b8a5-8346805b99c9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:59.711166 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245cb94-6958-4676-b8a5-8346805b99c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:59.735603 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3245cb94-6958-4676-b8a5-8346805b99c9 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:59.737583 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3245cb94-6958-4676-b8a5-8346805b99c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:59.744801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 994/1994] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:05:59.748789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245cb94-6958-4676-b8a5-8346805b99c9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:59.757928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245cb94-6958-4676-b8a5-8346805b99c9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:59.762520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce5314-2319-40cf-b0ca-051c8bf636e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:59.763174 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce5314-2319-40cf-b0ca-051c8bf636e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:59.763413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce5314-2319-40cf-b0ca-051c8bf636e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:59.763687 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce5314-2319-40cf-b0ca-051c8bf636e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:59.764392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce5314-2319-40cf-b0ca-051c8bf636e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:05:59.764697 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce5314-2319-40cf-b0ca-051c8bf636e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:59.766434 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce5314-2319-40cf-b0ca-051c8bf636e5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:59.777846 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 995/1995] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:05:59.782634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce5314-2319-40cf-b0ca-051c8bf636e5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:59.789879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1001/1996] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:05:59 2022] PUT /identity/v3/projects/838ec035db164e50bc335d2cf141d943/users/df9d6a9b73e64e31b014b5809912bbe8/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:05:59.791294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97133ce-d3b0-4a8c-a13b-a3bb41dc072c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:59.791583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97133ce-d3b0-4a8c-a13b-a3bb41dc072c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:59.792178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97133ce-d3b0-4a8c-a13b-a3bb41dc072c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:59.792839 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce5314-2319-40cf-b0ca-051c8bf636e5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:59.810002 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f97133ce-d3b0-4a8c-a13b-a3bb41dc072c None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:05:59.811274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f97133ce-d3b0-4a8c-a13b-a3bb41dc072c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:59.854569 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c280596-c051-4194-b8fb-dbc771399dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:59.855313 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c280596-c051-4194-b8fb-dbc771399dde admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:59.855671 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c280596-c051-4194-b8fb-dbc771399dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:59.855959 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c280596-c051-4194-b8fb-dbc771399dde admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:59.856647 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c280596-c051-4194-b8fb-dbc771399dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:59.858602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c280596-c051-4194-b8fb-dbc771399dde admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:59.886034 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1002/1997] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:05:59.895604 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97133ce-d3b0-4a8c-a13b-a3bb41dc072c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:59.897181 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f97133ce-d3b0-4a8c-a13b-a3bb41dc072c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:05:59.951136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97133ce-d3b0-4a8c-a13b-a3bb41dc072c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:05:59.954776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a762e-7d6a-4cac-9ac0-a45f1ed9666f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:05:59.955415 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a762e-7d6a-4cac-9ac0-a45f1ed9666f service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:05:59.955698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a762e-7d6a-4cac-9ac0-a45f1ed9666f service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:05:59.955973 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a762e-7d6a-4cac-9ac0-a45f1ed9666f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:05:59.965298 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a762e-7d6a-4cac-9ac0-a45f1ed9666f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:05:59.966771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a762e-7d6a-4cac-9ac0-a45f1ed9666f service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:05:59.976792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1003/1998] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:05:59.983922 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 996/1999] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:05:59 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:05:59.984966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a762e-7d6a-4cac-9ac0-a45f1ed9666f service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:05:59.994435 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a762e-7d6a-4cac-9ac0-a45f1ed9666f service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:00.048752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afec1ac-cc98-4afe-9f17-3722f8d586ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:00.049409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afec1ac-cc98-4afe-9f17-3722f8d586ee admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:00.049721 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afec1ac-cc98-4afe-9f17-3722f8d586ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:00.050001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afec1ac-cc98-4afe-9f17-3722f8d586ee admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:00.050675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afec1ac-cc98-4afe-9f17-3722f8d586ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:00.052641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afec1ac-cc98-4afe-9f17-3722f8d586ee admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:00.130107 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1004/2000] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:05:59 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:00.134249 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c280596-c051-4194-b8fb-dbc771399dde admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:00.145119 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c280596-c051-4194-b8fb-dbc771399dde admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:00.150075 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4606c-36c2-4208-9553-b2f3f6b19a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:00.150777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4606c-36c2-4208-9553-b2f3f6b19a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:00.151061 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4606c-36c2-4208-9553-b2f3f6b19a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:00.151338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4606c-36c2-4208-9553-b2f3f6b19a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:00.152089 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4606c-36c2-4208-9553-b2f3f6b19a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:00.153712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4606c-36c2-4208-9553-b2f3f6b19a4b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:00.163500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 997/2001] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:00.167370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afec1ac-cc98-4afe-9f17-3722f8d586ee admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:00.177920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afec1ac-cc98-4afe-9f17-3722f8d586ee admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:00.182641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422209cc-e55d-4021-90e5-0576e7fe7564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:00.183289 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422209cc-e55d-4021-90e5-0576e7fe7564 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:00.183571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422209cc-e55d-4021-90e5-0576e7fe7564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:00.183846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422209cc-e55d-4021-90e5-0576e7fe7564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:00.184559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422209cc-e55d-4021-90e5-0576e7fe7564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:00.186183 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422209cc-e55d-4021-90e5-0576e7fe7564 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:00.196852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1005/2002] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:00.200820 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4606c-36c2-4208-9553-b2f3f6b19a4b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:00.210522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4606c-36c2-4208-9553-b2f3f6b19a4b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:00.215079 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47beddd2-0f3b-40f6-83ba-4f75b89f595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:00.215946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47beddd2-0f3b-40f6-83ba-4f75b89f595c admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:00.216227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47beddd2-0f3b-40f6-83ba-4f75b89f595c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:00.216499 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47beddd2-0f3b-40f6-83ba-4f75b89f595c admin admin] PATH_INFO: `/v3/projects/392d5810747d4372ae025e4a5aa84e23/users/674d867af9524101a9124715207d5a32/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:00.234805 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47beddd2-0f3b-40f6-83ba-4f75b89f595c admin admin] RBAC: Authorizing `identity:create_grant(project_id=392d5810747d4372ae025e4a5aa84e23, user_id=674d867af9524101a9124715207d5a32, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:00.237495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47beddd2-0f3b-40f6-83ba-4f75b89f595c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:00.370411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 998/2003] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:00 2022] PUT /identity/v3/projects/392d5810747d4372ae025e4a5aa84e23/users/674d867af9524101a9124715207d5a32/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:00.381152 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5e95-960d-4c01-97c5-e0de4b0c7742 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:00.381446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5e95-960d-4c01-97c5-e0de4b0c7742 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:00.381777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5e95-960d-4c01-97c5-e0de4b0c7742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:00.409481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c53d5e95-960d-4c01-97c5-e0de4b0c7742 None None] MFA Rules not processed for user `674d867af9524101a9124715207d5a32`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:00.410736 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c53d5e95-960d-4c01-97c5-e0de4b0c7742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:00.479654 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1006/2004] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:00.483887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47beddd2-0f3b-40f6-83ba-4f75b89f595c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:00.552512 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47beddd2-0f3b-40f6-83ba-4f75b89f595c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:00.560153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144e53a-b126-4331-889a-e3525b902ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:00.561035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e53a-b126-4331-889a-e3525b902ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:00.561312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e53a-b126-4331-889a-e3525b902ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:00.561708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e53a-b126-4331-889a-e3525b902ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:00.562424 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144e53a-b126-4331-889a-e3525b902ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:00.564346 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144e53a-b126-4331-889a-e3525b902ba5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:00.667047 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 999/2005] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:00 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:00.668327 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d5e95-960d-4c01-97c5-e0de4b0c7742 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:00.679923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d5e95-960d-4c01-97c5-e0de4b0c7742 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:00.740291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d3fb6-5a15-40bc-9f1e-d93665a12255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:00.740967 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d3fb6-5a15-40bc-9f1e-d93665a12255 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:00.741248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d3fb6-5a15-40bc-9f1e-d93665a12255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:00.741559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d3fb6-5a15-40bc-9f1e-d93665a12255 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:00.742738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d3fb6-5a15-40bc-9f1e-d93665a12255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:00.744148 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d3fb6-5a15-40bc-9f1e-d93665a12255 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:00.855528 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1007/2006] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:00 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:00.860299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144e53a-b126-4331-889a-e3525b902ba5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:00.870517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144e53a-b126-4331-889a-e3525b902ba5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:00.875260 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d7c36-1259-4845-95ca-d3cf1fba6214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:00.875913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d7c36-1259-4845-95ca-d3cf1fba6214 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:00.876198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d7c36-1259-4845-95ca-d3cf1fba6214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:00.876475 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d7c36-1259-4845-95ca-d3cf1fba6214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:00.877202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d7c36-1259-4845-95ca-d3cf1fba6214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:00.878827 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d7c36-1259-4845-95ca-d3cf1fba6214 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:00.889072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1000/2007] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:00.893466 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d3fb6-5a15-40bc-9f1e-d93665a12255 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:00.903616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d3fb6-5a15-40bc-9f1e-d93665a12255 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:00.908946 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1439c-e2a2-4bc0-b2cb-98527b420063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:00.909852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1439c-e2a2-4bc0-b2cb-98527b420063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:00.910141 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1439c-e2a2-4bc0-b2cb-98527b420063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:00.910421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1439c-e2a2-4bc0-b2cb-98527b420063 admin admin] PATH_INFO: `/v3/projects/db2a507cbf5846a4b23280a1c55b493d/users/8bbb19da20304540bfead5c045b5ede8/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:00.925651 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1439c-e2a2-4bc0-b2cb-98527b420063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2a507cbf5846a4b23280a1c55b493d, user_id=8bbb19da20304540bfead5c045b5ede8, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:00.928611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1439c-e2a2-4bc0-b2cb-98527b420063 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:01.044001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1008/2008] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:00 2022] PUT /identity/v3/projects/db2a507cbf5846a4b23280a1c55b493d/users/8bbb19da20304540bfead5c045b5ede8/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:01.048354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d7c36-1259-4845-95ca-d3cf1fba6214 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:01.058396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d7c36-1259-4845-95ca-d3cf1fba6214 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:01.112871 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b204eb-7aaa-45cc-a874-9dfd5632e233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:01.113664 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b204eb-7aaa-45cc-a874-9dfd5632e233 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:01.114027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b204eb-7aaa-45cc-a874-9dfd5632e233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:01.114302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b204eb-7aaa-45cc-a874-9dfd5632e233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:01.115027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b204eb-7aaa-45cc-a874-9dfd5632e233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:01.116614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b204eb-7aaa-45cc-a874-9dfd5632e233 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:01.126667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1001/2009] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:01.130833 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1439c-e2a2-4bc0-b2cb-98527b420063 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:01.140872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1439c-e2a2-4bc0-b2cb-98527b420063 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:01.145552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a341-884a-4b4d-84ef-b3047d144574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:01.148034 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a341-884a-4b4d-84ef-b3047d144574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:01.148034 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a341-884a-4b4d-84ef-b3047d144574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:01.148034 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a341-884a-4b4d-84ef-b3047d144574 admin admin] PATH_INFO: `/v3/projects/db2a507cbf5846a4b23280a1c55b493d/users/8bbb19da20304540bfead5c045b5ede8/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:01.149559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9a341-884a-4b4d-84ef-b3047d144574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2a507cbf5846a4b23280a1c55b493d, user_id=8bbb19da20304540bfead5c045b5ede8, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:01.152483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9a341-884a-4b4d-84ef-b3047d144574 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:01.164539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1009/2010] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:01 2022] PUT /identity/v3/projects/db2a507cbf5846a4b23280a1c55b493d/users/8bbb19da20304540bfead5c045b5ede8/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:01.175082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc327fc-70c8-41d7-acd7-bf342e1ea4f4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:01.176755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc327fc-70c8-41d7-acd7-bf342e1ea4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:01.176755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc327fc-70c8-41d7-acd7-bf342e1ea4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:01.201811 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0fc327fc-70c8-41d7-acd7-bf342e1ea4f4 None None] MFA Rules not processed for user `8bbb19da20304540bfead5c045b5ede8`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:01.203049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0fc327fc-70c8-41d7-acd7-bf342e1ea4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:01.283832 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1002/2011] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:01.295124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a341-884a-4b4d-84ef-b3047d144574 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:01.296966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-66e9a341-884a-4b4d-84ef-b3047d144574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:01.367623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a341-884a-4b4d-84ef-b3047d144574 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:01.372021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129582df-2682-4d69-b1e0-7a55425701c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:01.374616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129582df-2682-4d69-b1e0-7a55425701c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:01.374616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129582df-2682-4d69-b1e0-7a55425701c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:01.374616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129582df-2682-4d69-b1e0-7a55425701c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:01.385429 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129582df-2682-4d69-b1e0-7a55425701c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:01.387127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129582df-2682-4d69-b1e0-7a55425701c2 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:01.398099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1010/2012] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:02.719888 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc327fc-70c8-41d7-acd7-bf342e1ea4f4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:02.799388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc327fc-70c8-41d7-acd7-bf342e1ea4f4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:02.804499 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4c9bc-7f1e-4537-85c1-ecf7c4f9b50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:02.805384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4c9bc-7f1e-4537-85c1-ecf7c4f9b50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:02.808040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4c9bc-7f1e-4537-85c1-ecf7c4f9b50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:02.808040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4c9bc-7f1e-4537-85c1-ecf7c4f9b50d admin admin] PATH_INFO: `/v3/users/674d867af9524101a9124715207d5a32` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:02.808348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4c9bc-7f1e-4537-85c1-ecf7c4f9b50d admin admin] RBAC: Authorizing `identity:delete_user(user_id=674d867af9524101a9124715207d5a32)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:02.810528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4c9bc-7f1e-4537-85c1-ecf7c4f9b50d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:03.052152 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-22a4c9bc-7f1e-4537-85c1-ecf7c4f9b50d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674d867af9524101a9124715207d5a32'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:03.127015 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-22a4c9bc-7f1e-4537-85c1-ecf7c4f9b50d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674d867af9524101a9124715207d5a32'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:03.139318 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-22a4c9bc-7f1e-4537-85c1-ecf7c4f9b50d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674d867af9524101a9124715207d5a32'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:03.140904 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-22a4c9bc-7f1e-4537-85c1-ecf7c4f9b50d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674d867af9524101a9124715207d5a32'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:03.142676 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-22a4c9bc-7f1e-4537-85c1-ecf7c4f9b50d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674d867af9524101a9124715207d5a32'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:03.163974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1003/2013] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:02 2022] DELETE /identity/v3/users/674d867af9524101a9124715207d5a32 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:03.168882 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ca863-4e3d-4acf-86a2-6e63c44a950d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:03.169839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ca863-4e3d-4acf-86a2-6e63c44a950d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:03.170187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ca863-4e3d-4acf-86a2-6e63c44a950d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:03.194787 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fe3ca863-4e3d-4acf-86a2-6e63c44a950d None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:03.197415 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fe3ca863-4e3d-4acf-86a2-6e63c44a950d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:03.289261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1011/2014] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:03.299630 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4c9bc-7f1e-4537-85c1-ecf7c4f9b50d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:03.301429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-22a4c9bc-7f1e-4537-85c1-ecf7c4f9b50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:03.385827 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4c9bc-7f1e-4537-85c1-ecf7c4f9b50d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:03.389786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1652262-a404-414e-bb45-3ac27199bb32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:03.390798 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1652262-a404-414e-bb45-3ac27199bb32 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:03.391296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1652262-a404-414e-bb45-3ac27199bb32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:03.391715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1652262-a404-414e-bb45-3ac27199bb32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:03.405708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1652262-a404-414e-bb45-3ac27199bb32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:03.407534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1652262-a404-414e-bb45-3ac27199bb32 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:03.430848 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1004/2015] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:06:03.967369 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ca863-4e3d-4acf-86a2-6e63c44a950d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:03.968981 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fe3ca863-4e3d-4acf-86a2-6e63c44a950d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:03.991666 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ca863-4e3d-4acf-86a2-6e63c44a950d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:03.998241 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:04.012816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:04.013401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:04.013904 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] PATH_INFO: `/v3/projects/392d5810747d4372ae025e4a5aa84e23` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:04.016009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] RBAC: Authorizing `identity:delete_project(project_id=392d5810747d4372ae025e4a5aa84e23)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:04.018251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:04.150751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '392d5810747d4372ae025e4a5aa84e23', 'request_id': 'req-9ad0c402-61c7-4b14-a0bb-8cf7658161da'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:04.157265 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '392d5810747d4372ae025e4a5aa84e23', 'request_id': 'req-9ad0c402-61c7-4b14-a0bb-8cf7658161da'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:04.164305 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '392d5810747d4372ae025e4a5aa84e23', 'request_id': 'req-9ad0c402-61c7-4b14-a0bb-8cf7658161da'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:04.260268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] The token cache is being invalidate because project 392d5810747d4372ae025e4a5aa84e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:04.260268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:04.261620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:04.264165 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1012/2016] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:03 2022] DELETE /identity/v3/projects/392d5810747d4372ae025e4a5aa84e23 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:04.268431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1652262-a404-414e-bb45-3ac27199bb32 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:04.279763 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1652262-a404-414e-bb45-3ac27199bb32 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:04.345796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033a944-7152-4e12-b31b-4d1e3bca6f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:04.346861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033a944-7152-4e12-b31b-4d1e3bca6f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:04.347239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033a944-7152-4e12-b31b-4d1e3bca6f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:04.347613 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033a944-7152-4e12-b31b-4d1e3bca6f37 admin admin] PATH_INFO: `/v3/users/8bbb19da20304540bfead5c045b5ede8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:04.348918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033a944-7152-4e12-b31b-4d1e3bca6f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bbb19da20304540bfead5c045b5ede8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:04.351041 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033a944-7152-4e12-b31b-4d1e3bca6f37 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:04.540776 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7033a944-7152-4e12-b31b-4d1e3bca6f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bbb19da20304540bfead5c045b5ede8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:04.615971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7033a944-7152-4e12-b31b-4d1e3bca6f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bbb19da20304540bfead5c045b5ede8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:04.633758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7033a944-7152-4e12-b31b-4d1e3bca6f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bbb19da20304540bfead5c045b5ede8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:04.635396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7033a944-7152-4e12-b31b-4d1e3bca6f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bbb19da20304540bfead5c045b5ede8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:04.636518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7033a944-7152-4e12-b31b-4d1e3bca6f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bbb19da20304540bfead5c045b5ede8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:04.668878 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1005/2017] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:04 2022] DELETE /identity/v3/users/8bbb19da20304540bfead5c045b5ede8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:05.244741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:05.246624 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:05.262853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0c402-61c7-4b14-a0bb-8cf7658161da admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:05.323166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:05.324014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:05.324291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:05.324566 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198 admin admin] PATH_INFO: `/v3/projects/db2a507cbf5846a4b23280a1c55b493d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:05.325787 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db2a507cbf5846a4b23280a1c55b493d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:05.328328 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:05.515179 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2a507cbf5846a4b23280a1c55b493d', 'request_id': 'req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:05.522848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2a507cbf5846a4b23280a1c55b493d', 'request_id': 'req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:05.537940 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2a507cbf5846a4b23280a1c55b493d', 'request_id': 'req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:05.656213 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198 admin admin] The token cache is being invalidate because project db2a507cbf5846a4b23280a1c55b493d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:05.656792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:05.659412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eaaa5eae-1f0d-43c7-b58b-28354dc6f198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:05.668251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1013/2018] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:05 2022] DELETE /identity/v3/projects/db2a507cbf5846a4b23280a1c55b493d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:05.673627 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388856f-1cee-440b-9177-37057b883fd2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:05.674330 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388856f-1cee-440b-9177-37057b883fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:05.674330 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388856f-1cee-440b-9177-37057b883fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:05.717442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5388856f-1cee-440b-9177-37057b883fd2 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:05.718808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5388856f-1cee-440b-9177-37057b883fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:05.805916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1006/2019] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:05.814950 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f385ba-5086-4bc2-bd7b-93bb817e0fc6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:05.815245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f385ba-5086-4bc2-bd7b-93bb817e0fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:05.815529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f385ba-5086-4bc2-bd7b-93bb817e0fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:05.836556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-41f385ba-5086-4bc2-bd7b-93bb817e0fc6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:05.838087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-41f385ba-5086-4bc2-bd7b-93bb817e0fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:05.858054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1014/2020] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:06:05.860468 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388856f-1cee-440b-9177-37057b883fd2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:05.871932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388856f-1cee-440b-9177-37057b883fd2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:05.878497 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4d49d-fd0b-497f-b3d1-5e539d35180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:05.879741 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4d49d-fd0b-497f-b3d1-5e539d35180b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:05.880028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4d49d-fd0b-497f-b3d1-5e539d35180b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:05.880304 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4d49d-fd0b-497f-b3d1-5e539d35180b admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:05.881502 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4d49d-fd0b-497f-b3d1-5e539d35180b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:06:05.881846 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4d49d-fd0b-497f-b3d1-5e539d35180b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:05.884826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4d49d-fd0b-497f-b3d1-5e539d35180b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:05.900476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1007/2021] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:06:05.904951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f385ba-5086-4bc2-bd7b-93bb817e0fc6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:05.917252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f385ba-5086-4bc2-bd7b-93bb817e0fc6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:05.927491 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3c9d2-037d-47f1-9e55-158689294dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:05.928209 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3c9d2-037d-47f1-9e55-158689294dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:05.928497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3c9d2-037d-47f1-9e55-158689294dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:05.928926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3c9d2-037d-47f1-9e55-158689294dc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:05.929681 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3c9d2-037d-47f1-9e55-158689294dc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:05.931620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3c9d2-037d-47f1-9e55-158689294dc1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:06.011311 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1015/2022] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:05 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:06.016367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4d49d-fd0b-497f-b3d1-5e539d35180b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:06.027714 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4d49d-fd0b-497f-b3d1-5e539d35180b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:06.033839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5162f2a-0ff7-4caf-bb61-51c747071f80 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:06.034157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5162f2a-0ff7-4caf-bb61-51c747071f80 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:06.034531 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5162f2a-0ff7-4caf-bb61-51c747071f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:06.072636 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b5162f2a-0ff7-4caf-bb61-51c747071f80 None None] MFA Rules not processed for user `df9d6a9b73e64e31b014b5809912bbe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:06.074115 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b5162f2a-0ff7-4caf-bb61-51c747071f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:06.095650 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deebb69-225a-4dba-b7de-cb1e59319e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:06.096324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deebb69-225a-4dba-b7de-cb1e59319e66 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:06.096608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deebb69-225a-4dba-b7de-cb1e59319e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:06.096934 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deebb69-225a-4dba-b7de-cb1e59319e66 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:06.097595 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deebb69-225a-4dba-b7de-cb1e59319e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:06.099509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deebb69-225a-4dba-b7de-cb1e59319e66 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:06.139596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1016/2023] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:06.151459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a6a57-0554-4afd-9257-0867eb14d4a0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:06.151746 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a6a57-0554-4afd-9257-0867eb14d4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:06.152020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a6a57-0554-4afd-9257-0867eb14d4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:06.169291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5e8a6a57-0554-4afd-9257-0867eb14d4a0 None None] MFA Rules not processed for user `df9d6a9b73e64e31b014b5809912bbe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:06.170503 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5e8a6a57-0554-4afd-9257-0867eb14d4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:06.178436 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1017/2024] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:06:06.183902 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1008/2025] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:06 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:06.185260 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a6a57-0554-4afd-9257-0867eb14d4a0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:06.190297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deebb69-225a-4dba-b7de-cb1e59319e66 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:06.192140 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6deebb69-225a-4dba-b7de-cb1e59319e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:06.199356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a6a57-0554-4afd-9257-0867eb14d4a0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:06.204023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05558e-4a7f-42f8-883f-5601dfb58137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:06.204684 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05558e-4a7f-42f8-883f-5601dfb58137 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:06.204968 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05558e-4a7f-42f8-883f-5601dfb58137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:06.205244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05558e-4a7f-42f8-883f-5601dfb58137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:06.206130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05558e-4a7f-42f8-883f-5601dfb58137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:06.207720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05558e-4a7f-42f8-883f-5601dfb58137 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:06.217618 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1018/2026] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:06.221403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05558e-4a7f-42f8-883f-5601dfb58137 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:06.231046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05558e-4a7f-42f8-883f-5601dfb58137 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:06.236488 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef20f9-162f-4841-8c24-7b08ebc8636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:06.237239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef20f9-162f-4841-8c24-7b08ebc8636f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:06.237551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef20f9-162f-4841-8c24-7b08ebc8636f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:06.237836 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef20f9-162f-4841-8c24-7b08ebc8636f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:06.238561 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef20f9-162f-4841-8c24-7b08ebc8636f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:06.240152 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef20f9-162f-4841-8c24-7b08ebc8636f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:06.250758 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1019/2027] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:06.254710 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef20f9-162f-4841-8c24-7b08ebc8636f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:06.266093 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef20f9-162f-4841-8c24-7b08ebc8636f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:06.267936 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deebb69-225a-4dba-b7de-cb1e59319e66 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:06.273990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a0695-2a6a-42c4-aa39-9327e4b8d1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:06.274492 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b3197-b735-4b99-92c6-d0a6d29509ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:06.278274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a0695-2a6a-42c4-aa39-9327e4b8d1fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:06.278274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a0695-2a6a-42c4-aa39-9327e4b8d1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:06.278462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b3197-b735-4b99-92c6-d0a6d29509ee service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:06.278566 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a0695-2a6a-42c4-aa39-9327e4b8d1fb admin admin] PATH_INFO: `/v3/projects/19b9760db57f4145b127f10ef76196ef/users/7d43cfe4059f4411884734ca62f14f8c/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:06.278744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b3197-b735-4b99-92c6-d0a6d29509ee service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:06.278744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b3197-b735-4b99-92c6-d0a6d29509ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:06.285498 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b3197-b735-4b99-92c6-d0a6d29509ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:06.287184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b3197-b735-4b99-92c6-d0a6d29509ee service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:06.291973 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a0695-2a6a-42c4-aa39-9327e4b8d1fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b9760db57f4145b127f10ef76196ef, user_id=7d43cfe4059f4411884734ca62f14f8c, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:06.294713 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a0695-2a6a-42c4-aa39-9327e4b8d1fb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:06.299717 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1009/2028] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:06:06.409473 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1020/2029] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:06 2022] PUT /identity/v3/projects/19b9760db57f4145b127f10ef76196ef/users/7d43cfe4059f4411884734ca62f14f8c/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:06.420751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f1bab-d725-40ea-8f30-b6aedce065be None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:06.421115 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f1bab-d725-40ea-8f30-b6aedce065be None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:06.422008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f1bab-d725-40ea-8f30-b6aedce065be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:06.469283 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1a2f1bab-d725-40ea-8f30-b6aedce065be None None] MFA Rules not processed for user `7d43cfe4059f4411884734ca62f14f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:06.471662 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1a2f1bab-d725-40ea-8f30-b6aedce065be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:06.549170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1010/2030] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:06.553852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a0695-2a6a-42c4-aa39-9327e4b8d1fb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:06.639769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a0695-2a6a-42c4-aa39-9327e4b8d1fb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:06.647213 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d72dab-229d-4ca4-b8ef-8ea331aefa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:06.648101 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72dab-229d-4ca4-b8ef-8ea331aefa83 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:06.648844 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72dab-229d-4ca4-b8ef-8ea331aefa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:06.649125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72dab-229d-4ca4-b8ef-8ea331aefa83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:06.650031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d72dab-229d-4ca4-b8ef-8ea331aefa83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:06.652746 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d72dab-229d-4ca4-b8ef-8ea331aefa83 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:06.769120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1021/2031] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:06 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:06.769977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f1bab-d725-40ea-8f30-b6aedce065be None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:06.784010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f1bab-d725-40ea-8f30-b6aedce065be None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:06.882682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70eb07f-c164-4ee7-afc6-7c55f3b131fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:06.883367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eb07f-c164-4ee7-afc6-7c55f3b131fd admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:06.883652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eb07f-c164-4ee7-afc6-7c55f3b131fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:06.883930 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70eb07f-c164-4ee7-afc6-7c55f3b131fd admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:06.884655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70eb07f-c164-4ee7-afc6-7c55f3b131fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:06.886666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70eb07f-c164-4ee7-afc6-7c55f3b131fd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:06.964912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1011/2032] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:06 2022] POST /identity/v3/users => generated 294 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:06.969623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d72dab-229d-4ca4-b8ef-8ea331aefa83 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:06.983409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d72dab-229d-4ca4-b8ef-8ea331aefa83 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:06.989729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3629d3e-2a5c-4be8-995e-d18dffeb8d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:06.990666 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629d3e-2a5c-4be8-995e-d18dffeb8d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:06.990958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629d3e-2a5c-4be8-995e-d18dffeb8d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:06.991229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629d3e-2a5c-4be8-995e-d18dffeb8d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:06.991959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3629d3e-2a5c-4be8-995e-d18dffeb8d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:06.993630 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3629d3e-2a5c-4be8-995e-d18dffeb8d13 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:07.007030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1022/2033] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:07.011761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70eb07f-c164-4ee7-afc6-7c55f3b131fd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:07.022296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70eb07f-c164-4ee7-afc6-7c55f3b131fd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:07.027371 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920947ab-c627-4693-b254-326e9dfb27e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:07.028261 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920947ab-c627-4693-b254-326e9dfb27e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:07.028551 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920947ab-c627-4693-b254-326e9dfb27e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:07.028831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920947ab-c627-4693-b254-326e9dfb27e3 admin admin] PATH_INFO: `/v3/projects/08b08ac26a3a4834b90ed43f0e30d06e/users/01cbb5392e62439ca8ac40198991fde9/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:07.045206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920947ab-c627-4693-b254-326e9dfb27e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b08ac26a3a4834b90ed43f0e30d06e, user_id=01cbb5392e62439ca8ac40198991fde9, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:07.064188 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920947ab-c627-4693-b254-326e9dfb27e3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:07.141124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef28160-1262-453d-aea4-72fd8c1ec36d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:07.141124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef28160-1262-453d-aea4-72fd8c1ec36d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:07.141124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef28160-1262-453d-aea4-72fd8c1ec36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:07.158064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0ef28160-1262-453d-aea4-72fd8c1ec36d None None] MFA Rules not processed for user `df9d6a9b73e64e31b014b5809912bbe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:07.159511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0ef28160-1262-453d-aea4-72fd8c1ec36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:07.177360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1012/2034] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:07 2022] PUT /identity/v3/projects/08b08ac26a3a4834b90ed43f0e30d06e/users/01cbb5392e62439ca8ac40198991fde9/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:06:07.181073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920947ab-c627-4693-b254-326e9dfb27e3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:07.247246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1023/2035] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:07.271520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920947ab-c627-4693-b254-326e9dfb27e3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:07.276596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbe7eb-782e-44b0-9356-0ee58096d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:07.277366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbe7eb-782e-44b0-9356-0ee58096d3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:07.277765 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbe7eb-782e-44b0-9356-0ee58096d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:07.278111 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbe7eb-782e-44b0-9356-0ee58096d3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:07.278992 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbe7eb-782e-44b0-9356-0ee58096d3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:07.280803 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbe7eb-782e-44b0-9356-0ee58096d3f5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:07.294662 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1013/2036] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:06:07.298708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef28160-1262-453d-aea4-72fd8c1ec36d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:07.309871 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef28160-1262-453d-aea4-72fd8c1ec36d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:07.315186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4c075-6c42-4b7b-b16a-a6e68e72660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:07.316128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4c075-6c42-4b7b-b16a-a6e68e72660f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:07.316430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4c075-6c42-4b7b-b16a-a6e68e72660f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:07.317331 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4c075-6c42-4b7b-b16a-a6e68e72660f admin admin] PATH_INFO: `/v3/projects/08b08ac26a3a4834b90ed43f0e30d06e/users/01cbb5392e62439ca8ac40198991fde9/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:07.319370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4c075-6c42-4b7b-b16a-a6e68e72660f admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b08ac26a3a4834b90ed43f0e30d06e, user_id=01cbb5392e62439ca8ac40198991fde9, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:07.322122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4c075-6c42-4b7b-b16a-a6e68e72660f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:07.367914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1024/2037] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:07 2022] PUT /identity/v3/projects/08b08ac26a3a4834b90ed43f0e30d06e/users/01cbb5392e62439ca8ac40198991fde9/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:06:07.375788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33558833-d63d-410c-8b48-5598e06ac3ea None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:07.376565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33558833-d63d-410c-8b48-5598e06ac3ea None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:07.376946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33558833-d63d-410c-8b48-5598e06ac3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:07.410819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-33558833-d63d-410c-8b48-5598e06ac3ea None None] MFA Rules not processed for user `01cbb5392e62439ca8ac40198991fde9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:07.412124 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-33558833-d63d-410c-8b48-5598e06ac3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:07.491006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1014/2038] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:06:07.499071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4c075-6c42-4b7b-b16a-a6e68e72660f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:07.501953 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-86f4c075-6c42-4b7b-b16a-a6e68e72660f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:07.574967 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4c075-6c42-4b7b-b16a-a6e68e72660f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:07.579689 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ef9e9-5351-4b7d-99ab-ec9d8f352623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:07.580488 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ef9e9-5351-4b7d-99ab-ec9d8f352623 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:07.580936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ef9e9-5351-4b7d-99ab-ec9d8f352623 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:07.581309 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ef9e9-5351-4b7d-99ab-ec9d8f352623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:07.648818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ef9e9-5351-4b7d-99ab-ec9d8f352623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:07.648818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ef9e9-5351-4b7d-99ab-ec9d8f352623 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:07.657104 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1025/2039] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:09.582549 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33558833-d63d-410c-8b48-5598e06ac3ea None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:09.582549 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-33558833-d63d-410c-8b48-5598e06ac3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:09.658366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33558833-d63d-410c-8b48-5598e06ac3ea None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:09.663340 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60539a1e-91bf-40ae-913b-ee05a8f885a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:09.664146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60539a1e-91bf-40ae-913b-ee05a8f885a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:09.664427 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60539a1e-91bf-40ae-913b-ee05a8f885a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:09.664697 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60539a1e-91bf-40ae-913b-ee05a8f885a6 admin admin] PATH_INFO: `/v3/users/2853821b1f51496f97fa6b694c8136ae` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:09.665947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60539a1e-91bf-40ae-913b-ee05a8f885a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2853821b1f51496f97fa6b694c8136ae)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:09.668265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60539a1e-91bf-40ae-913b-ee05a8f885a6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:09.915599 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-60539a1e-91bf-40ae-913b-ee05a8f885a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2853821b1f51496f97fa6b694c8136ae'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:10.078944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-60539a1e-91bf-40ae-913b-ee05a8f885a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2853821b1f51496f97fa6b694c8136ae'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:10.087688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-60539a1e-91bf-40ae-913b-ee05a8f885a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2853821b1f51496f97fa6b694c8136ae'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:10.088547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-60539a1e-91bf-40ae-913b-ee05a8f885a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2853821b1f51496f97fa6b694c8136ae'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:10.089159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-60539a1e-91bf-40ae-913b-ee05a8f885a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2853821b1f51496f97fa6b694c8136ae'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:10.107074 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1015/2040] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:09 2022] DELETE /identity/v3/users/2853821b1f51496f97fa6b694c8136ae => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:10.112411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ce6e-edb0-42a6-9ce6-40aff65ec769 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:10.112902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ce6e-edb0-42a6-9ce6-40aff65ec769 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:10.112982 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ce6e-edb0-42a6-9ce6-40aff65ec769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:10.142232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c425ce6e-edb0-42a6-9ce6-40aff65ec769 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:10.144440 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c425ce6e-edb0-42a6-9ce6-40aff65ec769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:10.310539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1026/2041] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:10.320026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60539a1e-91bf-40ae-913b-ee05a8f885a6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:10.328139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-60539a1e-91bf-40ae-913b-ee05a8f885a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:10.411732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60539a1e-91bf-40ae-913b-ee05a8f885a6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:10.417144 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b9cfa-75c2-4824-8a8b-2e59c3de3df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:10.418061 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b9cfa-75c2-4824-8a8b-2e59c3de3df1 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:10.418347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b9cfa-75c2-4824-8a8b-2e59c3de3df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:10.418849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b9cfa-75c2-4824-8a8b-2e59c3de3df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:10.430376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b9cfa-75c2-4824-8a8b-2e59c3de3df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:10.431941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b9cfa-75c2-4824-8a8b-2e59c3de3df1 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:10.444312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1016/2042] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:11.014615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425ce6e-edb0-42a6-9ce6-40aff65ec769 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:11.015973 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c425ce6e-edb0-42a6-9ce6-40aff65ec769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:11.035353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425ce6e-edb0-42a6-9ce6-40aff65ec769 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:11.042050 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:11.043440 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:11.043900 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:11.045094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] PATH_INFO: `/v3/projects/67ef6dfe81ec4ed7852c602caceb8bc6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:11.046013 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ef6dfe81ec4ed7852c602caceb8bc6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:11.048723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:11.192261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ef6dfe81ec4ed7852c602caceb8bc6', 'request_id': 'req-28b48064-47d7-444e-8b5c-6d1f69c3339f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:11.198522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ef6dfe81ec4ed7852c602caceb8bc6', 'request_id': 'req-28b48064-47d7-444e-8b5c-6d1f69c3339f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:11.205647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ef6dfe81ec4ed7852c602caceb8bc6', 'request_id': 'req-28b48064-47d7-444e-8b5c-6d1f69c3339f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:11.320766 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] The token cache is being invalidate because project 67ef6dfe81ec4ed7852c602caceb8bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:11.321462 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:11.322348 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:11.324327 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1027/2043] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:11 2022] DELETE /identity/v3/projects/67ef6dfe81ec4ed7852c602caceb8bc6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:11.329494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00fa86-df22-4801-8b04-df464d4d6ac6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:11.329994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00fa86-df22-4801-8b04-df464d4d6ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:11.330123 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00fa86-df22-4801-8b04-df464d4d6ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:11.351175 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0d00fa86-df22-4801-8b04-df464d4d6ac6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:11.352686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0d00fa86-df22-4801-8b04-df464d4d6ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:11.356400 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:11.358280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:11.430234 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1017/2044] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:11.439672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb06b6-df87-4d49-b854-48931c9988a1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:11.439966 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb06b6-df87-4d49-b854-48931c9988a1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:11.440102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b48064-47d7-444e-8b5c-6d1f69c3339f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:11.440527 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb06b6-df87-4d49-b854-48931c9988a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:11.445041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027264f-0c6e-40e6-989f-d3226995b8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:11.445980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027264f-0c6e-40e6-989f-d3226995b8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:11.446269 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027264f-0c6e-40e6-989f-d3226995b8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:11.446544 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027264f-0c6e-40e6-989f-d3226995b8bf admin admin] PATH_INFO: `/v3/users/7d43cfe4059f4411884734ca62f14f8c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:11.447765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027264f-0c6e-40e6-989f-d3226995b8bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d43cfe4059f4411884734ca62f14f8c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:11.449781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027264f-0c6e-40e6-989f-d3226995b8bf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:11.459587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-00bb06b6-df87-4d49-b854-48931c9988a1 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:11.460834 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-00bb06b6-df87-4d49-b854-48931c9988a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:11.472273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1018/2045] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:06:11.477779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb06b6-df87-4d49-b854-48931c9988a1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:11.491619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb06b6-df87-4d49-b854-48931c9988a1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:11.496688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238908c-4924-43ed-bef0-0b74f253381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:11.497345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238908c-4924-43ed-bef0-0b74f253381b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:11.497700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238908c-4924-43ed-bef0-0b74f253381b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:11.497977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238908c-4924-43ed-bef0-0b74f253381b admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:11.498725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238908c-4924-43ed-bef0-0b74f253381b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:06:11.499891 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238908c-4924-43ed-bef0-0b74f253381b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:11.501544 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238908c-4924-43ed-bef0-0b74f253381b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:11.513647 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1019/2046] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:06:11.517907 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238908c-4924-43ed-bef0-0b74f253381b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:11.527640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238908c-4924-43ed-bef0-0b74f253381b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:11.532631 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf39941-0c1c-4807-8741-c52d6427fc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:11.533306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39941-0c1c-4807-8741-c52d6427fc3c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:11.533891 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39941-0c1c-4807-8741-c52d6427fc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:11.534172 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39941-0c1c-4807-8741-c52d6427fc3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:11.542527 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf39941-0c1c-4807-8741-c52d6427fc3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:11.542527 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf39941-0c1c-4807-8741-c52d6427fc3c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:11.732353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1020/2047] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:11 2022] POST /identity/v3/projects => generated 361 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:11.733474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf39941-0c1c-4807-8741-c52d6427fc3c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:11.736270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1027264f-0c6e-40e6-989f-d3226995b8bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d43cfe4059f4411884734ca62f14f8c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:11.744521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1027264f-0c6e-40e6-989f-d3226995b8bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d43cfe4059f4411884734ca62f14f8c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:11.797223 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf39941-0c1c-4807-8741-c52d6427fc3c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:11.802589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22140837-9be2-4331-b05d-0169a5945c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:11.803462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22140837-9be2-4331-b05d-0169a5945c71 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:11.804037 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22140837-9be2-4331-b05d-0169a5945c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:11.804228 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22140837-9be2-4331-b05d-0169a5945c71 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:11.804957 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22140837-9be2-4331-b05d-0169a5945c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:11.807051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22140837-9be2-4331-b05d-0169a5945c71 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:11.907249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1027264f-0c6e-40e6-989f-d3226995b8bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d43cfe4059f4411884734ca62f14f8c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:11.907875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1027264f-0c6e-40e6-989f-d3226995b8bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d43cfe4059f4411884734ca62f14f8c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:11.909003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1027264f-0c6e-40e6-989f-d3226995b8bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d43cfe4059f4411884734ca62f14f8c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:11.931988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1028/2048] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:11 2022] DELETE /identity/v3/users/7d43cfe4059f4411884734ca62f14f8c => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:06:11.933697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0e85-6012-46b9-b28a-67dd17a6c62a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:11.934034 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0e85-6012-46b9-b28a-67dd17a6c62a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:11.934369 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0e85-6012-46b9-b28a-67dd17a6c62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:11.955878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-53ef0e85-6012-46b9-b28a-67dd17a6c62a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:11.957336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-53ef0e85-6012-46b9-b28a-67dd17a6c62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:11.996816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1021/2049] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:11 2022] POST /identity/v3/users => generated 281 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:11.997918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22140837-9be2-4331-b05d-0169a5945c71 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:11.999776 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-22140837-9be2-4331-b05d-0169a5945c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:12.012883 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22140837-9be2-4331-b05d-0169a5945c71 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:12.037313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1029/2050] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:06:12.038527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef0e85-6012-46b9-b28a-67dd17a6c62a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:12.040057 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-53ef0e85-6012-46b9-b28a-67dd17a6c62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:12.054067 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef0e85-6012-46b9-b28a-67dd17a6c62a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:12.059717 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f38872-0615-4219-9d77-9f9e1e49cccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:12.060178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f38872-0615-4219-9d77-9f9e1e49cccd admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:12.060524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f38872-0615-4219-9d77-9f9e1e49cccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:12.060873 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f38872-0615-4219-9d77-9f9e1e49cccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:12.061829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f38872-0615-4219-9d77-9f9e1e49cccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:12.063708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f38872-0615-4219-9d77-9f9e1e49cccd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:12.075775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1030/2051] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:12.077616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f38872-0615-4219-9d77-9f9e1e49cccd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:12.079629 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-08f38872-0615-4219-9d77-9f9e1e49cccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:12.094702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f75fe8-a8b7-4014-a1ef-d7be4d737bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:12.096854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f75fe8-a8b7-4014-a1ef-d7be4d737bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:12.097252 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f75fe8-a8b7-4014-a1ef-d7be4d737bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:12.097672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f75fe8-a8b7-4014-a1ef-d7be4d737bba admin admin] PATH_INFO: `/v3/users/b7a2fb33a4604a17bca3cff757fd5506` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:12.099362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f75fe8-a8b7-4014-a1ef-d7be4d737bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a2fb33a4604a17bca3cff757fd5506)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:12.101739 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f75fe8-a8b7-4014-a1ef-d7be4d737bba admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:12.155011 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f38872-0615-4219-9d77-9f9e1e49cccd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:12.159981 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482c7a1-7827-4a1a-bec5-9552f0a840c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:12.160648 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482c7a1-7827-4a1a-bec5-9552f0a840c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:12.160933 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482c7a1-7827-4a1a-bec5-9552f0a840c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:12.161211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482c7a1-7827-4a1a-bec5-9552f0a840c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:12.171001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482c7a1-7827-4a1a-bec5-9552f0a840c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:12.172462 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482c7a1-7827-4a1a-bec5-9552f0a840c4 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:12.184535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1031/2052] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:12.185439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482c7a1-7827-4a1a-bec5-9552f0a840c4 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:12.194600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482c7a1-7827-4a1a-bec5-9552f0a840c4 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:12.199339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980165d0-4a33-44e6-ad61-937f392c1055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:12.200041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980165d0-4a33-44e6-ad61-937f392c1055 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:12.200325 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980165d0-4a33-44e6-ad61-937f392c1055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:12.200602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980165d0-4a33-44e6-ad61-937f392c1055 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:12.201324 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980165d0-4a33-44e6-ad61-937f392c1055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:12.203481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980165d0-4a33-44e6-ad61-937f392c1055 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:12.214276 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1032/2053] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:12.218013 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980165d0-4a33-44e6-ad61-937f392c1055 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:12.228541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980165d0-4a33-44e6-ad61-937f392c1055 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:12.233849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fea0e7-e8fc-4af8-8d52-41e7cf338608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:12.234816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fea0e7-e8fc-4af8-8d52-41e7cf338608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:12.235095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fea0e7-e8fc-4af8-8d52-41e7cf338608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:12.235368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fea0e7-e8fc-4af8-8d52-41e7cf338608 admin admin] PATH_INFO: `/v3/projects/612ed15086764773ba8992311b5cd9de/users/79c1631b036b42c9955eaf939beb389a/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:12.257923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fea0e7-e8fc-4af8-8d52-41e7cf338608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=612ed15086764773ba8992311b5cd9de, user_id=79c1631b036b42c9955eaf939beb389a, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:12.262145 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fea0e7-e8fc-4af8-8d52-41e7cf338608 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:12.431533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1033/2054] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:12 2022] PUT /identity/v3/projects/612ed15086764773ba8992311b5cd9de/users/79c1631b036b42c9955eaf939beb389a/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:06:12.434021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc829-e18a-4ab6-9a78-ed8584d48542 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:12.434532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc829-e18a-4ab6-9a78-ed8584d48542 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:12.435009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc829-e18a-4ab6-9a78-ed8584d48542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:12.437791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a3f75fe8-a8b7-4014-a1ef-d7be4d737bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a2fb33a4604a17bca3cff757fd5506'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:12.464778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b87fc829-e18a-4ab6-9a78-ed8584d48542 None None] MFA Rules not processed for user `79c1631b036b42c9955eaf939beb389a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:12.466729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b87fc829-e18a-4ab6-9a78-ed8584d48542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:12.535024 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a3f75fe8-a8b7-4014-a1ef-d7be4d737bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a2fb33a4604a17bca3cff757fd5506'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:12.544333 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a3f75fe8-a8b7-4014-a1ef-d7be4d737bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a2fb33a4604a17bca3cff757fd5506'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:12.545037 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a3f75fe8-a8b7-4014-a1ef-d7be4d737bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a2fb33a4604a17bca3cff757fd5506'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:12.545689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-a3f75fe8-a8b7-4014-a1ef-d7be4d737bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a2fb33a4604a17bca3cff757fd5506'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:12.545972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1034/2055] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:12.584885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1022/2056] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:11 2022] DELETE /identity/v3/users/b7a2fb33a4604a17bca3cff757fd5506 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:12.591218 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f93f3-2f06-4c38-a33a-e2194ede206f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:12.591487 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f75fe8-a8b7-4014-a1ef-d7be4d737bba admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:12.591619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f93f3-2f06-4c38-a33a-e2194ede206f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:12.591913 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f93f3-2f06-4c38-a33a-e2194ede206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:12.593020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a3f75fe8-a8b7-4014-a1ef-d7be4d737bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:12.612319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4c9f93f3-2f06-4c38-a33a-e2194ede206f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:12.613560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4c9f93f3-2f06-4c38-a33a-e2194ede206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:12.661821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f75fe8-a8b7-4014-a1ef-d7be4d737bba admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:12.666651 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bd230-c31b-4f30-9082-897271912d80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:12.667663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bd230-c31b-4f30-9082-897271912d80 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:12.668153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bd230-c31b-4f30-9082-897271912d80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:12.668680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431bd230-c31b-4f30-9082-897271912d80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:12.670845 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-431bd230-c31b-4f30-9082-897271912d80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:12.698028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1035/2057] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:12.710626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f93f3-2f06-4c38-a33a-e2194ede206f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:12.713447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4c9f93f3-2f06-4c38-a33a-e2194ede206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:12.758816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bd230-c31b-4f30-9082-897271912d80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:12.760353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431bd230-c31b-4f30-9082-897271912d80 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:12.770944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1023/2058] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:06:12.786078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bd230-c31b-4f30-9082-897271912d80 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:12.787533 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-431bd230-c31b-4f30-9082-897271912d80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:12.793597 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f93f3-2f06-4c38-a33a-e2194ede206f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:12.798127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55944a91-802f-4cfc-9fcd-28bff64487e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:12.798823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944a91-802f-4cfc-9fcd-28bff64487e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:12.799105 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944a91-802f-4cfc-9fcd-28bff64487e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:12.799384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55944a91-802f-4cfc-9fcd-28bff64487e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:12.802510 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431bd230-c31b-4f30-9082-897271912d80 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:12.807530 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687f0e3-f3d4-4b11-a9e3-fbbf80616d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:12.808020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687f0e3-f3d4-4b11-a9e3-fbbf80616d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:12.808312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687f0e3-f3d4-4b11-a9e3-fbbf80616d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:12.808589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687f0e3-f3d4-4b11-a9e3-fbbf80616d57 admin admin] PATH_INFO: `/v3/users/79c1631b036b42c9955eaf939beb389a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:12.809122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55944a91-802f-4cfc-9fcd-28bff64487e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:12.809993 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687f0e3-f3d4-4b11-a9e3-fbbf80616d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c1631b036b42c9955eaf939beb389a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:12.810830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55944a91-802f-4cfc-9fcd-28bff64487e6 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:12.812478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687f0e3-f3d4-4b11-a9e3-fbbf80616d57 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:12.822812 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1036/2059] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:13.044518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6687f0e3-f3d4-4b11-a9e3-fbbf80616d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c1631b036b42c9955eaf939beb389a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:13.137981 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6687f0e3-f3d4-4b11-a9e3-fbbf80616d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c1631b036b42c9955eaf939beb389a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:13.147195 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6687f0e3-f3d4-4b11-a9e3-fbbf80616d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c1631b036b42c9955eaf939beb389a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:13.148094 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6687f0e3-f3d4-4b11-a9e3-fbbf80616d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c1631b036b42c9955eaf939beb389a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:13.149152 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6687f0e3-f3d4-4b11-a9e3-fbbf80616d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c1631b036b42c9955eaf939beb389a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:13.172169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1024/2060] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:12 2022] DELETE /identity/v3/users/79c1631b036b42c9955eaf939beb389a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:06:13.174269 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32b853-03b9-426a-8c6a-db846bc0b087 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:13.174558 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32b853-03b9-426a-8c6a-db846bc0b087 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:13.174838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32b853-03b9-426a-8c6a-db846bc0b087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:13.195128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4c32b853-03b9-426a-8c6a-db846bc0b087 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:13.196607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4c32b853-03b9-426a-8c6a-db846bc0b087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:13.259413 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1037/2061] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:13.269200 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687f0e3-f3d4-4b11-a9e3-fbbf80616d57 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:13.270947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6687f0e3-f3d4-4b11-a9e3-fbbf80616d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:13.313928 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32b853-03b9-426a-8c6a-db846bc0b087 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:13.320819 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4c32b853-03b9-426a-8c6a-db846bc0b087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:13.343403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687f0e3-f3d4-4b11-a9e3-fbbf80616d57 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:13.343888 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32b853-03b9-426a-8c6a-db846bc0b087 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:13.353649 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d399-9a51-4078-b030-ce82a9d24b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:13.362014 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d399-9a51-4078-b030-ce82a9d24b2b service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:13.362014 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d399-9a51-4078-b030-ce82a9d24b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:13.362014 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d399-9a51-4078-b030-ce82a9d24b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:13.367037 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d399-9a51-4078-b030-ce82a9d24b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:13.368638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d399-9a51-4078-b030-ce82a9d24b2b service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:13.373421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26868138-d477-4eb7-ae55-d16a1173186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:13.374879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26868138-d477-4eb7-ae55-d16a1173186b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:13.375177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26868138-d477-4eb7-ae55-d16a1173186b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:13.375741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26868138-d477-4eb7-ae55-d16a1173186b admin admin] PATH_INFO: `/v3/projects/4ef1b89918214facac105e73d7a5e275` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:13.378583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26868138-d477-4eb7-ae55-d16a1173186b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef1b89918214facac105e73d7a5e275)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:13.381463 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26868138-d477-4eb7-ae55-d16a1173186b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:13.388431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1025/2062] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:13.577592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-26868138-d477-4eb7-ae55-d16a1173186b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef1b89918214facac105e73d7a5e275', 'request_id': 'req-26868138-d477-4eb7-ae55-d16a1173186b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:13.584231 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-26868138-d477-4eb7-ae55-d16a1173186b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef1b89918214facac105e73d7a5e275', 'request_id': 'req-26868138-d477-4eb7-ae55-d16a1173186b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:13.591079 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-26868138-d477-4eb7-ae55-d16a1173186b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef1b89918214facac105e73d7a5e275', 'request_id': 'req-26868138-d477-4eb7-ae55-d16a1173186b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:13.692089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-26868138-d477-4eb7-ae55-d16a1173186b admin admin] The token cache is being invalidate because project 4ef1b89918214facac105e73d7a5e275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:13.692459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-26868138-d477-4eb7-ae55-d16a1173186b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:13.693240 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-26868138-d477-4eb7-ae55-d16a1173186b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:13.697225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d399-9a51-4078-b030-ce82a9d24b2b service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:13.700917 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1038/2063] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:13 2022] DELETE /identity/v3/projects/4ef1b89918214facac105e73d7a5e275 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:13.701017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6a16d399-9a51-4078-b030-ce82a9d24b2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:13.703553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc596ad-a6eb-4911-ac72-58f9d3efb2f6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:13.703874 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc596ad-a6eb-4911-ac72-58f9d3efb2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:13.704158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc596ad-a6eb-4911-ac72-58f9d3efb2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:13.713961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d399-9a51-4078-b030-ce82a9d24b2b service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:13.738882 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-abc596ad-a6eb-4911-ac72-58f9d3efb2f6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:13.740861 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-abc596ad-a6eb-4911-ac72-58f9d3efb2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:13.808225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:13.809103 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:13.809379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:13.809854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] PATH_INFO: `/v3/projects/19b9760db57f4145b127f10ef76196ef` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:13.811017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b9760db57f4145b127f10ef76196ef)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:13.818744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1039/2064] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:13.818932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:13.820621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660ac4b-618b-4aaf-b524-23b7dccb3222 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:13.821062 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660ac4b-618b-4aaf-b524-23b7dccb3222 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:13.821360 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660ac4b-618b-4aaf-b524-23b7dccb3222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:13.857169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5660ac4b-618b-4aaf-b524-23b7dccb3222 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:13.859577 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5660ac4b-618b-4aaf-b524-23b7dccb3222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:13.869573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1040/2065] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:13.873088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660ac4b-618b-4aaf-b524-23b7dccb3222 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:13.883820 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660ac4b-618b-4aaf-b524-23b7dccb3222 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:13.891670 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f941519-67a0-4748-8385-7c7338c54757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:13.892494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f941519-67a0-4748-8385-7c7338c54757 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:13.892785 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f941519-67a0-4748-8385-7c7338c54757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:13.894035 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f941519-67a0-4748-8385-7c7338c54757 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:13.894035 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f941519-67a0-4748-8385-7c7338c54757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:06:13.894358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f941519-67a0-4748-8385-7c7338c54757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:13.896568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f941519-67a0-4748-8385-7c7338c54757 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:13.910611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1041/2066] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:06:13.914920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f941519-67a0-4748-8385-7c7338c54757 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:13.945759 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f941519-67a0-4748-8385-7c7338c54757 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:13.962010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea03ad-ba17-4228-a8b9-2c751e0a93bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:13.963054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea03ad-ba17-4228-a8b9-2c751e0a93bf admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:13.965194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea03ad-ba17-4228-a8b9-2c751e0a93bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:13.967030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea03ad-ba17-4228-a8b9-2c751e0a93bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:13.968613 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea03ad-ba17-4228-a8b9-2c751e0a93bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:13.972382 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea03ad-ba17-4228-a8b9-2c751e0a93bf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:14.004788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b9760db57f4145b127f10ef76196ef', 'request_id': 'req-f7bdbb02-ba70-461f-9b3d-391c9572b412'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:14.013793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b9760db57f4145b127f10ef76196ef', 'request_id': 'req-f7bdbb02-ba70-461f-9b3d-391c9572b412'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:14.021362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b9760db57f4145b127f10ef76196ef', 'request_id': 'req-f7bdbb02-ba70-461f-9b3d-391c9572b412'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:14.094572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1042/2067] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:13 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:14.096317 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea03ad-ba17-4228-a8b9-2c751e0a93bf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:14.102921 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-54ea03ad-ba17-4228-a8b9-2c751e0a93bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:14.126215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] The token cache is being invalidate because project 19b9760db57f4145b127f10ef76196ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:14.126747 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:14.128672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:14.132906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1026/2068] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:13 2022] DELETE /identity/v3/projects/19b9760db57f4145b127f10ef76196ef => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:06:14.134193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:14.137773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:14.242765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea03ad-ba17-4228-a8b9-2c751e0a93bf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:14.253640 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f5971-119d-4a60-b3e8-a128ee0940b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:14.254522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f5971-119d-4a60-b3e8-a128ee0940b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:14.254804 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f5971-119d-4a60-b3e8-a128ee0940b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:14.255078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f5971-119d-4a60-b3e8-a128ee0940b8 admin admin] PATH_INFO: `/v3/users/81f7b0467e004b32add6caf0f8d5ccbc` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:14.257046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f5971-119d-4a60-b3e8-a128ee0940b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81f7b0467e004b32add6caf0f8d5ccbc)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:14.260524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632f5971-119d-4a60-b3e8-a128ee0940b8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:14.278842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdbb02-ba70-461f-9b3d-391c9572b412 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:14.285999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6006af-25ff-4a35-8598-9ad6e962184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:14.287511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6006af-25ff-4a35-8598-9ad6e962184b admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:14.288432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6006af-25ff-4a35-8598-9ad6e962184b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:14.289026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6006af-25ff-4a35-8598-9ad6e962184b admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:14.290047 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6006af-25ff-4a35-8598-9ad6e962184b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:14.292280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6006af-25ff-4a35-8598-9ad6e962184b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:14.830080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1027/2069] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:14 2022] POST /identity/v3/users => generated 286 bytes in 696 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:14.831535 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6006af-25ff-4a35-8598-9ad6e962184b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:14.833276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ea6006af-25ff-4a35-8598-9ad6e962184b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:14.847890 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6006af-25ff-4a35-8598-9ad6e962184b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:14.852427 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7cde3-a5da-4cd6-a4ce-c1b754976939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:14.853366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7cde3-a5da-4cd6-a4ce-c1b754976939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:14.853700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7cde3-a5da-4cd6-a4ce-c1b754976939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:14.853979 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7cde3-a5da-4cd6-a4ce-c1b754976939 admin admin] PATH_INFO: `/v3/users/01cbb5392e62439ca8ac40198991fde9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:14.855159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7cde3-a5da-4cd6-a4ce-c1b754976939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01cbb5392e62439ca8ac40198991fde9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:14.857146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a7cde3-a5da-4cd6-a4ce-c1b754976939 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:14.912725 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-632f5971-119d-4a60-b3e8-a128ee0940b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81f7b0467e004b32add6caf0f8d5ccbc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:14.922130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-632f5971-119d-4a60-b3e8-a128ee0940b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81f7b0467e004b32add6caf0f8d5ccbc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:14.991729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-632f5971-119d-4a60-b3e8-a128ee0940b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81f7b0467e004b32add6caf0f8d5ccbc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:14.992347 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-632f5971-119d-4a60-b3e8-a128ee0940b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81f7b0467e004b32add6caf0f8d5ccbc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:14.993004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-632f5971-119d-4a60-b3e8-a128ee0940b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81f7b0467e004b32add6caf0f8d5ccbc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:15.016382 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1043/2070] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:14 2022] DELETE /identity/v3/users/81f7b0467e004b32add6caf0f8d5ccbc => generated 0 bytes in 921 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:15.018172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f5971-119d-4a60-b3e8-a128ee0940b8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:15.019150 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-632f5971-119d-4a60-b3e8-a128ee0940b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:15.034351 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f1a7cde3-a5da-4cd6-a4ce-c1b754976939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01cbb5392e62439ca8ac40198991fde9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:15.087988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f5971-119d-4a60-b3e8-a128ee0940b8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:15.092642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7728b-5d6d-4ce1-a75e-ad032ee357b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:15.093892 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7728b-5d6d-4ce1-a75e-ad032ee357b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:15.094178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7728b-5d6d-4ce1-a75e-ad032ee357b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:15.094458 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7728b-5d6d-4ce1-a75e-ad032ee357b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:15.095187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7728b-5d6d-4ce1-a75e-ad032ee357b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:15.096790 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7728b-5d6d-4ce1-a75e-ad032ee357b1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:15.106594 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1044/2071] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:15.107378 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7728b-5d6d-4ce1-a75e-ad032ee357b1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:15.109712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-93a7728b-5d6d-4ce1-a75e-ad032ee357b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:15.111599 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f1a7cde3-a5da-4cd6-a4ce-c1b754976939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01cbb5392e62439ca8ac40198991fde9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:15.119193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f1a7cde3-a5da-4cd6-a4ce-c1b754976939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01cbb5392e62439ca8ac40198991fde9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:15.119882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f1a7cde3-a5da-4cd6-a4ce-c1b754976939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01cbb5392e62439ca8ac40198991fde9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:15.121134 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f1a7cde3-a5da-4cd6-a4ce-c1b754976939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01cbb5392e62439ca8ac40198991fde9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:15.121735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7728b-5d6d-4ce1-a75e-ad032ee357b1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:15.130215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:15.131211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:15.131621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:15.131906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] PATH_INFO: `/v3/projects/612ed15086764773ba8992311b5cd9de` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:15.133119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=612ed15086764773ba8992311b5cd9de)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:15.135122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:15.143419 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1028/2072] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:14 2022] DELETE /identity/v3/users/01cbb5392e62439ca8ac40198991fde9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:15.149720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b86d4-6e07-494f-ba7a-2f889d54026a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:15.149720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b86d4-6e07-494f-ba7a-2f889d54026a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:15.149720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b86d4-6e07-494f-ba7a-2f889d54026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:15.168238 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-394b86d4-6e07-494f-ba7a-2f889d54026a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:15.169761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-394b86d4-6e07-494f-ba7a-2f889d54026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:15.230658 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1029/2073] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:15.231322 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b86d4-6e07-494f-ba7a-2f889d54026a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:15.232660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-394b86d4-6e07-494f-ba7a-2f889d54026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:15.245229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b86d4-6e07-494f-ba7a-2f889d54026a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:15.250144 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab2dd6-741b-49ad-91a1-3c68797e1528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:15.250808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab2dd6-741b-49ad-91a1-3c68797e1528 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:15.251093 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab2dd6-741b-49ad-91a1-3c68797e1528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:15.251373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab2dd6-741b-49ad-91a1-3c68797e1528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:15.252105 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab2dd6-741b-49ad-91a1-3c68797e1528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:15.253849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab2dd6-741b-49ad-91a1-3c68797e1528 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:15.272934 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1030/2074] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:15.272934 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab2dd6-741b-49ad-91a1-3c68797e1528 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:15.274635 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b6ab2dd6-741b-49ad-91a1-3c68797e1528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:15.291370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '612ed15086764773ba8992311b5cd9de', 'request_id': 'req-080e3216-209d-43d0-96cd-49ba816c60bc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:15.301402 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '612ed15086764773ba8992311b5cd9de', 'request_id': 'req-080e3216-209d-43d0-96cd-49ba816c60bc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:15.309087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '612ed15086764773ba8992311b5cd9de', 'request_id': 'req-080e3216-209d-43d0-96cd-49ba816c60bc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:15.336230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab2dd6-741b-49ad-91a1-3c68797e1528 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:15.383404 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9d07e-a3b9-4aac-8bb7-3adf7ac8a1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:15.384059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9d07e-a3b9-4aac-8bb7-3adf7ac8a1ee service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:15.384344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9d07e-a3b9-4aac-8bb7-3adf7ac8a1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:15.384645 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9d07e-a3b9-4aac-8bb7-3adf7ac8a1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:15.392311 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] The token cache is being invalidate because project 612ed15086764773ba8992311b5cd9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:15.394110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:15.394110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:15.394953 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1045/2075] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:15 2022] DELETE /identity/v3/projects/612ed15086764773ba8992311b5cd9de => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:15.396386 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:15.397769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:15.455740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9d07e-a3b9-4aac-8bb7-3adf7ac8a1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:15.457445 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9d07e-a3b9-4aac-8bb7-3adf7ac8a1ee service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:15.463962 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3216-209d-43d0-96cd-49ba816c60bc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:15.469799 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1031/2076] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:15.470909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f67c38-143f-4411-a6ab-d9124f4200b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:15.471761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f4485-02db-40ba-aaf8-ecf933a0c842 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:15.472021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67c38-143f-4411-a6ab-d9124f4200b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:15.472384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f4485-02db-40ba-aaf8-ecf933a0c842 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:15.472626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67c38-143f-4411-a6ab-d9124f4200b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:15.473023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67c38-143f-4411-a6ab-d9124f4200b2 admin admin] PATH_INFO: `/v3/projects/98ca4d11f5b5459a93b0f97cbfcdc3a2/users/74d61067c8034b6cb80bec103bc404a0/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:15.473155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f4485-02db-40ba-aaf8-ecf933a0c842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:15.493427 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-286f4485-02db-40ba-aaf8-ecf933a0c842 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:15.494766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-286f4485-02db-40ba-aaf8-ecf933a0c842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:15.494890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f67c38-143f-4411-a6ab-d9124f4200b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ca4d11f5b5459a93b0f97cbfcdc3a2, user_id=74d61067c8034b6cb80bec103bc404a0, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:15.498262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f67c38-143f-4411-a6ab-d9124f4200b2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:15.510508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1032/2077] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:15.512231 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0cc18-840c-40d9-86e1-c971382cf051 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:15.512530 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0cc18-840c-40d9-86e1-c971382cf051 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:15.512813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0cc18-840c-40d9-86e1-c971382cf051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:15.534612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3fd0cc18-840c-40d9-86e1-c971382cf051 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:15.535856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3fd0cc18-840c-40d9-86e1-c971382cf051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:15.544723 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1033/2078] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:15.549195 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0cc18-840c-40d9-86e1-c971382cf051 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:15.568730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0cc18-840c-40d9-86e1-c971382cf051 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:15.573622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fad7e-2e59-4bc7-85b8-d1ba8a1c51f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:15.579145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fad7e-2e59-4bc7-85b8-d1ba8a1c51f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:15.579145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fad7e-2e59-4bc7-85b8-d1ba8a1c51f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:15.579145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fad7e-2e59-4bc7-85b8-d1ba8a1c51f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:15.579145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fad7e-2e59-4bc7-85b8-d1ba8a1c51f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:06:15.579145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fad7e-2e59-4bc7-85b8-d1ba8a1c51f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:15.579145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fad7e-2e59-4bc7-85b8-d1ba8a1c51f1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:15.591493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1034/2079] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:06:15.596863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fad7e-2e59-4bc7-85b8-d1ba8a1c51f1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:15.612602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1046/2080] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:15 2022] PUT /identity/v3/projects/98ca4d11f5b5459a93b0f97cbfcdc3a2/users/74d61067c8034b6cb80bec103bc404a0/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:15.612801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fad7e-2e59-4bc7-85b8-d1ba8a1c51f1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:15.617458 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3cb77-0c92-451c-99b2-44149f66c62f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:15.618011 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3cb77-0c92-451c-99b2-44149f66c62f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:15.618537 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3cb77-0c92-451c-99b2-44149f66c62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:15.643896 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4ad3cb77-0c92-451c-99b2-44149f66c62f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:15.647813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4ad3cb77-0c92-451c-99b2-44149f66c62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:15.702764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade61e30-9cd3-427d-ba01-1f11e6be046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:15.703530 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade61e30-9cd3-427d-ba01-1f11e6be046a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:15.703886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade61e30-9cd3-427d-ba01-1f11e6be046a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:15.704391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade61e30-9cd3-427d-ba01-1f11e6be046a admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:15.705164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade61e30-9cd3-427d-ba01-1f11e6be046a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:15.707160 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade61e30-9cd3-427d-ba01-1f11e6be046a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:15.729126 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1047/2081] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:15.742907 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3cb77-0c92-451c-99b2-44149f66c62f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:15.744936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4ad3cb77-0c92-451c-99b2-44149f66c62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:15.811015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3cb77-0c92-451c-99b2-44149f66c62f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:15.816775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9f490-7a81-4c1d-aa09-79f554e13630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:15.816775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9f490-7a81-4c1d-aa09-79f554e13630 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:15.816775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9f490-7a81-4c1d-aa09-79f554e13630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:15.816775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9f490-7a81-4c1d-aa09-79f554e13630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:15.829391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9f490-7a81-4c1d-aa09-79f554e13630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:15.831455 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9f490-7a81-4c1d-aa09-79f554e13630 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:15.850139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1048/2082] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:06:15.850139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9f490-7a81-4c1d-aa09-79f554e13630 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:15.850139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fea9f490-7a81-4c1d-aa09-79f554e13630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:15.851323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1035/2083] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:15 2022] POST /identity/v3/projects => generated 399 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:15.855203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade61e30-9cd3-427d-ba01-1f11e6be046a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:15.872361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9f490-7a81-4c1d-aa09-79f554e13630 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:15.939529 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade61e30-9cd3-427d-ba01-1f11e6be046a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:15.947730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0fa5f-489c-47dc-9bc5-20ac0d64ad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:15.948411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0fa5f-489c-47dc-9bc5-20ac0d64ad1a admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:15.948690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0fa5f-489c-47dc-9bc5-20ac0d64ad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:15.948962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0fa5f-489c-47dc-9bc5-20ac0d64ad1a admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:15.950442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0fa5f-489c-47dc-9bc5-20ac0d64ad1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:15.953402 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0fa5f-489c-47dc-9bc5-20ac0d64ad1a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:15.979643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:15.980515 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:15.980929 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:15.981213 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] PATH_INFO: `/v3/projects/08b08ac26a3a4834b90ed43f0e30d06e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:15.982512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b08ac26a3a4834b90ed43f0e30d06e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:15.985028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:16.053563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1036/2084] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:15 2022] POST /identity/v3/users => generated 300 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:16.057467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0fa5f-489c-47dc-9bc5-20ac0d64ad1a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:16.067655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0fa5f-489c-47dc-9bc5-20ac0d64ad1a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:16.072635 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b470c-e40e-48f9-a3d0-513ccc00223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:16.073333 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b470c-e40e-48f9-a3d0-513ccc00223c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:16.073652 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b470c-e40e-48f9-a3d0-513ccc00223c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:16.073954 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b470c-e40e-48f9-a3d0-513ccc00223c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:16.074677 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b470c-e40e-48f9-a3d0-513ccc00223c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:16.076678 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b470c-e40e-48f9-a3d0-513ccc00223c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:16.096028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1037/2085] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:06:16.096028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b470c-e40e-48f9-a3d0-513ccc00223c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:16.101682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b470c-e40e-48f9-a3d0-513ccc00223c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:16.106526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4731e38-a5f3-466f-b67b-bf1c82f8672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:16.107293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4731e38-a5f3-466f-b67b-bf1c82f8672b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:16.107584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4731e38-a5f3-466f-b67b-bf1c82f8672b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:16.107859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4731e38-a5f3-466f-b67b-bf1c82f8672b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:16.109094 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4731e38-a5f3-466f-b67b-bf1c82f8672b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:16.110711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4731e38-a5f3-466f-b67b-bf1c82f8672b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:16.140517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1038/2086] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:06:16.141476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4731e38-a5f3-466f-b67b-bf1c82f8672b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:16.143876 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b4731e38-a5f3-466f-b67b-bf1c82f8672b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:16.153068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b08ac26a3a4834b90ed43f0e30d06e', 'request_id': 'req-6a766b9d-c55f-41ca-82db-ec7b1445a610'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.161642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b08ac26a3a4834b90ed43f0e30d06e', 'request_id': 'req-6a766b9d-c55f-41ca-82db-ec7b1445a610'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.168368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4731e38-a5f3-466f-b67b-bf1c82f8672b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:16.168564 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b08ac26a3a4834b90ed43f0e30d06e', 'request_id': 'req-6a766b9d-c55f-41ca-82db-ec7b1445a610'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.224719 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e55dd-8450-45e8-80c4-6785e008eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:16.225611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e55dd-8450-45e8-80c4-6785e008eb1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:16.225899 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e55dd-8450-45e8-80c4-6785e008eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:16.226172 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e55dd-8450-45e8-80c4-6785e008eb1b admin admin] PATH_INFO: `/v3/projects/becf69a081a94daab8520756bf063386` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:16.227380 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e55dd-8450-45e8-80c4-6785e008eb1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=becf69a081a94daab8520756bf063386)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:16.229299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e55dd-8450-45e8-80c4-6785e008eb1b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:16.330502 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] The token cache is being invalidate because project 08b08ac26a3a4834b90ed43f0e30d06e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:16.336645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.336645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.336645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1049/2087] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:15 2022] DELETE /identity/v3/projects/08b08ac26a3a4834b90ed43f0e30d06e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:16.336645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:16.338961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:16.346145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-625e55dd-8450-45e8-80c4-6785e008eb1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'becf69a081a94daab8520756bf063386', 'request_id': 'req-625e55dd-8450-45e8-80c4-6785e008eb1b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.353557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-625e55dd-8450-45e8-80c4-6785e008eb1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'becf69a081a94daab8520756bf063386', 'request_id': 'req-625e55dd-8450-45e8-80c4-6785e008eb1b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.361323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-625e55dd-8450-45e8-80c4-6785e008eb1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'becf69a081a94daab8520756bf063386', 'request_id': 'req-625e55dd-8450-45e8-80c4-6785e008eb1b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.366782 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a766b9d-c55f-41ca-82db-ec7b1445a610 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:16.437837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec66ec-0399-4917-be6b-af422bedf635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:16.438738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec66ec-0399-4917-be6b-af422bedf635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:16.439017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec66ec-0399-4917-be6b-af422bedf635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:16.439287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec66ec-0399-4917-be6b-af422bedf635 admin admin] PATH_INFO: `/v3/projects/d7b3eba7595a4108b4edaaa04cf47e85/users/64e0c4cb49fb4c8f8c0b9c0c13d4b261/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:16.453924 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec66ec-0399-4917-be6b-af422bedf635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b3eba7595a4108b4edaaa04cf47e85, user_id=64e0c4cb49fb4c8f8c0b9c0c13d4b261, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:16.456727 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec66ec-0399-4917-be6b-af422bedf635 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:16.461282 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-625e55dd-8450-45e8-80c4-6785e008eb1b admin admin] The token cache is being invalidate because project becf69a081a94daab8520756bf063386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:16.462831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-625e55dd-8450-45e8-80c4-6785e008eb1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.462831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-625e55dd-8450-45e8-80c4-6785e008eb1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.463962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1039/2088] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:16 2022] DELETE /identity/v3/projects/becf69a081a94daab8520756bf063386 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:16.465226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2642ff6-f36a-44c0-8de0-0a053e4bce24 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:16.465514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2642ff6-f36a-44c0-8de0-0a053e4bce24 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:16.465816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2642ff6-f36a-44c0-8de0-0a053e4bce24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:16.485150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d2642ff6-f36a-44c0-8de0-0a053e4bce24 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:16.486399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d2642ff6-f36a-44c0-8de0-0a053e4bce24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:16.503459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1040/2089] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:16.503459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2642ff6-f36a-44c0-8de0-0a053e4bce24 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:16.503459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d2642ff6-f36a-44c0-8de0-0a053e4bce24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:16.508513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2642ff6-f36a-44c0-8de0-0a053e4bce24 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:16.513422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e988f0-9a7d-49d7-ae13-5959bb2cb356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:16.514327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e988f0-9a7d-49d7-ae13-5959bb2cb356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:16.514642 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e988f0-9a7d-49d7-ae13-5959bb2cb356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:16.514920 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e988f0-9a7d-49d7-ae13-5959bb2cb356 admin admin] PATH_INFO: `/v3/users/e98a6a51e43b4517b5f119d84c9db54b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:16.516131 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e988f0-9a7d-49d7-ae13-5959bb2cb356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e98a6a51e43b4517b5f119d84c9db54b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:16.518269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e988f0-9a7d-49d7-ae13-5959bb2cb356 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:16.558007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1050/2090] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:16 2022] PUT /identity/v3/projects/d7b3eba7595a4108b4edaaa04cf47e85/users/64e0c4cb49fb4c8f8c0b9c0c13d4b261/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:16.559960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c991-a0b6-455b-abdf-18b81407e9ef None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:16.560251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c991-a0b6-455b-abdf-18b81407e9ef None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:16.560532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c991-a0b6-455b-abdf-18b81407e9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:16.578130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-86c8c991-a0b6-455b-abdf-18b81407e9ef None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:16.579375 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-86c8c991-a0b6-455b-abdf-18b81407e9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:16.638608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1051/2091] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:16.640344 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32225eb0-f23d-4f6a-9ada-7efd1dc4316d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:16.640635 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32225eb0-f23d-4f6a-9ada-7efd1dc4316d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:16.640908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32225eb0-f23d-4f6a-9ada-7efd1dc4316d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:16.674375 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-32225eb0-f23d-4f6a-9ada-7efd1dc4316d None None] MFA Rules not processed for user `64e0c4cb49fb4c8f8c0b9c0c13d4b261`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:16.676140 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-32225eb0-f23d-4f6a-9ada-7efd1dc4316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:16.745925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1052/2092] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:16.746772 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32225eb0-f23d-4f6a-9ada-7efd1dc4316d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:16.759129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-76e988f0-9a7d-49d7-ae13-5959bb2cb356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e98a6a51e43b4517b5f119d84c9db54b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.759343 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32225eb0-f23d-4f6a-9ada-7efd1dc4316d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:16.763955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc8859-a877-4e72-a652-275a5e48f1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:16.764659 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc8859-a877-4e72-a652-275a5e48f1ac admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:16.764945 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc8859-a877-4e72-a652-275a5e48f1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:16.765241 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc8859-a877-4e72-a652-275a5e48f1ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:16.765969 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc8859-a877-4e72-a652-275a5e48f1ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:06:16.766279 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc8859-a877-4e72-a652-275a5e48f1ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:16.767872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc8859-a877-4e72-a652-275a5e48f1ac admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:16.779643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1053/2093] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:06:16.784991 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc8859-a877-4e72-a652-275a5e48f1ac admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:16.784991 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eadc8859-a877-4e72-a652-275a5e48f1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:16.829892 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-76e988f0-9a7d-49d7-ae13-5959bb2cb356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e98a6a51e43b4517b5f119d84c9db54b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.838179 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-76e988f0-9a7d-49d7-ae13-5959bb2cb356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e98a6a51e43b4517b5f119d84c9db54b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.840614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-76e988f0-9a7d-49d7-ae13-5959bb2cb356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e98a6a51e43b4517b5f119d84c9db54b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.840730 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc8859-a877-4e72-a652-275a5e48f1ac admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:16.844534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-76e988f0-9a7d-49d7-ae13-5959bb2cb356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e98a6a51e43b4517b5f119d84c9db54b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:16.848898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413bc36-256c-4429-95e6-e75bbc16f0b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:16.849598 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413bc36-256c-4429-95e6-e75bbc16f0b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:16.849903 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413bc36-256c-4429-95e6-e75bbc16f0b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:16.850161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413bc36-256c-4429-95e6-e75bbc16f0b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:16.852712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a413bc36-256c-4429-95e6-e75bbc16f0b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:16.866192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413bc36-256c-4429-95e6-e75bbc16f0b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:16.866684 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1041/2094] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:16 2022] DELETE /identity/v3/users/e98a6a51e43b4517b5f119d84c9db54b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:16.868617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413bc36-256c-4429-95e6-e75bbc16f0b8 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:16.870535 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e988f0-9a7d-49d7-ae13-5959bb2cb356 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:16.871954 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-76e988f0-9a7d-49d7-ae13-5959bb2cb356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:16.879841 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1054/2095] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:16.961501 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e988f0-9a7d-49d7-ae13-5959bb2cb356 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:16.967450 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b6163-6b9c-456f-9848-769a620546b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:16.968596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b6163-6b9c-456f-9848-769a620546b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:16.969040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b6163-6b9c-456f-9848-769a620546b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:16.969324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b6163-6b9c-456f-9848-769a620546b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:16.970063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b6163-6b9c-456f-9848-769a620546b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:16.972063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b6163-6b9c-456f-9848-769a620546b9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:17.112035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1042/2096] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:16 2022] POST /identity/v3/projects => generated 371 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:17.116256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413bc36-256c-4429-95e6-e75bbc16f0b8 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:17.137456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413bc36-256c-4429-95e6-e75bbc16f0b8 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:17.212547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82355060-7197-42c6-84d7-d81be7f19050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:17.219621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82355060-7197-42c6-84d7-d81be7f19050 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:17.219798 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82355060-7197-42c6-84d7-d81be7f19050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:17.220071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82355060-7197-42c6-84d7-d81be7f19050 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:17.220961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82355060-7197-42c6-84d7-d81be7f19050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:17.223072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82355060-7197-42c6-84d7-d81be7f19050 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:17.331036 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1055/2097] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:17 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:17.332272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b6163-6b9c-456f-9848-769a620546b9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:17.344478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b6163-6b9c-456f-9848-769a620546b9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:17.349444 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1f68e-9994-4993-a410-fdf2a8b3ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:17.350202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1f68e-9994-4993-a410-fdf2a8b3ca45 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:17.350562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1f68e-9994-4993-a410-fdf2a8b3ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:17.350849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1f68e-9994-4993-a410-fdf2a8b3ca45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:17.351582 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1f68e-9994-4993-a410-fdf2a8b3ca45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:17.353349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1f68e-9994-4993-a410-fdf2a8b3ca45 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:17.365173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1043/2098] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:17.368980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82355060-7197-42c6-84d7-d81be7f19050 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:17.379192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82355060-7197-42c6-84d7-d81be7f19050 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:17.384038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea53cef-3d05-48d6-ad75-8f8d223a7ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:17.386526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea53cef-3d05-48d6-ad75-8f8d223a7ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:17.386526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea53cef-3d05-48d6-ad75-8f8d223a7ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:17.386526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea53cef-3d05-48d6-ad75-8f8d223a7ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:17.386526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea53cef-3d05-48d6-ad75-8f8d223a7ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:17.387834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea53cef-3d05-48d6-ad75-8f8d223a7ff6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:17.401765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1056/2099] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:17.406063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1f68e-9994-4993-a410-fdf2a8b3ca45 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:17.415991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1f68e-9994-4993-a410-fdf2a8b3ca45 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:17.420666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01ce2a-947a-42fb-b62d-62859c36dd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:17.421786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ce2a-947a-42fb-b62d-62859c36dd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:17.422076 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ce2a-947a-42fb-b62d-62859c36dd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:17.422386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ce2a-947a-42fb-b62d-62859c36dd07 admin admin] PATH_INFO: `/v3/projects/051fad711fc84488b9476c577bb0717d/users/b1d05c823fba4b458db0bbcc02dee146/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:17.437378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01ce2a-947a-42fb-b62d-62859c36dd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051fad711fc84488b9476c577bb0717d, user_id=b1d05c823fba4b458db0bbcc02dee146, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:17.440128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a01ce2a-947a-42fb-b62d-62859c36dd07 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:17.482542 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bd80e-bf31-4f4b-befc-6ff6b88ea483 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:17.482833 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bd80e-bf31-4f4b-befc-6ff6b88ea483 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:17.483114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03bd80e-bf31-4f4b-befc-6ff6b88ea483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:17.509992 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a03bd80e-bf31-4f4b-befc-6ff6b88ea483 None None] MFA Rules not processed for user `74d61067c8034b6cb80bec103bc404a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:17.511201 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a03bd80e-bf31-4f4b-befc-6ff6b88ea483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:17.584495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1044/2100] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:17 2022] PUT /identity/v3/projects/051fad711fc84488b9476c577bb0717d/users/b1d05c823fba4b458db0bbcc02dee146/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:17.585328 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01ce2a-947a-42fb-b62d-62859c36dd07 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:17.586941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5a01ce2a-947a-42fb-b62d-62859c36dd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:17.591884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1057/2101] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:06:17.595084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33252d35-504a-4447-b358-0c627f4de708 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:17.595605 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33252d35-504a-4447-b358-0c627f4de708 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:17.595892 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33252d35-504a-4447-b358-0c627f4de708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:17.624673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-33252d35-504a-4447-b358-0c627f4de708 None None] MFA Rules not processed for user `b1d05c823fba4b458db0bbcc02dee146`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:17.625930 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-33252d35-504a-4447-b358-0c627f4de708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:17.658675 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01ce2a-947a-42fb-b62d-62859c36dd07 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:17.663673 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0fe56-3f66-4f81-9666-19cbef419ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:17.664678 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0fe56-3f66-4f81-9666-19cbef419ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:17.664962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0fe56-3f66-4f81-9666-19cbef419ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:17.665237 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0fe56-3f66-4f81-9666-19cbef419ba5 admin admin] PATH_INFO: `/v3/projects/e8632715666f41f48639c9433b76b88a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:17.666475 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0fe56-3f66-4f81-9666-19cbef419ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8632715666f41f48639c9433b76b88a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:17.668432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0fe56-3f66-4f81-9666-19cbef419ba5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:17.689923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1058/2102] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:17.690842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33252d35-504a-4447-b358-0c627f4de708 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:17.692161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-33252d35-504a-4447-b358-0c627f4de708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:17.748661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33252d35-504a-4447-b358-0c627f4de708 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:17.752825 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f555e84-9ae7-4751-91e0-9d3a29402bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:17.753464 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555e84-9ae7-4751-91e0-9d3a29402bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:17.753789 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555e84-9ae7-4751-91e0-9d3a29402bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:17.754055 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555e84-9ae7-4751-91e0-9d3a29402bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:17.769143 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9a0fe56-3f66-4f81-9666-19cbef419ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8632715666f41f48639c9433b76b88a', 'request_id': 'req-d9a0fe56-3f66-4f81-9666-19cbef419ba5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:17.775493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9a0fe56-3f66-4f81-9666-19cbef419ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8632715666f41f48639c9433b76b88a', 'request_id': 'req-d9a0fe56-3f66-4f81-9666-19cbef419ba5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:17.781268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9a0fe56-3f66-4f81-9666-19cbef419ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8632715666f41f48639c9433b76b88a', 'request_id': 'req-d9a0fe56-3f66-4f81-9666-19cbef419ba5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:17.809875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f555e84-9ae7-4751-91e0-9d3a29402bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:17.811308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f555e84-9ae7-4751-91e0-9d3a29402bd6 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:17.825772 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1059/2103] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:17.828087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f555e84-9ae7-4751-91e0-9d3a29402bd6 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:17.829500 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5f555e84-9ae7-4751-91e0-9d3a29402bd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:17.862055 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9a0fe56-3f66-4f81-9666-19cbef419ba5 admin admin] The token cache is being invalidate because project e8632715666f41f48639c9433b76b88a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:17.864895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9a0fe56-3f66-4f81-9666-19cbef419ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:17.864895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-d9a0fe56-3f66-4f81-9666-19cbef419ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:17.869111 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1045/2104] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:17 2022] DELETE /identity/v3/projects/e8632715666f41f48639c9433b76b88a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:17.871066 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c1222-a02a-4330-bf76-937743469019 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:17.871359 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c1222-a02a-4330-bf76-937743469019 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:17.871683 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c1222-a02a-4330-bf76-937743469019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:17.891739 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1f1c1222-a02a-4330-bf76-937743469019 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:17.892941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1f1c1222-a02a-4330-bf76-937743469019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:17.898724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f555e84-9ae7-4751-91e0-9d3a29402bd6 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:17.954403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cbf682-97df-483d-b9d2-d0e5f31235a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce12ee27315460793dfedd294eb3c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:17.954403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbf682-97df-483d-b9d2-d0e5f31235a4 service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:17.954403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbf682-97df-483d-b9d2-d0e5f31235a4 service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:17.954403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cbf682-97df-483d-b9d2-d0e5f31235a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:17.954853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-44cbf682-97df-483d-b9d2-d0e5f31235a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:17.959862 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1046/2105] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:17.968830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edace926-f16f-44d6-bb99-e82d1253e6b2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:17.969208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edace926-f16f-44d6-bb99-e82d1253e6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:17.969575 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edace926-f16f-44d6-bb99-e82d1253e6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:17.991214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-edace926-f16f-44d6-bb99-e82d1253e6b2 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:17.992423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-edace926-f16f-44d6-bb99-e82d1253e6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:18.000879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1047/2106] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:06:18.004924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edace926-f16f-44d6-bb99-e82d1253e6b2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:18.013669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edace926-f16f-44d6-bb99-e82d1253e6b2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:18.019260 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2409fb2-cebd-4b47-81b9-95a33821d9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:18.019893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2409fb2-cebd-4b47-81b9-95a33821d9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:18.023229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2409fb2-cebd-4b47-81b9-95a33821d9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:18.023229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2409fb2-cebd-4b47-81b9-95a33821d9c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:18.023229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2409fb2-cebd-4b47-81b9-95a33821d9c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:06:18.023229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2409fb2-cebd-4b47-81b9-95a33821d9c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:18.023580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbf682-97df-483d-b9d2-d0e5f31235a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:18.023580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cbf682-97df-483d-b9d2-d0e5f31235a4 service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:18.023730 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2409fb2-cebd-4b47-81b9-95a33821d9c3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:18.031968 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1060/2107] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:18.034953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1048/2108] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:06:18.039084 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cbf682-97df-483d-b9d2-d0e5f31235a4 service glance] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:18.049802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cbf682-97df-483d-b9d2-d0e5f31235a4 service glance] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:18.056210 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9665b8-816a-4c15-974a-603bfbef97fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:18.056876 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9665b8-816a-4c15-974a-603bfbef97fb admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:18.057162 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9665b8-816a-4c15-974a-603bfbef97fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:18.057886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9665b8-816a-4c15-974a-603bfbef97fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:18.058161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9665b8-816a-4c15-974a-603bfbef97fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:18.060099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9665b8-816a-4c15-974a-603bfbef97fb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:18.170053 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1061/2109] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:18 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:18.174636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2409fb2-cebd-4b47-81b9-95a33821d9c3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:18.184995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2409fb2-cebd-4b47-81b9-95a33821d9c3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:18.243362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f44f9-2e9d-4c4b-accb-ae766bedb7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:18.244283 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f44f9-2e9d-4c4b-accb-ae766bedb7aa admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:18.244577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f44f9-2e9d-4c4b-accb-ae766bedb7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:18.244908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f44f9-2e9d-4c4b-accb-ae766bedb7aa admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:18.245680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f44f9-2e9d-4c4b-accb-ae766bedb7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:18.253834 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f44f9-2e9d-4c4b-accb-ae766bedb7aa admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:18.435792 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1049/2110] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:18 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:18.440368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9665b8-816a-4c15-974a-603bfbef97fb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:18.450410 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9665b8-816a-4c15-974a-603bfbef97fb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:18.455173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a63efa-9e7a-471f-96d8-6b9d05d78a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:18.455914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a63efa-9e7a-471f-96d8-6b9d05d78a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:18.456285 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a63efa-9e7a-471f-96d8-6b9d05d78a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:18.456585 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a63efa-9e7a-471f-96d8-6b9d05d78a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:18.457364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a63efa-9e7a-471f-96d8-6b9d05d78a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:18.459495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a63efa-9e7a-471f-96d8-6b9d05d78a74 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:18.479093 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1062/2111] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:18.481949 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f44f9-2e9d-4c4b-accb-ae766bedb7aa admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:18.492528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f44f9-2e9d-4c4b-accb-ae766bedb7aa admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:18.497300 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa64f59-d671-4eeb-b8b8-3d72a0e7800f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:18.498152 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa64f59-d671-4eeb-b8b8-3d72a0e7800f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:18.498267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa64f59-d671-4eeb-b8b8-3d72a0e7800f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:18.498561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa64f59-d671-4eeb-b8b8-3d72a0e7800f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:18.500004 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa64f59-d671-4eeb-b8b8-3d72a0e7800f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:18.501693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa64f59-d671-4eeb-b8b8-3d72a0e7800f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:18.512040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1050/2112] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:18.516015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a63efa-9e7a-471f-96d8-6b9d05d78a74 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:18.526297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a63efa-9e7a-471f-96d8-6b9d05d78a74 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:18.531387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03351bf7-2fbe-4c02-a94f-cfd6b179a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:18.532257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03351bf7-2fbe-4c02-a94f-cfd6b179a986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:18.532541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03351bf7-2fbe-4c02-a94f-cfd6b179a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:18.532816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03351bf7-2fbe-4c02-a94f-cfd6b179a986 admin admin] PATH_INFO: `/v3/projects/565e586f3c104cde8a0615a277ebe146/users/dff2dad45fd64f30bb4f5eec46f62aac/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:18.548348 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03351bf7-2fbe-4c02-a94f-cfd6b179a986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=565e586f3c104cde8a0615a277ebe146, user_id=dff2dad45fd64f30bb4f5eec46f62aac, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:18.551070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03351bf7-2fbe-4c02-a94f-cfd6b179a986 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:18.656441 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1063/2113] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:18 2022] PUT /identity/v3/projects/565e586f3c104cde8a0615a277ebe146/users/dff2dad45fd64f30bb4f5eec46f62aac/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:18.667475 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd87e91-f87d-42d4-8c7a-1b83c30c2449 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:18.667842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd87e91-f87d-42d4-8c7a-1b83c30c2449 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:18.668215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd87e91-f87d-42d4-8c7a-1b83c30c2449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:18.711875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fcd87e91-f87d-42d4-8c7a-1b83c30c2449 None None] MFA Rules not processed for user `dff2dad45fd64f30bb4f5eec46f62aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:18.713201 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fcd87e91-f87d-42d4-8c7a-1b83c30c2449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:18.809655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1051/2114] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:18.814226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03351bf7-2fbe-4c02-a94f-cfd6b179a986 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:18.893604 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03351bf7-2fbe-4c02-a94f-cfd6b179a986 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:18.898566 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d340f7-15c8-4f2a-949c-b6072aed4dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:18.899308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d340f7-15c8-4f2a-949c-b6072aed4dda admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:18.899656 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d340f7-15c8-4f2a-949c-b6072aed4dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:18.899994 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d340f7-15c8-4f2a-949c-b6072aed4dda admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:18.900775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d340f7-15c8-4f2a-949c-b6072aed4dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:18.903098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d340f7-15c8-4f2a-949c-b6072aed4dda admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:19.067914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1064/2115] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:18 2022] POST /identity/v3/projects => generated 379 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:19.069182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd87e91-f87d-42d4-8c7a-1b83c30c2449 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:19.080191 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd87e91-f87d-42d4-8c7a-1b83c30c2449 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:19.151145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca53d3-da61-4b51-bcab-8b67dde223c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:19.151831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca53d3-da61-4b51-bcab-8b67dde223c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:19.152135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca53d3-da61-4b51-bcab-8b67dde223c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:19.152417 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca53d3-da61-4b51-bcab-8b67dde223c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:19.153122 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca53d3-da61-4b51-bcab-8b67dde223c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:19.155962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca53d3-da61-4b51-bcab-8b67dde223c9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:19.295128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1052/2116] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:19 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:19.296347 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d340f7-15c8-4f2a-949c-b6072aed4dda admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:19.306409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d340f7-15c8-4f2a-949c-b6072aed4dda admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:19.310916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f31a6a-f2e3-4621-98b8-be8be1e694ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:19.312064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f31a6a-f2e3-4621-98b8-be8be1e694ec admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:19.312340 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f31a6a-f2e3-4621-98b8-be8be1e694ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:19.312609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f31a6a-f2e3-4621-98b8-be8be1e694ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:19.313381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f31a6a-f2e3-4621-98b8-be8be1e694ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:19.315029 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f31a6a-f2e3-4621-98b8-be8be1e694ec admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:19.325475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1065/2117] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:19.330139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca53d3-da61-4b51-bcab-8b67dde223c9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:19.340014 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca53d3-da61-4b51-bcab-8b67dde223c9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:19.344797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444bf39-dc61-4e2b-bc80-5dfd6a95213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:19.345456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444bf39-dc61-4e2b-bc80-5dfd6a95213a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:19.345899 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444bf39-dc61-4e2b-bc80-5dfd6a95213a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:19.346186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444bf39-dc61-4e2b-bc80-5dfd6a95213a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:19.346942 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444bf39-dc61-4e2b-bc80-5dfd6a95213a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:19.348654 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444bf39-dc61-4e2b-bc80-5dfd6a95213a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:19.361750 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1053/2118] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:06:19.362872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f31a6a-f2e3-4621-98b8-be8be1e694ec admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:19.372572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f31a6a-f2e3-4621-98b8-be8be1e694ec admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:19.377696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3faaa-5cde-44f7-a5a7-1fd635761bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:19.378568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3faaa-5cde-44f7-a5a7-1fd635761bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:19.378855 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3faaa-5cde-44f7-a5a7-1fd635761bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:19.379128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3faaa-5cde-44f7-a5a7-1fd635761bfc admin admin] PATH_INFO: `/v3/projects/0a42ea8db417430083432b6b216aae6a/users/1feca0d463024cfdbc309d8a8749c66e/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:19.394114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3faaa-5cde-44f7-a5a7-1fd635761bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a42ea8db417430083432b6b216aae6a, user_id=1feca0d463024cfdbc309d8a8749c66e, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:19.397102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3faaa-5cde-44f7-a5a7-1fd635761bfc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:19.539302 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1066/2119] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:19 2022] PUT /identity/v3/projects/0a42ea8db417430083432b6b216aae6a/users/1feca0d463024cfdbc309d8a8749c66e/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:06:19.550364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fea1f-822e-4381-9df5-32849be42781 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:19.550976 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fea1f-822e-4381-9df5-32849be42781 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:19.551258 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fea1f-822e-4381-9df5-32849be42781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:19.580426 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0a3fea1f-822e-4381-9df5-32849be42781 None None] MFA Rules not processed for user `1feca0d463024cfdbc309d8a8749c66e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:19.581776 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0a3fea1f-822e-4381-9df5-32849be42781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:19.646620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1054/2120] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:19.651158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3faaa-5cde-44f7-a5a7-1fd635761bfc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:19.675220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bd14d-fb5d-4e8a-9963-3fb06ca09e46 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:19.675565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bd14d-fb5d-4e8a-9963-3fb06ca09e46 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:19.675947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bd14d-fb5d-4e8a-9963-3fb06ca09e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:19.695336 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e56bd14d-fb5d-4e8a-9963-3fb06ca09e46 None None] MFA Rules not processed for user `74d61067c8034b6cb80bec103bc404a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:19.696960 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e56bd14d-fb5d-4e8a-9963-3fb06ca09e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:19.717343 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3faaa-5cde-44f7-a5a7-1fd635761bfc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:19.722251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1651ff-d46c-4600-ae9c-8c9e0f575ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:19.722920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1651ff-d46c-4600-ae9c-8c9e0f575ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:19.723209 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1651ff-d46c-4600-ae9c-8c9e0f575ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:19.723488 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1651ff-d46c-4600-ae9c-8c9e0f575ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:19.724180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1651ff-d46c-4600-ae9c-8c9e0f575ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:19.726136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1651ff-d46c-4600-ae9c-8c9e0f575ca0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:19.759601 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1055/2121] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:19.805073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1067/2122] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:19 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:19.809003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bd14d-fb5d-4e8a-9963-3fb06ca09e46 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:19.825468 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bd14d-fb5d-4e8a-9963-3fb06ca09e46 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:19.888379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb843da-528a-4e4a-8f1c-bae930f2091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:19.889281 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb843da-528a-4e4a-8f1c-bae930f2091c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:19.889718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb843da-528a-4e4a-8f1c-bae930f2091c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:19.890099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb843da-528a-4e4a-8f1c-bae930f2091c admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:19.891111 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb843da-528a-4e4a-8f1c-bae930f2091c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:19.893214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb843da-528a-4e4a-8f1c-bae930f2091c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:19.972032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1056/2123] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:19 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:19.978125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1651ff-d46c-4600-ae9c-8c9e0f575ca0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:19.990036 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1651ff-d46c-4600-ae9c-8c9e0f575ca0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:19.995041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6cd76-a4e8-4eb0-aefb-fa85486f3677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:19.998212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6cd76-a4e8-4eb0-aefb-fa85486f3677 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:19.998212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6cd76-a4e8-4eb0-aefb-fa85486f3677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:19.998212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6cd76-a4e8-4eb0-aefb-fa85486f3677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:19.998212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6cd76-a4e8-4eb0-aefb-fa85486f3677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:19.999457 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6cd76-a4e8-4eb0-aefb-fa85486f3677 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:20.011221 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1068/2124] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:20.015382 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb843da-528a-4e4a-8f1c-bae930f2091c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:20.026484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb843da-528a-4e4a-8f1c-bae930f2091c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:20.034853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63605ae-217b-4d62-8de6-a457bf86a25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:20.035760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63605ae-217b-4d62-8de6-a457bf86a25d admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:20.036157 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63605ae-217b-4d62-8de6-a457bf86a25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:20.036437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63605ae-217b-4d62-8de6-a457bf86a25d admin admin] PATH_INFO: `/v3/projects/5399fde44ebd4a2583d96b0763454dbd/users/04467813baf14f5a9d03d7d8f76c23ba/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:20.056854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63605ae-217b-4d62-8de6-a457bf86a25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5399fde44ebd4a2583d96b0763454dbd, user_id=04467813baf14f5a9d03d7d8f76c23ba, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:20.059550 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63605ae-217b-4d62-8de6-a457bf86a25d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:20.137835 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1057/2125] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:20 2022] PUT /identity/v3/projects/5399fde44ebd4a2583d96b0763454dbd/users/04467813baf14f5a9d03d7d8f76c23ba/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:20.141932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6cd76-a4e8-4eb0-aefb-fa85486f3677 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:20.151883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6cd76-a4e8-4eb0-aefb-fa85486f3677 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:20.213080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052362c-5c4a-45fd-8aef-6018b058bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:20.213767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052362c-5c4a-45fd-8aef-6018b058bed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:20.214050 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052362c-5c4a-45fd-8aef-6018b058bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:20.214323 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052362c-5c4a-45fd-8aef-6018b058bed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:20.215034 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052362c-5c4a-45fd-8aef-6018b058bed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:20.216618 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052362c-5c4a-45fd-8aef-6018b058bed0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:20.227134 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1069/2126] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:20.231504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63605ae-217b-4d62-8de6-a457bf86a25d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:20.250227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63605ae-217b-4d62-8de6-a457bf86a25d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:20.255170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ce948-30fe-4c1d-8808-e214fa605f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:20.256277 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ce948-30fe-4c1d-8808-e214fa605f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:20.256567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ce948-30fe-4c1d-8808-e214fa605f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:20.256844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719ce948-30fe-4c1d-8808-e214fa605f5c admin admin] PATH_INFO: `/v3/projects/5399fde44ebd4a2583d96b0763454dbd/users/04467813baf14f5a9d03d7d8f76c23ba/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:20.258928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ce948-30fe-4c1d-8808-e214fa605f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5399fde44ebd4a2583d96b0763454dbd, user_id=04467813baf14f5a9d03d7d8f76c23ba, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:20.261636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719ce948-30fe-4c1d-8808-e214fa605f5c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:20.272384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1058/2127] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:20 2022] PUT /identity/v3/projects/5399fde44ebd4a2583d96b0763454dbd/users/04467813baf14f5a9d03d7d8f76c23ba/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:20.284132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e78db-8e50-4722-b0cf-6c008bcbca7d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:20.284423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e78db-8e50-4722-b0cf-6c008bcbca7d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:20.284704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e78db-8e50-4722-b0cf-6c008bcbca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:20.311223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6d0e78db-8e50-4722-b0cf-6c008bcbca7d None None] MFA Rules not processed for user `04467813baf14f5a9d03d7d8f76c23ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:20.312383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6d0e78db-8e50-4722-b0cf-6c008bcbca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:20.378192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1070/2128] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:20.389206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ce948-30fe-4c1d-8808-e214fa605f5c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:20.391703 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-719ce948-30fe-4c1d-8808-e214fa605f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:20.458444 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719ce948-30fe-4c1d-8808-e214fa605f5c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:20.462389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d01bf-b829-4f7f-b15e-d08d9388d313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:20.463041 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d01bf-b829-4f7f-b15e-d08d9388d313 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:20.463329 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d01bf-b829-4f7f-b15e-d08d9388d313 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:20.463608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d01bf-b829-4f7f-b15e-d08d9388d313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:20.473985 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d01bf-b829-4f7f-b15e-d08d9388d313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:20.475463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d01bf-b829-4f7f-b15e-d08d9388d313 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:20.485409 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1059/2129] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:20.607178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e78db-8e50-4722-b0cf-6c008bcbca7d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:20.608640 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6d0e78db-8e50-4722-b0cf-6c008bcbca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:20.620481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e78db-8e50-4722-b0cf-6c008bcbca7d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:20.624292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17088b4c-0fd1-4bde-b68b-f09cc884f980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:20.624966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17088b4c-0fd1-4bde-b68b-f09cc884f980 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:20.625420 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17088b4c-0fd1-4bde-b68b-f09cc884f980 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:20.625730 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17088b4c-0fd1-4bde-b68b-f09cc884f980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:20.686642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17088b4c-0fd1-4bde-b68b-f09cc884f980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:20.688072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17088b4c-0fd1-4bde-b68b-f09cc884f980 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:20.697064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1071/2130] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:26.227341 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d01bf-b829-4f7f-b15e-d08d9388d313 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:26.232377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17088b4c-0fd1-4bde-b68b-f09cc884f980 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:26.235211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-17088b4c-0fd1-4bde-b68b-f09cc884f980 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:26.329110 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d01bf-b829-4f7f-b15e-d08d9388d313 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:26.334407 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae6dbc-f66b-410a-850d-3dc8db38e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:26.335411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae6dbc-f66b-410a-850d-3dc8db38e4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:26.335768 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae6dbc-f66b-410a-850d-3dc8db38e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:26.344293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae6dbc-f66b-410a-850d-3dc8db38e4ab admin admin] PATH_INFO: `/v3/users/dff2dad45fd64f30bb4f5eec46f62aac` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:26.346450 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae6dbc-f66b-410a-850d-3dc8db38e4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff2dad45fd64f30bb4f5eec46f62aac)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:26.349020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae6dbc-f66b-410a-850d-3dc8db38e4ab admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:26.394129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17088b4c-0fd1-4bde-b68b-f09cc884f980 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:26.404300 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381de66-e990-4dfb-b4c4-5515592e00cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:26.404300 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381de66-e990-4dfb-b4c4-5515592e00cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:26.404300 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381de66-e990-4dfb-b4c4-5515592e00cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:26.404300 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381de66-e990-4dfb-b4c4-5515592e00cb admin admin] PATH_INFO: `/v3/users/64e0c4cb49fb4c8f8c0b9c0c13d4b261` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:26.406557 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381de66-e990-4dfb-b4c4-5515592e00cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=64e0c4cb49fb4c8f8c0b9c0c13d4b261)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:26.408590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381de66-e990-4dfb-b4c4-5515592e00cb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:26.595422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08ae6dbc-f66b-410a-850d-3dc8db38e4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff2dad45fd64f30bb4f5eec46f62aac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:26.651784 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e381de66-e990-4dfb-b4c4-5515592e00cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64e0c4cb49fb4c8f8c0b9c0c13d4b261'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:26.659003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e381de66-e990-4dfb-b4c4-5515592e00cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64e0c4cb49fb4c8f8c0b9c0c13d4b261'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:26.673311 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08ae6dbc-f66b-410a-850d-3dc8db38e4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff2dad45fd64f30bb4f5eec46f62aac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:26.681600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08ae6dbc-f66b-410a-850d-3dc8db38e4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff2dad45fd64f30bb4f5eec46f62aac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:26.683548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08ae6dbc-f66b-410a-850d-3dc8db38e4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff2dad45fd64f30bb4f5eec46f62aac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:26.684190 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-08ae6dbc-f66b-410a-850d-3dc8db38e4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff2dad45fd64f30bb4f5eec46f62aac'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:26.707454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1060/2131] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:26 2022] DELETE /identity/v3/users/dff2dad45fd64f30bb4f5eec46f62aac => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:26.709859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf5cbf-5f47-4afd-a2b4-9afcf175dc1b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:26.709859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf5cbf-5f47-4afd-a2b4-9afcf175dc1b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:26.709859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf5cbf-5f47-4afd-a2b4-9afcf175dc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:26.728995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-cbcf5cbf-5f47-4afd-a2b4-9afcf175dc1b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:26.730233 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cbcf5cbf-5f47-4afd-a2b4-9afcf175dc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:26.757368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e381de66-e990-4dfb-b4c4-5515592e00cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64e0c4cb49fb4c8f8c0b9c0c13d4b261'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:26.758473 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e381de66-e990-4dfb-b4c4-5515592e00cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64e0c4cb49fb4c8f8c0b9c0c13d4b261'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:26.759321 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e381de66-e990-4dfb-b4c4-5515592e00cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64e0c4cb49fb4c8f8c0b9c0c13d4b261'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:26.789192 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1072/2132] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:26 2022] DELETE /identity/v3/users/64e0c4cb49fb4c8f8c0b9c0c13d4b261 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:26.793626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d346969-7662-4da2-b995-878b4e934b24 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:26.793929 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d346969-7662-4da2-b995-878b4e934b24 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:26.794921 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d346969-7662-4da2-b995-878b4e934b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:26.799270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1061/2133] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:26.813562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf5cbf-5f47-4afd-a2b4-9afcf175dc1b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:26.815002 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cbcf5cbf-5f47-4afd-a2b4-9afcf175dc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:26.826935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5d346969-7662-4da2-b995-878b4e934b24 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:26.828823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5d346969-7662-4da2-b995-878b4e934b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:26.875927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf5cbf-5f47-4afd-a2b4-9afcf175dc1b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:26.886283 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1073/2134] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:26.896751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d346969-7662-4da2-b995-878b4e934b24 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:26.945419 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b22d61-b0ab-4019-85f8-7e9fa34376ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:26.950289 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b22d61-b0ab-4019-85f8-7e9fa34376ce service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:26.950793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b22d61-b0ab-4019-85f8-7e9fa34376ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:26.951067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b22d61-b0ab-4019-85f8-7e9fa34376ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:26.953936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d346969-7662-4da2-b995-878b4e934b24 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:26.957937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e890af2-c47a-4bad-ab8d-57ea7fcbd39f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:26.958641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e890af2-c47a-4bad-ab8d-57ea7fcbd39f service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:26.963469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e890af2-c47a-4bad-ab8d-57ea7fcbd39f service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:26.963561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b22d61-b0ab-4019-85f8-7e9fa34376ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:26.963779 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e890af2-c47a-4bad-ab8d-57ea7fcbd39f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:26.964955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b22d61-b0ab-4019-85f8-7e9fa34376ce service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:26.976260 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1062/2135] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:26.977776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e890af2-c47a-4bad-ab8d-57ea7fcbd39f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:26.979588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e890af2-c47a-4bad-ab8d-57ea7fcbd39f service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:27.000686 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1074/2136] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:06:27.633345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b22d61-b0ab-4019-85f8-7e9fa34376ce service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:27.635079 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-76b22d61-b0ab-4019-85f8-7e9fa34376ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:27.651436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b22d61-b0ab-4019-85f8-7e9fa34376ce service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:27.673588 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:27.674629 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:27.674914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:27.675188 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] PATH_INFO: `/v3/projects/565e586f3c104cde8a0615a277ebe146` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:27.676569 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=565e586f3c104cde8a0615a277ebe146)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:27.678576 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:27.792718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565e586f3c104cde8a0615a277ebe146', 'request_id': 'req-ca6dd9b2-9138-44be-85f0-51602a8b8800'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:27.801155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565e586f3c104cde8a0615a277ebe146', 'request_id': 'req-ca6dd9b2-9138-44be-85f0-51602a8b8800'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:27.807790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565e586f3c104cde8a0615a277ebe146', 'request_id': 'req-ca6dd9b2-9138-44be-85f0-51602a8b8800'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:27.883854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] The token cache is being invalidate because project 565e586f3c104cde8a0615a277ebe146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:27.884090 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:27.884720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:27.886315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1063/2137] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:27 2022] DELETE /identity/v3/projects/565e586f3c104cde8a0615a277ebe146 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:27.890963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e890af2-c47a-4bad-ab8d-57ea7fcbd39f service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:27.900773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e890af2-c47a-4bad-ab8d-57ea7fcbd39f service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:27.957377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227b0a2-a088-4db5-ad16-ad8754168158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:27.958641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227b0a2-a088-4db5-ad16-ad8754168158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:27.959548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227b0a2-a088-4db5-ad16-ad8754168158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:27.959835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227b0a2-a088-4db5-ad16-ad8754168158 admin admin] PATH_INFO: `/v3/users/1feca0d463024cfdbc309d8a8749c66e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:27.961168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227b0a2-a088-4db5-ad16-ad8754168158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1feca0d463024cfdbc309d8a8749c66e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:27.963455 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227b0a2-a088-4db5-ad16-ad8754168158 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:28.174687 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:28.175737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:28.190060 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6dd9b2-9138-44be-85f0-51602a8b8800 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:28.196549 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:28.197589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:28.197931 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:28.198151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] PATH_INFO: `/v3/projects/d7b3eba7595a4108b4edaaa04cf47e85` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:28.199478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7b3eba7595a4108b4edaaa04cf47e85)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:28.199990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2227b0a2-a088-4db5-ad16-ad8754168158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1feca0d463024cfdbc309d8a8749c66e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:28.201432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:28.209576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2227b0a2-a088-4db5-ad16-ad8754168158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1feca0d463024cfdbc309d8a8749c66e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:28.297845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2227b0a2-a088-4db5-ad16-ad8754168158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1feca0d463024cfdbc309d8a8749c66e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:28.298581 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2227b0a2-a088-4db5-ad16-ad8754168158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1feca0d463024cfdbc309d8a8749c66e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:28.299399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2227b0a2-a088-4db5-ad16-ad8754168158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1feca0d463024cfdbc309d8a8749c66e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:28.322357 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1075/2138] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:27 2022] DELETE /identity/v3/users/1feca0d463024cfdbc309d8a8749c66e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:06:28.360770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7b3eba7595a4108b4edaaa04cf47e85', 'request_id': 'req-97f870a0-4378-4e22-bae9-f177ccc98664'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:28.370500 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7b3eba7595a4108b4edaaa04cf47e85', 'request_id': 'req-97f870a0-4378-4e22-bae9-f177ccc98664'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:28.378946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7b3eba7595a4108b4edaaa04cf47e85', 'request_id': 'req-97f870a0-4378-4e22-bae9-f177ccc98664'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:28.516136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] The token cache is being invalidate because project d7b3eba7595a4108b4edaaa04cf47e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:28.516529 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:28.517183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:28.519038 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1064/2139] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:28 2022] DELETE /identity/v3/projects/d7b3eba7595a4108b4edaaa04cf47e85 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:29.040024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227b0a2-a088-4db5-ad16-ad8754168158 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:29.041442 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2227b0a2-a088-4db5-ad16-ad8754168158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:29.138017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227b0a2-a088-4db5-ad16-ad8754168158 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:29.206095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:29.207137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:29.207487 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:29.207766 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] PATH_INFO: `/v3/projects/0a42ea8db417430083432b6b216aae6a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:29.208949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a42ea8db417430083432b6b216aae6a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:29.210910 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:29.346943 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a42ea8db417430083432b6b216aae6a', 'request_id': 'req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:29.353514 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a42ea8db417430083432b6b216aae6a', 'request_id': 'req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:29.365665 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a42ea8db417430083432b6b216aae6a', 'request_id': 'req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:29.491139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] The token cache is being invalidate because project 0a42ea8db417430083432b6b216aae6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:29.491359 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:29.491984 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:29.493570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1076/2140] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:29 2022] DELETE /identity/v3/projects/0a42ea8db417430083432b6b216aae6a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:29.497724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:29.499841 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:29.512662 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f870a0-4378-4e22-bae9-f177ccc98664 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:29.571797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eac9d3-6643-41e9-a72a-19070ace0ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:29.572763 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eac9d3-6643-41e9-a72a-19070ace0ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:29.573027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eac9d3-6643-41e9-a72a-19070ace0ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:29.573412 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eac9d3-6643-41e9-a72a-19070ace0ffb admin admin] PATH_INFO: `/v3/users/04467813baf14f5a9d03d7d8f76c23ba` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:29.574648 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eac9d3-6643-41e9-a72a-19070ace0ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=04467813baf14f5a9d03d7d8f76c23ba)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:29.576831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eac9d3-6643-41e9-a72a-19070ace0ffb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:29.884573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-80eac9d3-6643-41e9-a72a-19070ace0ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04467813baf14f5a9d03d7d8f76c23ba'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:29.974623 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-80eac9d3-6643-41e9-a72a-19070ace0ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04467813baf14f5a9d03d7d8f76c23ba'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:29.982148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-80eac9d3-6643-41e9-a72a-19070ace0ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04467813baf14f5a9d03d7d8f76c23ba'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:29.982842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-80eac9d3-6643-41e9-a72a-19070ace0ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04467813baf14f5a9d03d7d8f76c23ba'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:29.983515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-80eac9d3-6643-41e9-a72a-19070ace0ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04467813baf14f5a9d03d7d8f76c23ba'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:30.001339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1065/2141] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:29 2022] DELETE /identity/v3/users/04467813baf14f5a9d03d7d8f76c23ba => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:30.462270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:30.463689 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:30.476998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58908afd-d8e5-4aad-9fc1-9c820ecedcf9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:30.534223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:30.535120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:30.535395 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:30.535689 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8 admin admin] PATH_INFO: `/v3/projects/5399fde44ebd4a2583d96b0763454dbd` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:30.536878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5399fde44ebd4a2583d96b0763454dbd)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:30.538864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:30.670771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5399fde44ebd4a2583d96b0763454dbd', 'request_id': 'req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:30.676647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5399fde44ebd4a2583d96b0763454dbd', 'request_id': 'req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:30.681817 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5399fde44ebd4a2583d96b0763454dbd', 'request_id': 'req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:30.768399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8 admin admin] The token cache is being invalidate because project 5399fde44ebd4a2583d96b0763454dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:30.768825 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:30.776800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b35b7fbb-4fe1-4bdb-ab93-d8480d7ac2c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:30.776800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1077/2142] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:30 2022] DELETE /identity/v3/projects/5399fde44ebd4a2583d96b0763454dbd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:30.779330 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a285b10-8353-4d5f-8237-f1dff55949ce None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:30.779817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a285b10-8353-4d5f-8237-f1dff55949ce None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:30.779913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a285b10-8353-4d5f-8237-f1dff55949ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:30.800980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1a285b10-8353-4d5f-8237-f1dff55949ce None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:30.802419 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1a285b10-8353-4d5f-8237-f1dff55949ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:30.871692 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1066/2143] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:30.880294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd3914-1a4d-4d4a-8259-d2f6b5084fe6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:30.880588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd3914-1a4d-4d4a-8259-d2f6b5084fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:30.880870 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd3914-1a4d-4d4a-8259-d2f6b5084fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:30.900625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2bfd3914-1a4d-4d4a-8259-d2f6b5084fe6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:30.902151 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2bfd3914-1a4d-4d4a-8259-d2f6b5084fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:30.915831 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1078/2144] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:30.920050 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a285b10-8353-4d5f-8237-f1dff55949ce None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:30.930596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a285b10-8353-4d5f-8237-f1dff55949ce None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:30.936083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67154c-e58e-4d9c-a565-03099a08616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:30.936752 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67154c-e58e-4d9c-a565-03099a08616f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:30.937038 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67154c-e58e-4d9c-a565-03099a08616f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:30.937320 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67154c-e58e-4d9c-a565-03099a08616f admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:30.938728 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67154c-e58e-4d9c-a565-03099a08616f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:06:30.939040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67154c-e58e-4d9c-a565-03099a08616f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:30.940726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67154c-e58e-4d9c-a565-03099a08616f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:30.953259 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1067/2145] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:06:30.957755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd3914-1a4d-4d4a-8259-d2f6b5084fe6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:30.969647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd3914-1a4d-4d4a-8259-d2f6b5084fe6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:30.974649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d882360-64fb-4e20-9fbd-020653755707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:30.975316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d882360-64fb-4e20-9fbd-020653755707 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:30.975594 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d882360-64fb-4e20-9fbd-020653755707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:30.975863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d882360-64fb-4e20-9fbd-020653755707 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:30.976551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d882360-64fb-4e20-9fbd-020653755707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:30.978514 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d882360-64fb-4e20-9fbd-020653755707 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:31.095829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1079/2146] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:30 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:31.099916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67154c-e58e-4d9c-a565-03099a08616f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:31.110348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67154c-e58e-4d9c-a565-03099a08616f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:31.173676 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91caa3c-116a-4db7-bbc7-bb8035793487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:31.174534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91caa3c-116a-4db7-bbc7-bb8035793487 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:31.174875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91caa3c-116a-4db7-bbc7-bb8035793487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:31.175127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91caa3c-116a-4db7-bbc7-bb8035793487 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:31.175855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91caa3c-116a-4db7-bbc7-bb8035793487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:31.178935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91caa3c-116a-4db7-bbc7-bb8035793487 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:31.297690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1068/2147] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:31 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:31.299502 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d882360-64fb-4e20-9fbd-020653755707 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:31.309608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d882360-64fb-4e20-9fbd-020653755707 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:31.314496 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ffdbb-f12f-44b9-bd25-47b6ef10c41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:31.315223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ffdbb-f12f-44b9-bd25-47b6ef10c41a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:31.315574 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ffdbb-f12f-44b9-bd25-47b6ef10c41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:31.315929 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ffdbb-f12f-44b9-bd25-47b6ef10c41a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:31.316722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ffdbb-f12f-44b9-bd25-47b6ef10c41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:31.318354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ffdbb-f12f-44b9-bd25-47b6ef10c41a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:31.329143 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1080/2148] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:31.333853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91caa3c-116a-4db7-bbc7-bb8035793487 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:31.346683 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91caa3c-116a-4db7-bbc7-bb8035793487 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:31.351574 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcf9e8-3ef5-49a7-9359-9d0858a24ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:31.352227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcf9e8-3ef5-49a7-9359-9d0858a24ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:31.352513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcf9e8-3ef5-49a7-9359-9d0858a24ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:31.352792 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcf9e8-3ef5-49a7-9359-9d0858a24ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:31.353520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbcf9e8-3ef5-49a7-9359-9d0858a24ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:31.355191 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbcf9e8-3ef5-49a7-9359-9d0858a24ae4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:31.366320 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1069/2149] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:31.370518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ffdbb-f12f-44b9-bd25-47b6ef10c41a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:31.380567 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ffdbb-f12f-44b9-bd25-47b6ef10c41a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:31.385562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde135ca-758f-4667-9ea7-b2d3c8b9d344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:31.386320 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde135ca-758f-4667-9ea7-b2d3c8b9d344 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:31.386675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde135ca-758f-4667-9ea7-b2d3c8b9d344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:31.387018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde135ca-758f-4667-9ea7-b2d3c8b9d344 admin admin] PATH_INFO: `/v3/projects/f528eb1c964c40a88fee13acb543a773/users/8315d84fdd3f42839b71ec3df2886434/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:31.403202 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde135ca-758f-4667-9ea7-b2d3c8b9d344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f528eb1c964c40a88fee13acb543a773, user_id=8315d84fdd3f42839b71ec3df2886434, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:31.406024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde135ca-758f-4667-9ea7-b2d3c8b9d344 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:31.543068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1081/2150] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:31 2022] PUT /identity/v3/projects/f528eb1c964c40a88fee13acb543a773/users/8315d84fdd3f42839b71ec3df2886434/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:06:31.555030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746f7a-1334-46e9-8cfe-a08ed019133e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:31.555324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746f7a-1334-46e9-8cfe-a08ed019133e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:31.555608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746f7a-1334-46e9-8cfe-a08ed019133e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:31.582117 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-80746f7a-1334-46e9-8cfe-a08ed019133e None None] MFA Rules not processed for user `8315d84fdd3f42839b71ec3df2886434`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:31.583322 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-80746f7a-1334-46e9-8cfe-a08ed019133e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:31.646181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1070/2151] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:31.658568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde135ca-758f-4667-9ea7-b2d3c8b9d344 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:31.660727 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bde135ca-758f-4667-9ea7-b2d3c8b9d344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:31.722383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde135ca-758f-4667-9ea7-b2d3c8b9d344 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:31.726076 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60c7dc-c342-4e5b-973b-24b41047f01b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:31.726722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60c7dc-c342-4e5b-973b-24b41047f01b service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:31.727178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60c7dc-c342-4e5b-973b-24b41047f01b service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:31.727456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60c7dc-c342-4e5b-973b-24b41047f01b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:31.736074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60c7dc-c342-4e5b-973b-24b41047f01b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:31.737489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60c7dc-c342-4e5b-973b-24b41047f01b service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:31.746822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1082/2152] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:06:36.132027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80746f7a-1334-46e9-8cfe-a08ed019133e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:36.190935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80746f7a-1334-46e9-8cfe-a08ed019133e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:36.195564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d684e7-4c30-41a7-9c64-d9202b4f11e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:36.196437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d684e7-4c30-41a7-9c64-d9202b4f11e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:36.196722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d684e7-4c30-41a7-9c64-d9202b4f11e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:36.197000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d684e7-4c30-41a7-9c64-d9202b4f11e4 admin admin] PATH_INFO: `/v3/users/8315d84fdd3f42839b71ec3df2886434` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:36.198199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d684e7-4c30-41a7-9c64-d9202b4f11e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8315d84fdd3f42839b71ec3df2886434)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:36.200115 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d684e7-4c30-41a7-9c64-d9202b4f11e4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:36.478999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-43d684e7-4c30-41a7-9c64-d9202b4f11e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8315d84fdd3f42839b71ec3df2886434'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:36.580318 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-43d684e7-4c30-41a7-9c64-d9202b4f11e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8315d84fdd3f42839b71ec3df2886434'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:36.587472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-43d684e7-4c30-41a7-9c64-d9202b4f11e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8315d84fdd3f42839b71ec3df2886434'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:36.588105 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-43d684e7-4c30-41a7-9c64-d9202b4f11e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8315d84fdd3f42839b71ec3df2886434'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:36.588718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-43d684e7-4c30-41a7-9c64-d9202b4f11e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8315d84fdd3f42839b71ec3df2886434'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:36.605982 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1071/2153] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:36 2022] DELETE /identity/v3/users/8315d84fdd3f42839b71ec3df2886434 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:36.611100 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087656cc-c9d5-48c6-aac2-a226f0d2d9c7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:36.611580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087656cc-c9d5-48c6-aac2-a226f0d2d9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:36.611672 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087656cc-c9d5-48c6-aac2-a226f0d2d9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:36.630380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-087656cc-c9d5-48c6-aac2-a226f0d2d9c7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:36.631583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-087656cc-c9d5-48c6-aac2-a226f0d2d9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:36.707399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1083/2154] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:36.716064 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d684e7-4c30-41a7-9c64-d9202b4f11e4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:36.717784 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-43d684e7-4c30-41a7-9c64-d9202b4f11e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:36.777584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d684e7-4c30-41a7-9c64-d9202b4f11e4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:36.781376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889b7a8-af00-47ca-b70b-b31fe0abc2ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:36.782071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889b7a8-af00-47ca-b70b-b31fe0abc2ec service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:36.782407 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889b7a8-af00-47ca-b70b-b31fe0abc2ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:36.782698 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889b7a8-af00-47ca-b70b-b31fe0abc2ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:36.792442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889b7a8-af00-47ca-b70b-b31fe0abc2ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:36.794185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889b7a8-af00-47ca-b70b-b31fe0abc2ec service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:36.804631 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1072/2155] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:37.239833 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087656cc-c9d5-48c6-aac2-a226f0d2d9c7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:37.244701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-087656cc-c9d5-48c6-aac2-a226f0d2d9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:37.263881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087656cc-c9d5-48c6-aac2-a226f0d2d9c7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:37.276897 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f4035-a613-425d-a2ec-481203ef77a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:37.276897 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f4035-a613-425d-a2ec-481203ef77a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:37.276897 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f4035-a613-425d-a2ec-481203ef77a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:37.276897 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f4035-a613-425d-a2ec-481203ef77a4 admin admin] PATH_INFO: `/v3/projects/f528eb1c964c40a88fee13acb543a773` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:37.277653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f4035-a613-425d-a2ec-481203ef77a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f528eb1c964c40a88fee13acb543a773)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:37.277993 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f4035-a613-425d-a2ec-481203ef77a4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:37.432427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-097f4035-a613-425d-a2ec-481203ef77a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f528eb1c964c40a88fee13acb543a773', 'request_id': 'req-097f4035-a613-425d-a2ec-481203ef77a4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:37.439003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-097f4035-a613-425d-a2ec-481203ef77a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f528eb1c964c40a88fee13acb543a773', 'request_id': 'req-097f4035-a613-425d-a2ec-481203ef77a4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:37.446768 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-097f4035-a613-425d-a2ec-481203ef77a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f528eb1c964c40a88fee13acb543a773', 'request_id': 'req-097f4035-a613-425d-a2ec-481203ef77a4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:37.530463 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-097f4035-a613-425d-a2ec-481203ef77a4 admin admin] The token cache is being invalidate because project f528eb1c964c40a88fee13acb543a773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:37.530751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-097f4035-a613-425d-a2ec-481203ef77a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:37.533106 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-097f4035-a613-425d-a2ec-481203ef77a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:37.533433 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1084/2156] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:37 2022] DELETE /identity/v3/projects/f528eb1c964c40a88fee13acb543a773 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:37.538586 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e93e8a-1cd8-4034-a7c3-64aa2b479157 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:37.539095 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e93e8a-1cd8-4034-a7c3-64aa2b479157 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:37.539186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e93e8a-1cd8-4034-a7c3-64aa2b479157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:37.557154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d4e93e8a-1cd8-4034-a7c3-64aa2b479157 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:37.558460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d4e93e8a-1cd8-4034-a7c3-64aa2b479157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:37.616714 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1073/2157] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:37.625702 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066552-9eb1-4338-a69e-d6e592c0c472 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:37.626205 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066552-9eb1-4338-a69e-d6e592c0c472 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:37.626205 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066552-9eb1-4338-a69e-d6e592c0c472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:37.644388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7f066552-9eb1-4338-a69e-d6e592c0c472 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:37.645868 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7f066552-9eb1-4338-a69e-d6e592c0c472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:37.653773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1085/2158] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:37.658674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e93e8a-1cd8-4034-a7c3-64aa2b479157 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:37.669027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e93e8a-1cd8-4034-a7c3-64aa2b479157 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:37.674127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26aa41-8d66-4973-b331-861ef0598e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:37.674781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26aa41-8d66-4973-b331-861ef0598e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:37.675063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26aa41-8d66-4973-b331-861ef0598e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:37.675338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26aa41-8d66-4973-b331-861ef0598e6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:37.676053 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26aa41-8d66-4973-b331-861ef0598e6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:06:37.676362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26aa41-8d66-4973-b331-861ef0598e6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:37.677972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26aa41-8d66-4973-b331-861ef0598e6c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:37.690710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1074/2159] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:06:37.695109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f066552-9eb1-4338-a69e-d6e592c0c472 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:37.704796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f066552-9eb1-4338-a69e-d6e592c0c472 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:37.709519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7952a-037e-4cf4-b2f5-0721a5e1d258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:37.710194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7952a-037e-4cf4-b2f5-0721a5e1d258 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:37.710480 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7952a-037e-4cf4-b2f5-0721a5e1d258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:37.710765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7952a-037e-4cf4-b2f5-0721a5e1d258 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:37.711469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7952a-037e-4cf4-b2f5-0721a5e1d258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:37.713364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7952a-037e-4cf4-b2f5-0721a5e1d258 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:37.841818 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1086/2160] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:37 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:37.846660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26aa41-8d66-4973-b331-861ef0598e6c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:37.856635 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26aa41-8d66-4973-b331-861ef0598e6c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:37.913077 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18e612-ed2d-4f65-8476-39f78d397d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:37.913845 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18e612-ed2d-4f65-8476-39f78d397d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:37.914054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18e612-ed2d-4f65-8476-39f78d397d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:37.921829 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18e612-ed2d-4f65-8476-39f78d397d99 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:37.921829 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18e612-ed2d-4f65-8476-39f78d397d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:37.921829 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18e612-ed2d-4f65-8476-39f78d397d99 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:38.009265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1075/2161] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:37 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:38.013449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7952a-037e-4cf4-b2f5-0721a5e1d258 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:38.025429 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7952a-037e-4cf4-b2f5-0721a5e1d258 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:38.031237 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cde2a2-9bdc-4faa-8a42-0968a6d73163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:38.031969 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cde2a2-9bdc-4faa-8a42-0968a6d73163 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:38.032884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cde2a2-9bdc-4faa-8a42-0968a6d73163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:38.032884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cde2a2-9bdc-4faa-8a42-0968a6d73163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:38.033663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cde2a2-9bdc-4faa-8a42-0968a6d73163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:38.035589 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cde2a2-9bdc-4faa-8a42-0968a6d73163 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:38.051503 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1087/2162] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:38.052673 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18e612-ed2d-4f65-8476-39f78d397d99 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:38.062849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18e612-ed2d-4f65-8476-39f78d397d99 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:38.068193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e7acb-328d-4f14-aab7-ca3bf648d676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:38.068850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e7acb-328d-4f14-aab7-ca3bf648d676 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:38.069133 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e7acb-328d-4f14-aab7-ca3bf648d676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:38.069410 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e7acb-328d-4f14-aab7-ca3bf648d676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:38.070172 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e7acb-328d-4f14-aab7-ca3bf648d676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:38.071784 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e7acb-328d-4f14-aab7-ca3bf648d676 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:38.082499 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1076/2163] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:38.086331 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cde2a2-9bdc-4faa-8a42-0968a6d73163 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:38.097807 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cde2a2-9bdc-4faa-8a42-0968a6d73163 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:38.102530 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7873c-d48d-4d59-99ec-ecbc7035f56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:38.103427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7873c-d48d-4d59-99ec-ecbc7035f56d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:38.103781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7873c-d48d-4d59-99ec-ecbc7035f56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:38.104124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7873c-d48d-4d59-99ec-ecbc7035f56d admin admin] PATH_INFO: `/v3/projects/ef22e7dbb6a1456c8fe365d9539a9016/users/e6f587c1067c491c8d1b50eb203e4f3f/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:38.120026 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7873c-d48d-4d59-99ec-ecbc7035f56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef22e7dbb6a1456c8fe365d9539a9016, user_id=e6f587c1067c491c8d1b50eb203e4f3f, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:38.122834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7873c-d48d-4d59-99ec-ecbc7035f56d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:38.214099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1088/2164] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:38 2022] PUT /identity/v3/projects/ef22e7dbb6a1456c8fe365d9539a9016/users/e6f587c1067c491c8d1b50eb203e4f3f/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:38.224273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6e8f5-40aa-402b-b0ef-3a6f05df636a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:38.224567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6e8f5-40aa-402b-b0ef-3a6f05df636a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:38.224849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6e8f5-40aa-402b-b0ef-3a6f05df636a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:38.250749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-85d6e8f5-40aa-402b-b0ef-3a6f05df636a None None] MFA Rules not processed for user `e6f587c1067c491c8d1b50eb203e4f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:38.252449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-85d6e8f5-40aa-402b-b0ef-3a6f05df636a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:38.316381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1077/2165] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:38.320885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7873c-d48d-4d59-99ec-ecbc7035f56d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:38.383190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7873c-d48d-4d59-99ec-ecbc7035f56d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:38.387873 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d561d69-606c-43c1-86c2-8dbbe0d1c6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:38.388537 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d561d69-606c-43c1-86c2-8dbbe0d1c6aa admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:38.388820 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d561d69-606c-43c1-86c2-8dbbe0d1c6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:38.389096 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d561d69-606c-43c1-86c2-8dbbe0d1c6aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:38.389836 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d561d69-606c-43c1-86c2-8dbbe0d1c6aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:38.395025 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d561d69-606c-43c1-86c2-8dbbe0d1c6aa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:38.508137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1089/2166] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:38 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:38.512221 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6e8f5-40aa-402b-b0ef-3a6f05df636a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:38.522628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6e8f5-40aa-402b-b0ef-3a6f05df636a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:38.583837 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c0207-9bc2-4135-8d5c-c858ccf26ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:38.584517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c0207-9bc2-4135-8d5c-c858ccf26ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:38.584805 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c0207-9bc2-4135-8d5c-c858ccf26ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:38.585086 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c0207-9bc2-4135-8d5c-c858ccf26ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:38.585826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c0207-9bc2-4135-8d5c-c858ccf26ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:38.589842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c0207-9bc2-4135-8d5c-c858ccf26ba8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:38.704456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1078/2167] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:38 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:38.708470 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d561d69-606c-43c1-86c2-8dbbe0d1c6aa admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:38.721231 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d561d69-606c-43c1-86c2-8dbbe0d1c6aa admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:38.726190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b97243-b302-4c40-8553-cee2882a1d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:38.726860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b97243-b302-4c40-8553-cee2882a1d4e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:38.727180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b97243-b302-4c40-8553-cee2882a1d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:38.727416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b97243-b302-4c40-8553-cee2882a1d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:38.728149 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b97243-b302-4c40-8553-cee2882a1d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:38.729992 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b97243-b302-4c40-8553-cee2882a1d4e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:38.741956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1090/2168] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:38.745805 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c0207-9bc2-4135-8d5c-c858ccf26ba8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:38.755910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c0207-9bc2-4135-8d5c-c858ccf26ba8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:38.760492 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a16a9-e216-450f-860a-9ebc635f259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:38.761172 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a16a9-e216-450f-860a-9ebc635f259d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:38.761462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a16a9-e216-450f-860a-9ebc635f259d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:38.761781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a16a9-e216-450f-860a-9ebc635f259d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:38.762533 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a16a9-e216-450f-860a-9ebc635f259d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:38.764130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a16a9-e216-450f-860a-9ebc635f259d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:38.776073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1079/2169] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:06:38.782980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b97243-b302-4c40-8553-cee2882a1d4e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:38.792768 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b97243-b302-4c40-8553-cee2882a1d4e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:38.797335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fdb22-0659-48e5-800f-4e827191f3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:38.798764 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fdb22-0659-48e5-800f-4e827191f3e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:38.799048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fdb22-0659-48e5-800f-4e827191f3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:38.799322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fdb22-0659-48e5-800f-4e827191f3e8 admin admin] PATH_INFO: `/v3/projects/903b72494e5a47b2a99dfdad850827db/users/63403f717b77402eb114d0f7ade71e04/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:38.813953 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fdb22-0659-48e5-800f-4e827191f3e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903b72494e5a47b2a99dfdad850827db, user_id=63403f717b77402eb114d0f7ade71e04, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:38.816628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fdb22-0659-48e5-800f-4e827191f3e8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:38.882851 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1091/2170] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:38 2022] PUT /identity/v3/projects/903b72494e5a47b2a99dfdad850827db/users/63403f717b77402eb114d0f7ade71e04/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:38.892804 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28983f78-9adc-4513-8987-dc2f0040164d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:38.893091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28983f78-9adc-4513-8987-dc2f0040164d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:38.893367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28983f78-9adc-4513-8987-dc2f0040164d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:38.920508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-28983f78-9adc-4513-8987-dc2f0040164d None None] MFA Rules not processed for user `63403f717b77402eb114d0f7ade71e04`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:38.921772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-28983f78-9adc-4513-8987-dc2f0040164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:38.987071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1080/2171] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:38.992027 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fdb22-0659-48e5-800f-4e827191f3e8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:39.055194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fdb22-0659-48e5-800f-4e827191f3e8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:39.060061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67ff21-1eec-41ab-add7-a4ba56dedeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:39.060650 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67ff21-1eec-41ab-add7-a4ba56dedeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:39.061232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67ff21-1eec-41ab-add7-a4ba56dedeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:39.061232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67ff21-1eec-41ab-add7-a4ba56dedeb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:39.061919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67ff21-1eec-41ab-add7-a4ba56dedeb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:39.063835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67ff21-1eec-41ab-add7-a4ba56dedeb2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:39.162698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1092/2172] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:38 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:39.168352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28983f78-9adc-4513-8987-dc2f0040164d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:39.178914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28983f78-9adc-4513-8987-dc2f0040164d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:39.233088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b3d0-7c86-4ca3-99c0-0b2f4a00b04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:39.233787 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b3d0-7c86-4ca3-99c0-0b2f4a00b04e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:39.234076 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b3d0-7c86-4ca3-99c0-0b2f4a00b04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:39.234358 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4b3d0-7c86-4ca3-99c0-0b2f4a00b04e admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:39.235099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4b3d0-7c86-4ca3-99c0-0b2f4a00b04e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:39.237105 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4b3d0-7c86-4ca3-99c0-0b2f4a00b04e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:39.362989 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1081/2173] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:39 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:39.367207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67ff21-1eec-41ab-add7-a4ba56dedeb2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:39.377383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67ff21-1eec-41ab-add7-a4ba56dedeb2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:39.384593 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2c6eb-7a84-4c67-891a-6029d33534c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:39.385446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2c6eb-7a84-4c67-891a-6029d33534c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:39.385866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2c6eb-7a84-4c67-891a-6029d33534c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:39.386165 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2c6eb-7a84-4c67-891a-6029d33534c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:39.386898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2c6eb-7a84-4c67-891a-6029d33534c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:39.388593 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2c6eb-7a84-4c67-891a-6029d33534c0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:39.406614 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1093/2174] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:39.411167 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b3d0-7c86-4ca3-99c0-0b2f4a00b04e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:39.421463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4b3d0-7c86-4ca3-99c0-0b2f4a00b04e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:39.427092 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e49e69-a6cd-4fc0-ba84-ee3003d2781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:39.427985 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e49e69-a6cd-4fc0-ba84-ee3003d2781a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:39.428271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e49e69-a6cd-4fc0-ba84-ee3003d2781a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:39.428551 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e49e69-a6cd-4fc0-ba84-ee3003d2781a admin admin] PATH_INFO: `/v3/projects/d8711379781e43069520e492c4ffbe95/users/7fb1cef56bf7457b827425db0fa5ba66/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:39.444513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e49e69-a6cd-4fc0-ba84-ee3003d2781a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8711379781e43069520e492c4ffbe95, user_id=7fb1cef56bf7457b827425db0fa5ba66, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:39.447391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e49e69-a6cd-4fc0-ba84-ee3003d2781a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:39.560163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1082/2175] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:39 2022] PUT /identity/v3/projects/d8711379781e43069520e492c4ffbe95/users/7fb1cef56bf7457b827425db0fa5ba66/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:39.564159 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2c6eb-7a84-4c67-891a-6029d33534c0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:39.575629 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2c6eb-7a84-4c67-891a-6029d33534c0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:39.646852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02e21c-2e87-4ad5-86a7-7c65dbb38991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:39.647593 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02e21c-2e87-4ad5-86a7-7c65dbb38991 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:39.647884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02e21c-2e87-4ad5-86a7-7c65dbb38991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:39.648164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02e21c-2e87-4ad5-86a7-7c65dbb38991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:39.649364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02e21c-2e87-4ad5-86a7-7c65dbb38991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:39.650560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02e21c-2e87-4ad5-86a7-7c65dbb38991 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:39.662389 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1094/2176] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:39.667084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e49e69-a6cd-4fc0-ba84-ee3003d2781a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:39.678136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e49e69-a6cd-4fc0-ba84-ee3003d2781a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:39.683609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc45e2-31fc-422f-ae29-2c9951d3d960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:39.684347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc45e2-31fc-422f-ae29-2c9951d3d960 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:39.684735 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc45e2-31fc-422f-ae29-2c9951d3d960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:39.685134 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc45e2-31fc-422f-ae29-2c9951d3d960 admin admin] PATH_INFO: `/v3/projects/d8711379781e43069520e492c4ffbe95/users/7fb1cef56bf7457b827425db0fa5ba66/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:39.687336 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc45e2-31fc-422f-ae29-2c9951d3d960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8711379781e43069520e492c4ffbe95, user_id=7fb1cef56bf7457b827425db0fa5ba66, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:39.690978 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc45e2-31fc-422f-ae29-2c9951d3d960 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:39.705155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1083/2177] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:39 2022] PUT /identity/v3/projects/d8711379781e43069520e492c4ffbe95/users/7fb1cef56bf7457b827425db0fa5ba66/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:39.715977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af30d-1548-4a46-9979-0214dc1bbdcb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:39.716485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af30d-1548-4a46-9979-0214dc1bbdcb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:39.717932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af30d-1548-4a46-9979-0214dc1bbdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:39.743688 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c07af30d-1548-4a46-9979-0214dc1bbdcb None None] MFA Rules not processed for user `7fb1cef56bf7457b827425db0fa5ba66`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:39.744959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c07af30d-1548-4a46-9979-0214dc1bbdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:39.818493 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1095/2178] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:39.831668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc45e2-31fc-422f-ae29-2c9951d3d960 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:39.833613 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b3fc45e2-31fc-422f-ae29-2c9951d3d960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:39.890412 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc45e2-31fc-422f-ae29-2c9951d3d960 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:39.894230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fc65c-e960-4bb8-89f6-31be7342c9f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:39.894869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fc65c-e960-4bb8-89f6-31be7342c9f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:39.895164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fc65c-e960-4bb8-89f6-31be7342c9f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:39.895435 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fc65c-e960-4bb8-89f6-31be7342c9f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:39.958414 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fc65c-e960-4bb8-89f6-31be7342c9f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:39.959882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fc65c-e960-4bb8-89f6-31be7342c9f1 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:39.968774 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1084/2179] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:42.193895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07af30d-1548-4a46-9979-0214dc1bbdcb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:42.206415 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07af30d-1548-4a46-9979-0214dc1bbdcb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:42.210924 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621a2af-3d28-4b16-a71b-afcf69444a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:42.215976 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621a2af-3d28-4b16-a71b-afcf69444a35 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:42.215976 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621a2af-3d28-4b16-a71b-afcf69444a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:42.215976 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621a2af-3d28-4b16-a71b-afcf69444a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:42.275683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621a2af-3d28-4b16-a71b-afcf69444a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:42.277715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621a2af-3d28-4b16-a71b-afcf69444a35 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:42.287904 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1096/2180] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:42.291663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32c8d7-b24d-4fcb-9b53-5602a9ab8b8a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:42.292150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32c8d7-b24d-4fcb-9b53-5602a9ab8b8a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:42.292414 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32c8d7-b24d-4fcb-9b53-5602a9ab8b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:42.314583 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3f32c8d7-b24d-4fcb-9b53-5602a9ab8b8a None None] MFA Rules not processed for user `baed8aff24b64c788f40e6d7dd1f99c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:42.316210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3f32c8d7-b24d-4fcb-9b53-5602a9ab8b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:42.372479 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1085/2181] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:44.083440 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621a2af-3d28-4b16-a71b-afcf69444a35 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:44.092081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621a2af-3d28-4b16-a71b-afcf69444a35 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:44.096388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c0612-fa8d-45c9-a94b-0f97c9550504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:44.096969 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0612-fa8d-45c9-a94b-0f97c9550504 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:44.097255 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0612-fa8d-45c9-a94b-0f97c9550504 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:44.097565 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0612-fa8d-45c9-a94b-0f97c9550504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:44.109175 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c0612-fa8d-45c9-a94b-0f97c9550504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:44.111412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c0612-fa8d-45c9-a94b-0f97c9550504 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:44.121650 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1097/2182] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:49.221905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32c8d7-b24d-4fcb-9b53-5602a9ab8b8a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:49.334208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32c8d7-b24d-4fcb-9b53-5602a9ab8b8a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:49.340299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbbcf2-9223-413c-a9b9-ee7854459c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:49.340299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbbcf2-9223-413c-a9b9-ee7854459c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:49.340299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbbcf2-9223-413c-a9b9-ee7854459c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:49.340299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbbcf2-9223-413c-a9b9-ee7854459c33 admin admin] PATH_INFO: `/v3/users/e6f587c1067c491c8d1b50eb203e4f3f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:49.341555 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbbcf2-9223-413c-a9b9-ee7854459c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f587c1067c491c8d1b50eb203e4f3f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:49.343496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbbcf2-9223-413c-a9b9-ee7854459c33 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:49.530195 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7cdbbcf2-9223-413c-a9b9-ee7854459c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f587c1067c491c8d1b50eb203e4f3f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:49.611662 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7cdbbcf2-9223-413c-a9b9-ee7854459c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f587c1067c491c8d1b50eb203e4f3f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:49.619546 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7cdbbcf2-9223-413c-a9b9-ee7854459c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f587c1067c491c8d1b50eb203e4f3f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:49.620164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7cdbbcf2-9223-413c-a9b9-ee7854459c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f587c1067c491c8d1b50eb203e4f3f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:49.620817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7cdbbcf2-9223-413c-a9b9-ee7854459c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f587c1067c491c8d1b50eb203e4f3f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:49.638817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1086/2183] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:49 2022] DELETE /identity/v3/users/e6f587c1067c491c8d1b50eb203e4f3f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:49.643309 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee047be-f7dc-42ca-a00d-7db9d2954a7f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:49.649986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee047be-f7dc-42ca-a00d-7db9d2954a7f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:49.649986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee047be-f7dc-42ca-a00d-7db9d2954a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:49.690608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6ee047be-f7dc-42ca-a00d-7db9d2954a7f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:49.691802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6ee047be-f7dc-42ca-a00d-7db9d2954a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:49.747967 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1098/2184] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:49.758072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbbcf2-9223-413c-a9b9-ee7854459c33 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:49.765823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7cdbbcf2-9223-413c-a9b9-ee7854459c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:49.858387 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbbcf2-9223-413c-a9b9-ee7854459c33 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:49.862795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b80c8f-ff1c-4194-a63a-09134ff0dc23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:49.863526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b80c8f-ff1c-4194-a63a-09134ff0dc23 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:49.863811 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b80c8f-ff1c-4194-a63a-09134ff0dc23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:49.864088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b80c8f-ff1c-4194-a63a-09134ff0dc23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:49.873006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b80c8f-ff1c-4194-a63a-09134ff0dc23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:49.874520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b80c8f-ff1c-4194-a63a-09134ff0dc23 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:49.884690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1087/2185] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:50.266690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee047be-f7dc-42ca-a00d-7db9d2954a7f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:50.268401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6ee047be-f7dc-42ca-a00d-7db9d2954a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:50.282006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee047be-f7dc-42ca-a00d-7db9d2954a7f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:50.287742 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:50.289426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:50.289760 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:50.290395 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] PATH_INFO: `/v3/projects/ef22e7dbb6a1456c8fe365d9539a9016` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:50.291641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef22e7dbb6a1456c8fe365d9539a9016)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:50.293870 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:50.333941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b80c8f-ff1c-4194-a63a-09134ff0dc23 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:50.335663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f3b80c8f-ff1c-4194-a63a-09134ff0dc23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:50.348757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b80c8f-ff1c-4194-a63a-09134ff0dc23 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:50.353439 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52dc5f-8299-4ffb-8bf0-86d0d9ea7805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:50.361511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52dc5f-8299-4ffb-8bf0-86d0d9ea7805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:50.361511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52dc5f-8299-4ffb-8bf0-86d0d9ea7805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:50.361511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52dc5f-8299-4ffb-8bf0-86d0d9ea7805 admin admin] PATH_INFO: `/v3/users/b1d05c823fba4b458db0bbcc02dee146` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:50.361511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52dc5f-8299-4ffb-8bf0-86d0d9ea7805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d05c823fba4b458db0bbcc02dee146)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:50.361511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52dc5f-8299-4ffb-8bf0-86d0d9ea7805 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:50.442067 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef22e7dbb6a1456c8fe365d9539a9016', 'request_id': 'req-600cba1f-a1a1-486d-a446-3382f5ade69e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.448162 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef22e7dbb6a1456c8fe365d9539a9016', 'request_id': 'req-600cba1f-a1a1-486d-a446-3382f5ade69e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.454226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef22e7dbb6a1456c8fe365d9539a9016', 'request_id': 'req-600cba1f-a1a1-486d-a446-3382f5ade69e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.538993 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] The token cache is being invalidate because project ef22e7dbb6a1456c8fe365d9539a9016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:50.539288 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.540002 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.541809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1099/2186] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:50 2022] DELETE /identity/v3/projects/ef22e7dbb6a1456c8fe365d9539a9016 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:50.548120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:50.549589 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:50.555879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bb52dc5f-8299-4ffb-8bf0-86d0d9ea7805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d05c823fba4b458db0bbcc02dee146'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.607758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bb52dc5f-8299-4ffb-8bf0-86d0d9ea7805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d05c823fba4b458db0bbcc02dee146'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.611222 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cba1f-a1a1-486d-a446-3382f5ade69e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:50.614901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bb52dc5f-8299-4ffb-8bf0-86d0d9ea7805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d05c823fba4b458db0bbcc02dee146'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.619686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bb52dc5f-8299-4ffb-8bf0-86d0d9ea7805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d05c823fba4b458db0bbcc02dee146'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.619813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dff324-5e5c-4841-94c5-6ec6ee8f8abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:50.619933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-bb52dc5f-8299-4ffb-8bf0-86d0d9ea7805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d05c823fba4b458db0bbcc02dee146'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.620026 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff324-5e5c-4841-94c5-6ec6ee8f8abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:50.620026 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff324-5e5c-4841-94c5-6ec6ee8f8abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:50.620026 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dff324-5e5c-4841-94c5-6ec6ee8f8abc admin admin] PATH_INFO: `/v3/users/63403f717b77402eb114d0f7ade71e04` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:50.620026 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dff324-5e5c-4841-94c5-6ec6ee8f8abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=63403f717b77402eb114d0f7ade71e04)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:50.620619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dff324-5e5c-4841-94c5-6ec6ee8f8abc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:50.632770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1088/2187] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:50 2022] DELETE /identity/v3/users/b1d05c823fba4b458db0bbcc02dee146 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:06:50.637281 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f11155-f384-4a60-b826-4798f0588d08 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:50.637608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f11155-f384-4a60-b826-4798f0588d08 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:50.637890 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f11155-f384-4a60-b826-4798f0588d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:50.655087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-30f11155-f384-4a60-b826-4798f0588d08 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:50.656319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-30f11155-f384-4a60-b826-4798f0588d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:50.714539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1089/2188] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:06:50.724800 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f11155-f384-4a60-b826-4798f0588d08 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:50.727601 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-30f11155-f384-4a60-b826-4798f0588d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:50.776207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b7dff324-5e5c-4841-94c5-6ec6ee8f8abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63403f717b77402eb114d0f7ade71e04'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.783960 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f11155-f384-4a60-b826-4798f0588d08 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:50.784258 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b7dff324-5e5c-4841-94c5-6ec6ee8f8abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63403f717b77402eb114d0f7ade71e04'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.787690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3131681-0671-4457-893f-163c0d59395b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:50.790827 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3131681-0671-4457-893f-163c0d59395b service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:50.790827 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3131681-0671-4457-893f-163c0d59395b service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:50.790827 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3131681-0671-4457-893f-163c0d59395b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:50.798200 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3131681-0671-4457-893f-163c0d59395b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:50.799629 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3131681-0671-4457-893f-163c0d59395b service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:50.808909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1090/2189] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:06:50.845010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b7dff324-5e5c-4841-94c5-6ec6ee8f8abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63403f717b77402eb114d0f7ade71e04'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.845835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b7dff324-5e5c-4841-94c5-6ec6ee8f8abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63403f717b77402eb114d0f7ade71e04'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.846991 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b7dff324-5e5c-4841-94c5-6ec6ee8f8abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63403f717b77402eb114d0f7ade71e04'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:50.865025 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1100/2190] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:50 2022] DELETE /identity/v3/users/63403f717b77402eb114d0f7ade71e04 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:51.311998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3131681-0671-4457-893f-163c0d59395b service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:51.314044 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f3131681-0671-4457-893f-163c0d59395b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:51.328325 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3131681-0671-4457-893f-163c0d59395b service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:51.344432 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dff324-5e5c-4841-94c5-6ec6ee8f8abc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:51.345891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b7dff324-5e5c-4841-94c5-6ec6ee8f8abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:51.391883 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb09f0-02cc-47a4-b607-4db09c4aa104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:51.392677 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb09f0-02cc-47a4-b607-4db09c4aa104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:51.393010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb09f0-02cc-47a4-b607-4db09c4aa104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:51.393294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb09f0-02cc-47a4-b607-4db09c4aa104 admin admin] PATH_INFO: `/v3/projects/051fad711fc84488b9476c577bb0717d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:51.395182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb09f0-02cc-47a4-b607-4db09c4aa104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=051fad711fc84488b9476c577bb0717d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:51.397117 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb09f0-02cc-47a4-b607-4db09c4aa104 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:51.419705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dff324-5e5c-4841-94c5-6ec6ee8f8abc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:51.428968 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:51.430021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:51.430324 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:51.435574 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] PATH_INFO: `/v3/projects/903b72494e5a47b2a99dfdad850827db` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:51.435574 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=903b72494e5a47b2a99dfdad850827db)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:51.435574 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:51.559682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7bdb09f0-02cc-47a4-b607-4db09c4aa104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051fad711fc84488b9476c577bb0717d', 'request_id': 'req-7bdb09f0-02cc-47a4-b607-4db09c4aa104'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:51.561145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7bdb09f0-02cc-47a4-b607-4db09c4aa104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051fad711fc84488b9476c577bb0717d', 'request_id': 'req-7bdb09f0-02cc-47a4-b607-4db09c4aa104'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:51.566683 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7bdb09f0-02cc-47a4-b607-4db09c4aa104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051fad711fc84488b9476c577bb0717d', 'request_id': 'req-7bdb09f0-02cc-47a4-b607-4db09c4aa104'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:51.588249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903b72494e5a47b2a99dfdad850827db', 'request_id': 'req-92c1362d-f9e3-48f7-b305-3d022e919c0f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:51.595004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903b72494e5a47b2a99dfdad850827db', 'request_id': 'req-92c1362d-f9e3-48f7-b305-3d022e919c0f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:51.600609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903b72494e5a47b2a99dfdad850827db', 'request_id': 'req-92c1362d-f9e3-48f7-b305-3d022e919c0f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:51.633332 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7bdb09f0-02cc-47a4-b607-4db09c4aa104 admin admin] The token cache is being invalidate because project 051fad711fc84488b9476c577bb0717d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:51.633722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7bdb09f0-02cc-47a4-b607-4db09c4aa104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:51.634356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7bdb09f0-02cc-47a4-b607-4db09c4aa104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:51.635940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1091/2191] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:51 2022] DELETE /identity/v3/projects/051fad711fc84488b9476c577bb0717d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:51.640668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24686ca3-a7d6-4eb9-b060-8ecb2e80e171 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:51.641164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24686ca3-a7d6-4eb9-b060-8ecb2e80e171 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:51.641447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24686ca3-a7d6-4eb9-b060-8ecb2e80e171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:51.679931 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-24686ca3-a7d6-4eb9-b060-8ecb2e80e171 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:51.681218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-24686ca3-a7d6-4eb9-b060-8ecb2e80e171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:51.704898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] The token cache is being invalidate because project 903b72494e5a47b2a99dfdad850827db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:51.704898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:51.704898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:51.709189 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1101/2192] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:51 2022] DELETE /identity/v3/projects/903b72494e5a47b2a99dfdad850827db => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:06:51.710282 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:51.711663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:51.750798 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1092/2193] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:06:51.757956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069443b6-6891-430a-ab83-0cb51d68919c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:51.758293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069443b6-6891-430a-ab83-0cb51d68919c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:51.758638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069443b6-6891-430a-ab83-0cb51d68919c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:51.777241 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1362d-f9e3-48f7-b305-3d022e919c0f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:51.779388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-069443b6-6891-430a-ab83-0cb51d68919c None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:51.780634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-069443b6-6891-430a-ab83-0cb51d68919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:51.782291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbeb5f-c578-4c98-a7a5-71dfb4b3cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:51.783346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbeb5f-c578-4c98-a7a5-71dfb4b3cd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:51.783707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbeb5f-c578-4c98-a7a5-71dfb4b3cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:51.784054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbeb5f-c578-4c98-a7a5-71dfb4b3cd17 admin admin] PATH_INFO: `/v3/users/7fb1cef56bf7457b827425db0fa5ba66` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:51.785425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbeb5f-c578-4c98-a7a5-71dfb4b3cd17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb1cef56bf7457b827425db0fa5ba66)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:51.787400 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbeb5f-c578-4c98-a7a5-71dfb4b3cd17 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:51.789405 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1093/2194] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:51.793580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069443b6-6891-430a-ab83-0cb51d68919c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:51.803292 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069443b6-6891-430a-ab83-0cb51d68919c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:51.808079 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9f6dc-0460-4fc9-9998-3e9b31537f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:51.808879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9f6dc-0460-4fc9-9998-3e9b31537f2e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:51.809173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9f6dc-0460-4fc9-9998-3e9b31537f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:51.809558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9f6dc-0460-4fc9-9998-3e9b31537f2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:51.810307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9f6dc-0460-4fc9-9998-3e9b31537f2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:06:51.810622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9f6dc-0460-4fc9-9998-3e9b31537f2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:51.812259 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9f6dc-0460-4fc9-9998-3e9b31537f2e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:51.825962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1094/2195] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:06:51.830901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9f6dc-0460-4fc9-9998-3e9b31537f2e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:51.841250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9f6dc-0460-4fc9-9998-3e9b31537f2e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:51.847557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77fbe7-c89b-4676-9ee3-d085837666a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:51.848218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fbe7-c89b-4676-9ee3-d085837666a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:51.848507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fbe7-c89b-4676-9ee3-d085837666a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:51.848785 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fbe7-c89b-4676-9ee3-d085837666a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:51.849522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77fbe7-c89b-4676-9ee3-d085837666a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:51.851454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77fbe7-c89b-4676-9ee3-d085837666a5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:51.957593 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1095/2196] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:51 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:51.961564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77fbe7-c89b-4676-9ee3-d085837666a5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:51.972443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-21dbeb5f-c578-4c98-a7a5-71dfb4b3cd17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb1cef56bf7457b827425db0fa5ba66'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:51.980767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-21dbeb5f-c578-4c98-a7a5-71dfb4b3cd17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb1cef56bf7457b827425db0fa5ba66'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:52.022237 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77fbe7-c89b-4676-9ee3-d085837666a5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:52.026835 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710ae9c-d5e5-4a50-85da-69417a317797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:52.027504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710ae9c-d5e5-4a50-85da-69417a317797 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:52.027790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710ae9c-d5e5-4a50-85da-69417a317797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:52.028067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710ae9c-d5e5-4a50-85da-69417a317797 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:52.028751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710ae9c-d5e5-4a50-85da-69417a317797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:52.030719 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710ae9c-d5e5-4a50-85da-69417a317797 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:52.036653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-21dbeb5f-c578-4c98-a7a5-71dfb4b3cd17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb1cef56bf7457b827425db0fa5ba66'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:52.037837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-21dbeb5f-c578-4c98-a7a5-71dfb4b3cd17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb1cef56bf7457b827425db0fa5ba66'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:52.038464 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-21dbeb5f-c578-4c98-a7a5-71dfb4b3cd17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb1cef56bf7457b827425db0fa5ba66'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:52.057386 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1102/2197] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:51 2022] DELETE /identity/v3/users/7fb1cef56bf7457b827425db0fa5ba66 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:06:52.122864 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1096/2198] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:51 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:52.127552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbeb5f-c578-4c98-a7a5-71dfb4b3cd17 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:52.129000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-21dbeb5f-c578-4c98-a7a5-71dfb4b3cd17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:52.192303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbeb5f-c578-4c98-a7a5-71dfb4b3cd17 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:52.197003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccdc87-6315-4e2f-ae71-16fca9cc8f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:52.197698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccdc87-6315-4e2f-ae71-16fca9cc8f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:52.197985 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccdc87-6315-4e2f-ae71-16fca9cc8f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:52.198263 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccdc87-6315-4e2f-ae71-16fca9cc8f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:52.199017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccdc87-6315-4e2f-ae71-16fca9cc8f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:52.200611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccdc87-6315-4e2f-ae71-16fca9cc8f43 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:52.210198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1103/2199] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:52.214299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710ae9c-d5e5-4a50-85da-69417a317797 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:52.224501 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710ae9c-d5e5-4a50-85da-69417a317797 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:52.229114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36e9fe-3a25-4f06-b09f-dc8ceb5f893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:52.229809 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36e9fe-3a25-4f06-b09f-dc8ceb5f893b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:52.230091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36e9fe-3a25-4f06-b09f-dc8ceb5f893b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:52.230368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36e9fe-3a25-4f06-b09f-dc8ceb5f893b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:52.231094 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36e9fe-3a25-4f06-b09f-dc8ceb5f893b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:52.232700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36e9fe-3a25-4f06-b09f-dc8ceb5f893b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:52.246534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1097/2200] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:52.247763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccdc87-6315-4e2f-ae71-16fca9cc8f43 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:52.258738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccdc87-6315-4e2f-ae71-16fca9cc8f43 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:52.279559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ff136-b027-4da5-b79c-1b7b8a0efc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:52.280421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ff136-b027-4da5-b79c-1b7b8a0efc90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:52.280670 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ff136-b027-4da5-b79c-1b7b8a0efc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:52.280953 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ff136-b027-4da5-b79c-1b7b8a0efc90 admin admin] PATH_INFO: `/v3/projects/63f9bc608c214250accbae10d8060053/users/2ab117280ce24acf95a79495af77489f/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:52.303933 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ff136-b027-4da5-b79c-1b7b8a0efc90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f9bc608c214250accbae10d8060053, user_id=2ab117280ce24acf95a79495af77489f, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:52.306798 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ff136-b027-4da5-b79c-1b7b8a0efc90 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:52.402570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1104/2201] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:52 2022] PUT /identity/v3/projects/63f9bc608c214250accbae10d8060053/users/2ab117280ce24acf95a79495af77489f/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:52.413454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9519b-90f8-4cd5-ba18-db703a14fd9e None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:52.414010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9519b-90f8-4cd5-ba18-db703a14fd9e None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:52.414143 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9519b-90f8-4cd5-ba18-db703a14fd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:52.440299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3db9519b-90f8-4cd5-ba18-db703a14fd9e None None] MFA Rules not processed for user `2ab117280ce24acf95a79495af77489f`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:52.441627 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3db9519b-90f8-4cd5-ba18-db703a14fd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:52.487563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ff136-b027-4da5-b79c-1b7b8a0efc90 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:52.489473 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1b9ff136-b027-4da5-b79c-1b7b8a0efc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:52.509668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1098/2202] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:52.521653 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9519b-90f8-4cd5-ba18-db703a14fd9e None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:52.523036 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3db9519b-90f8-4cd5-ba18-db703a14fd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:52.562095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ff136-b027-4da5-b79c-1b7b8a0efc90 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:52.566870 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bcc93-d071-4da6-b265-208efe071ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:52.567853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bcc93-d071-4da6-b265-208efe071ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:52.568002 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bcc93-d071-4da6-b265-208efe071ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:52.568529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bcc93-d071-4da6-b265-208efe071ba3 admin admin] PATH_INFO: `/v3/projects/d8711379781e43069520e492c4ffbe95` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:52.569463 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bcc93-d071-4da6-b265-208efe071ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8711379781e43069520e492c4ffbe95)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:52.571693 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bcc93-d071-4da6-b265-208efe071ba3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:52.582610 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9519b-90f8-4cd5-ba18-db703a14fd9e None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:52.586563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856c8a0-f797-4e0f-a2cf-2402fd592482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:52.587218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c8a0-f797-4e0f-a2cf-2402fd592482 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:52.587508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c8a0-f797-4e0f-a2cf-2402fd592482 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:52.587790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856c8a0-f797-4e0f-a2cf-2402fd592482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:52.598279 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856c8a0-f797-4e0f-a2cf-2402fd592482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:52.599731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856c8a0-f797-4e0f-a2cf-2402fd592482 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:52.608753 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1099/2203] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:06:52.675490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb4bcc93-d071-4da6-b265-208efe071ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8711379781e43069520e492c4ffbe95', 'request_id': 'req-bb4bcc93-d071-4da6-b265-208efe071ba3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:52.682071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb4bcc93-d071-4da6-b265-208efe071ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8711379781e43069520e492c4ffbe95', 'request_id': 'req-bb4bcc93-d071-4da6-b265-208efe071ba3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:52.687971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb4bcc93-d071-4da6-b265-208efe071ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8711379781e43069520e492c4ffbe95', 'request_id': 'req-bb4bcc93-d071-4da6-b265-208efe071ba3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:52.760003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb4bcc93-d071-4da6-b265-208efe071ba3 admin admin] The token cache is being invalidate because project d8711379781e43069520e492c4ffbe95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:52.760293 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb4bcc93-d071-4da6-b265-208efe071ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:52.760921 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb4bcc93-d071-4da6-b265-208efe071ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:52.762912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1105/2204] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:52 2022] DELETE /identity/v3/projects/d8711379781e43069520e492c4ffbe95 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:52.767535 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d6745-9a36-454f-a163-49cb867b96a4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:52.767828 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d6745-9a36-454f-a163-49cb867b96a4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:52.768135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d6745-9a36-454f-a163-49cb867b96a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:52.786649 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6b1d6745-9a36-454f-a163-49cb867b96a4 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:52.787934 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6b1d6745-9a36-454f-a163-49cb867b96a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:52.847935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1100/2205] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:06:52.855752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade78ac7-58f6-4a06-85e0-88205da72de4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:52.856660 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade78ac7-58f6-4a06-85e0-88205da72de4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:52.857100 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade78ac7-58f6-4a06-85e0-88205da72de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:52.878524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ade78ac7-58f6-4a06-85e0-88205da72de4 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:52.879856 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ade78ac7-58f6-4a06-85e0-88205da72de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:52.888566 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1106/2206] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:52.894152 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d6745-9a36-454f-a163-49cb867b96a4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:52.904126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d6745-9a36-454f-a163-49cb867b96a4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:52.909749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288a794-0dfd-417e-a71f-aebd032f04ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:52.910417 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288a794-0dfd-417e-a71f-aebd032f04ba admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:52.910700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288a794-0dfd-417e-a71f-aebd032f04ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:52.910979 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288a794-0dfd-417e-a71f-aebd032f04ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:52.911700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288a794-0dfd-417e-a71f-aebd032f04ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:06:52.912009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288a794-0dfd-417e-a71f-aebd032f04ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:52.913778 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288a794-0dfd-417e-a71f-aebd032f04ba admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:52.925446 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1101/2207] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:06:52.929904 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade78ac7-58f6-4a06-85e0-88205da72de4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:52.939673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade78ac7-58f6-4a06-85e0-88205da72de4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:52.944557 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a028b6-d28c-442b-86d5-086b1a1dc159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:52.945215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a028b6-d28c-442b-86d5-086b1a1dc159 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:52.945499 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a028b6-d28c-442b-86d5-086b1a1dc159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:52.946358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a028b6-d28c-442b-86d5-086b1a1dc159 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:52.947058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a028b6-d28c-442b-86d5-086b1a1dc159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:52.949002 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a028b6-d28c-442b-86d5-086b1a1dc159 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:53.078883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1107/2208] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:52 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:53.082999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288a794-0dfd-417e-a71f-aebd032f04ba admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:53.093593 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288a794-0dfd-417e-a71f-aebd032f04ba admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:53.150991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1aadf-51fd-4965-bb72-3c58cfc32912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:53.151664 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1aadf-51fd-4965-bb72-3c58cfc32912 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:53.151957 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1aadf-51fd-4965-bb72-3c58cfc32912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:53.152238 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1aadf-51fd-4965-bb72-3c58cfc32912 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:53.152938 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1aadf-51fd-4965-bb72-3c58cfc32912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:53.154912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1aadf-51fd-4965-bb72-3c58cfc32912 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:53.262494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1102/2209] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:53 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:53.268722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a028b6-d28c-442b-86d5-086b1a1dc159 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:53.278913 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a028b6-d28c-442b-86d5-086b1a1dc159 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:53.284158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2ea94-729a-489e-895f-947f9509fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:53.284835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2ea94-729a-489e-895f-947f9509fd6f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:53.285109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2ea94-729a-489e-895f-947f9509fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:53.285378 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2ea94-729a-489e-895f-947f9509fd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:53.286201 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2ea94-729a-489e-895f-947f9509fd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:53.287792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2ea94-729a-489e-895f-947f9509fd6f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:53.300076 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1108/2210] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:53.304080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1aadf-51fd-4965-bb72-3c58cfc32912 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:53.313886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1aadf-51fd-4965-bb72-3c58cfc32912 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:53.318907 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4242ff-c4a4-433c-a9f9-91691d678be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:53.319656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4242ff-c4a4-433c-a9f9-91691d678be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:53.319879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4242ff-c4a4-433c-a9f9-91691d678be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:53.320157 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4242ff-c4a4-433c-a9f9-91691d678be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:53.320948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4242ff-c4a4-433c-a9f9-91691d678be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:53.322733 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4242ff-c4a4-433c-a9f9-91691d678be8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:53.334467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1103/2211] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:53.338549 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2ea94-729a-489e-895f-947f9509fd6f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:53.348817 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2ea94-729a-489e-895f-947f9509fd6f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:53.353626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236b445-fa23-4ca1-8f92-a4ae6a1a14e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:53.354510 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236b445-fa23-4ca1-8f92-a4ae6a1a14e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:53.354790 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236b445-fa23-4ca1-8f92-a4ae6a1a14e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:53.355055 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236b445-fa23-4ca1-8f92-a4ae6a1a14e7 admin admin] PATH_INFO: `/v3/projects/da11afaf25b54912ba9b2922d4720d9c/users/c486e20d4c754aac801da7956fe6ce4a/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:53.369864 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236b445-fa23-4ca1-8f92-a4ae6a1a14e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da11afaf25b54912ba9b2922d4720d9c, user_id=c486e20d4c754aac801da7956fe6ce4a, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:53.372503 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236b445-fa23-4ca1-8f92-a4ae6a1a14e7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:53.510726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1109/2212] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:53 2022] PUT /identity/v3/projects/da11afaf25b54912ba9b2922d4720d9c/users/c486e20d4c754aac801da7956fe6ce4a/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:06:53.522448 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3185227-f973-400e-8a28-0d8c9dad9f31 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:53.522929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3185227-f973-400e-8a28-0d8c9dad9f31 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:53.523031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3185227-f973-400e-8a28-0d8c9dad9f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:53.548764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b3185227-f973-400e-8a28-0d8c9dad9f31 None None] MFA Rules not processed for user `c486e20d4c754aac801da7956fe6ce4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:53.550098 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b3185227-f973-400e-8a28-0d8c9dad9f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:53.611781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1104/2213] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:53.622997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236b445-fa23-4ca1-8f92-a4ae6a1a14e7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:53.624669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1236b445-fa23-4ca1-8f92-a4ae6a1a14e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:53.678769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236b445-fa23-4ca1-8f92-a4ae6a1a14e7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:53.682336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c96cf4-3656-4f51-a66e-3e5a70822aee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:53.682970 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c96cf4-3656-4f51-a66e-3e5a70822aee service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:53.683251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c96cf4-3656-4f51-a66e-3e5a70822aee service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:53.683522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c96cf4-3656-4f51-a66e-3e5a70822aee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:53.691955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c96cf4-3656-4f51-a66e-3e5a70822aee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:53.693366 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c96cf4-3656-4f51-a66e-3e5a70822aee service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:53.701865 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1110/2214] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:56.469945 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15655d4-ca3b-434b-b61f-d7916b0687e5 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:56.472939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15655d4-ca3b-434b-b61f-d7916b0687e5 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:56.472939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15655d4-ca3b-434b-b61f-d7916b0687e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:56.506937 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a15655d4-ca3b-434b-b61f-d7916b0687e5 None None] MFA Rules not processed for user `74d61067c8034b6cb80bec103bc404a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:56.508395 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a15655d4-ca3b-434b-b61f-d7916b0687e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:56.582067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1105/2215] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:06:56.786326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c96cf4-3656-4f51-a66e-3e5a70822aee service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:56.940383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c96cf4-3656-4f51-a66e-3e5a70822aee service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:56.948667 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2da50b-533c-4951-9dbc-db38dc4b1826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:56.949932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2da50b-533c-4951-9dbc-db38dc4b1826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:56.950245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2da50b-533c-4951-9dbc-db38dc4b1826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:56.950577 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2da50b-533c-4951-9dbc-db38dc4b1826 admin admin] PATH_INFO: `/v3/users/c486e20d4c754aac801da7956fe6ce4a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:56.952180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2da50b-533c-4951-9dbc-db38dc4b1826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c486e20d4c754aac801da7956fe6ce4a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:56.954193 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2da50b-533c-4951-9dbc-db38dc4b1826 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:57.177757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e2da50b-533c-4951-9dbc-db38dc4b1826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c486e20d4c754aac801da7956fe6ce4a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:57.185274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e2da50b-533c-4951-9dbc-db38dc4b1826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c486e20d4c754aac801da7956fe6ce4a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:57.273714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e2da50b-533c-4951-9dbc-db38dc4b1826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c486e20d4c754aac801da7956fe6ce4a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:57.275206 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e2da50b-533c-4951-9dbc-db38dc4b1826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c486e20d4c754aac801da7956fe6ce4a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:57.276775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e2da50b-533c-4951-9dbc-db38dc4b1826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c486e20d4c754aac801da7956fe6ce4a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:57.303335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1111/2216] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:06:56 2022] DELETE /identity/v3/users/c486e20d4c754aac801da7956fe6ce4a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:06:57.303666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65ffb-6eb3-47c9-b554-836a8eda16cd None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:57.304030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65ffb-6eb3-47c9-b554-836a8eda16cd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:57.304355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed65ffb-6eb3-47c9-b554-836a8eda16cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:57.323634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0ed65ffb-6eb3-47c9-b554-836a8eda16cd None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:57.324921 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0ed65ffb-6eb3-47c9-b554-836a8eda16cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:57.428542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1106/2217] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:06:57.439948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2da50b-533c-4951-9dbc-db38dc4b1826 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:57.441665 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5e2da50b-533c-4951-9dbc-db38dc4b1826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:57.602030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2da50b-533c-4951-9dbc-db38dc4b1826 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:57.605729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a21c4d-e0a6-4564-9396-7b53570dd9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:57.606392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a21c4d-e0a6-4564-9396-7b53570dd9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:57.606680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a21c4d-e0a6-4564-9396-7b53570dd9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:57.606949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a21c4d-e0a6-4564-9396-7b53570dd9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:57.626157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a21c4d-e0a6-4564-9396-7b53570dd9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:57.636069 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a21c4d-e0a6-4564-9396-7b53570dd9f4 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:57.642837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1112/2218] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:06:58.382949 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed65ffb-6eb3-47c9-b554-836a8eda16cd None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:58.385205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0ed65ffb-6eb3-47c9-b554-836a8eda16cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:58.398322 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed65ffb-6eb3-47c9-b554-836a8eda16cd None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:58.405810 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7038295-74c8-41f1-8c98-08d6e9255197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:58.406743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7038295-74c8-41f1-8c98-08d6e9255197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:58.406952 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7038295-74c8-41f1-8c98-08d6e9255197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:58.408351 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7038295-74c8-41f1-8c98-08d6e9255197 admin admin] PATH_INFO: `/v3/projects/da11afaf25b54912ba9b2922d4720d9c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:58.409043 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7038295-74c8-41f1-8c98-08d6e9255197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da11afaf25b54912ba9b2922d4720d9c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:58.412444 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7038295-74c8-41f1-8c98-08d6e9255197 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:58.567708 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7038295-74c8-41f1-8c98-08d6e9255197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da11afaf25b54912ba9b2922d4720d9c', 'request_id': 'req-e7038295-74c8-41f1-8c98-08d6e9255197'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:58.579146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7038295-74c8-41f1-8c98-08d6e9255197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da11afaf25b54912ba9b2922d4720d9c', 'request_id': 'req-e7038295-74c8-41f1-8c98-08d6e9255197'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:58.589858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7038295-74c8-41f1-8c98-08d6e9255197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da11afaf25b54912ba9b2922d4720d9c', 'request_id': 'req-e7038295-74c8-41f1-8c98-08d6e9255197'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:58.689018 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7038295-74c8-41f1-8c98-08d6e9255197 admin admin] The token cache is being invalidate because project da11afaf25b54912ba9b2922d4720d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:06:58.689502 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7038295-74c8-41f1-8c98-08d6e9255197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:58.691404 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7038295-74c8-41f1-8c98-08d6e9255197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:06:58.694904 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1107/2219] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:06:58 2022] DELETE /identity/v3/projects/da11afaf25b54912ba9b2922d4720d9c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:58.699108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44470143-edd2-437d-897c-5b0196d5055e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:58.699668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44470143-edd2-437d-897c-5b0196d5055e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:58.699668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44470143-edd2-437d-897c-5b0196d5055e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:58.735076 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-44470143-edd2-437d-897c-5b0196d5055e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:58.735775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-44470143-edd2-437d-897c-5b0196d5055e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:58.843944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1113/2220] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:58.852304 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1232394-2e64-4211-9bdc-a6aa039af34f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:58.852600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1232394-2e64-4211-9bdc-a6aa039af34f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:58.852882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1232394-2e64-4211-9bdc-a6aa039af34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:58.888476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e1232394-2e64-4211-9bdc-a6aa039af34f None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:58.889778 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e1232394-2e64-4211-9bdc-a6aa039af34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:58.903097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1108/2221] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:58.905982 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44470143-edd2-437d-897c-5b0196d5055e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:58.917304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44470143-edd2-437d-897c-5b0196d5055e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:58.922639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688732b-4824-4d27-b2c2-4d9959cd2d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:58.923883 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688732b-4824-4d27-b2c2-4d9959cd2d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:58.924395 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688732b-4824-4d27-b2c2-4d9959cd2d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:58.924971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688732b-4824-4d27-b2c2-4d9959cd2d6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:58.926039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688732b-4824-4d27-b2c2-4d9959cd2d6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:06:58.926360 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688732b-4824-4d27-b2c2-4d9959cd2d6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:58.928292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688732b-4824-4d27-b2c2-4d9959cd2d6f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:58.948024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1114/2222] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:06:58.952742 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1232394-2e64-4211-9bdc-a6aa039af34f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:58.977013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1232394-2e64-4211-9bdc-a6aa039af34f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:59.009137 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72dc33-354f-471d-ad41-f53d5aae53ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:59.010456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72dc33-354f-471d-ad41-f53d5aae53ea admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:59.013602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72dc33-354f-471d-ad41-f53d5aae53ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:59.013602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72dc33-354f-471d-ad41-f53d5aae53ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:59.013602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72dc33-354f-471d-ad41-f53d5aae53ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:59.017135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72dc33-354f-471d-ad41-f53d5aae53ea admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:59.127108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607037fc-61f8-4739-a6a7-a43948c8d501 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:59.127495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607037fc-61f8-4739-a6a7-a43948c8d501 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:59.130972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607037fc-61f8-4739-a6a7-a43948c8d501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:59.146937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-607037fc-61f8-4739-a6a7-a43948c8d501 None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:59.148147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-607037fc-61f8-4739-a6a7-a43948c8d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:59.172054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1109/2223] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:06:58 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:06:59.176185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72dc33-354f-471d-ad41-f53d5aae53ea admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:59.205843 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1115/2224] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 21:06:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:06:59.238560 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72dc33-354f-471d-ad41-f53d5aae53ea admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:59.244052 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a4e8c-dadb-42ec-a14e-fa5217426827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:59.244979 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a4e8c-dadb-42ec-a14e-fa5217426827 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:59.245432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a4e8c-dadb-42ec-a14e-fa5217426827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:59.245902 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a4e8c-dadb-42ec-a14e-fa5217426827 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:59.247070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a4e8c-dadb-42ec-a14e-fa5217426827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:59.249431 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a4e8c-dadb-42ec-a14e-fa5217426827 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:59.252160 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607037fc-61f8-4739-a6a7-a43948c8d501 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:59.253904 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-607037fc-61f8-4739-a6a7-a43948c8d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:59.349869 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607037fc-61f8-4739-a6a7-a43948c8d501 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:59.356833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1110/2225] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:06:59 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:06:59.359146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a4e8c-dadb-42ec-a14e-fa5217426827 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:59.383784 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a4e8c-dadb-42ec-a14e-fa5217426827 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:59.399033 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef64f64-2fae-4bdc-9a32-2e126dbe1fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:59.403421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef64f64-2fae-4bdc-9a32-2e126dbe1fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:59.403421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef64f64-2fae-4bdc-9a32-2e126dbe1fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:59.403421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef64f64-2fae-4bdc-9a32-2e126dbe1fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:59.403421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef64f64-2fae-4bdc-9a32-2e126dbe1fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:59.403421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef64f64-2fae-4bdc-9a32-2e126dbe1fe9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:59.419837 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1111/2226] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:59.421298 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef64f64-2fae-4bdc-9a32-2e126dbe1fe9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:59.429991 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a5062-1bae-41eb-b6b8-3a61a7e9d9af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:59.431765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a5062-1bae-41eb-b6b8-3a61a7e9d9af service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:59.431765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a5062-1bae-41eb-b6b8-3a61a7e9d9af service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:59.431765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a5062-1bae-41eb-b6b8-3a61a7e9d9af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:59.459689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef64f64-2fae-4bdc-9a32-2e126dbe1fe9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:59.483118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3cd1e-c70d-4742-a7f9-6672f039a4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:59.485088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3cd1e-c70d-4742-a7f9-6672f039a4aa admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:59.485548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3cd1e-c70d-4742-a7f9-6672f039a4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:59.486998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3cd1e-c70d-4742-a7f9-6672f039a4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:59.488637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3cd1e-c70d-4742-a7f9-6672f039a4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:59.492060 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3cd1e-c70d-4742-a7f9-6672f039a4aa admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:59.504920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a5062-1bae-41eb-b6b8-3a61a7e9d9af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:59.507912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a5062-1bae-41eb-b6b8-3a61a7e9d9af service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:59.520875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1112/2227] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:06:59.525391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3cd1e-c70d-4742-a7f9-6672f039a4aa admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:59.530708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1116/2228] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:06:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 21:06:59.543669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3cd1e-c70d-4742-a7f9-6672f039a4aa admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:06:59.552030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4bb28-486e-4404-9754-af6c2aaa804f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:06:59.553744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4bb28-486e-4404-9754-af6c2aaa804f admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:59.554192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4bb28-486e-4404-9754-af6c2aaa804f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:59.554623 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4bb28-486e-4404-9754-af6c2aaa804f admin admin] PATH_INFO: `/v3/projects/01e4db40dfe440a297c5e817963ff06b/users/a829579e474f40bab9d7314010d20d71/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:59.578777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4bb28-486e-4404-9754-af6c2aaa804f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e4db40dfe440a297c5e817963ff06b, user_id=a829579e474f40bab9d7314010d20d71, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:06:59.584046 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4bb28-486e-4404-9754-af6c2aaa804f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:06:59.686327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1113/2229] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:06:59 2022] PUT /identity/v3/projects/01e4db40dfe440a297c5e817963ff06b/users/a829579e474f40bab9d7314010d20d71/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:06:59.699815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e41e9-a3e3-4469-bf93-52f4827a5ab9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:06:59.700339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e41e9-a3e3-4469-bf93-52f4827a5ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:06:59.700339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e41e9-a3e3-4469-bf93-52f4827a5ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:06:59.734283 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e66e41e9-a3e3-4469-bf93-52f4827a5ab9 None None] MFA Rules not processed for user `a829579e474f40bab9d7314010d20d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:06:59.735826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e66e41e9-a3e3-4469-bf93-52f4827a5ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:06:59.868133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1117/2230] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:06:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:06:59.884645 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4bb28-486e-4404-9754-af6c2aaa804f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:06:59.886687 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-56d4bb28-486e-4404-9754-af6c2aaa804f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:00.077599 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4bb28-486e-4404-9754-af6c2aaa804f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:00.083832 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cc49c-96bc-4f8f-88a1-89b9ebcab315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:00.084853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cc49c-96bc-4f8f-88a1-89b9ebcab315 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:00.085355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cc49c-96bc-4f8f-88a1-89b9ebcab315 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:00.085948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cc49c-96bc-4f8f-88a1-89b9ebcab315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:00.121845 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cc49c-96bc-4f8f-88a1-89b9ebcab315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:00.123589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cc49c-96bc-4f8f-88a1-89b9ebcab315 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:00.151879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1114/2231] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:06:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:07:17.179323 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e41e9-a3e3-4469-bf93-52f4827a5ab9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:17.251372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e41e9-a3e3-4469-bf93-52f4827a5ab9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:17.256116 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd1cc-1f24-41fe-8269-9e09e3a7816c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:17.257015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd1cc-1f24-41fe-8269-9e09e3a7816c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:17.261676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd1cc-1f24-41fe-8269-9e09e3a7816c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:17.261676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd1cc-1f24-41fe-8269-9e09e3a7816c admin admin] PATH_INFO: `/v3/users/a829579e474f40bab9d7314010d20d71` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:17.261676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bd1cc-1f24-41fe-8269-9e09e3a7816c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a829579e474f40bab9d7314010d20d71)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:17.261676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bd1cc-1f24-41fe-8269-9e09e3a7816c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:17.470482 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-df4bd1cc-1f24-41fe-8269-9e09e3a7816c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a829579e474f40bab9d7314010d20d71'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:17.487878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-df4bd1cc-1f24-41fe-8269-9e09e3a7816c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a829579e474f40bab9d7314010d20d71'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:17.561783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-df4bd1cc-1f24-41fe-8269-9e09e3a7816c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a829579e474f40bab9d7314010d20d71'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:17.562631 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-df4bd1cc-1f24-41fe-8269-9e09e3a7816c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a829579e474f40bab9d7314010d20d71'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:17.563298 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-df4bd1cc-1f24-41fe-8269-9e09e3a7816c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a829579e474f40bab9d7314010d20d71'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:17.595131 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1118/2232] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:07:17 2022] DELETE /identity/v3/users/a829579e474f40bab9d7314010d20d71 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:07:17.599463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa26c8-e736-46ca-aa58-f7e7e735a890 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:17.600023 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa26c8-e736-46ca-aa58-f7e7e735a890 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:17.600023 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa26c8-e736-46ca-aa58-f7e7e735a890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:17.617764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-13fa26c8-e736-46ca-aa58-f7e7e735a890 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:07:17.618906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-13fa26c8-e736-46ca-aa58-f7e7e735a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:17.698171 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1115/2233] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:07:17.709563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd1cc-1f24-41fe-8269-9e09e3a7816c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:17.710998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-df4bd1cc-1f24-41fe-8269-9e09e3a7816c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:17.777556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd1cc-1f24-41fe-8269-9e09e3a7816c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:17.781939 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a305e-037b-48fb-9270-b096a651cbbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:17.782665 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a305e-037b-48fb-9270-b096a651cbbe service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:17.782954 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a305e-037b-48fb-9270-b096a651cbbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:17.783230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a305e-037b-48fb-9270-b096a651cbbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:17.792917 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a305e-037b-48fb-9270-b096a651cbbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:17.795162 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a305e-037b-48fb-9270-b096a651cbbe service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:17.805010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1119/2234] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:07:18.522149 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa26c8-e736-46ca-aa58-f7e7e735a890 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:18.523958 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-13fa26c8-e736-46ca-aa58-f7e7e735a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:18.540473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa26c8-e736-46ca-aa58-f7e7e735a890 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:18.546227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816281e-dcfc-41db-ba09-2aa9a2c6849f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:18.556349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816281e-dcfc-41db-ba09-2aa9a2c6849f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:18.556671 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816281e-dcfc-41db-ba09-2aa9a2c6849f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:18.556952 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816281e-dcfc-41db-ba09-2aa9a2c6849f admin admin] PATH_INFO: `/v3/projects/01e4db40dfe440a297c5e817963ff06b` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:18.558524 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816281e-dcfc-41db-ba09-2aa9a2c6849f admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e4db40dfe440a297c5e817963ff06b)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:18.560556 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816281e-dcfc-41db-ba09-2aa9a2c6849f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:18.716036 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1816281e-dcfc-41db-ba09-2aa9a2c6849f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e4db40dfe440a297c5e817963ff06b', 'request_id': 'req-1816281e-dcfc-41db-ba09-2aa9a2c6849f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:18.727327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1816281e-dcfc-41db-ba09-2aa9a2c6849f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e4db40dfe440a297c5e817963ff06b', 'request_id': 'req-1816281e-dcfc-41db-ba09-2aa9a2c6849f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:18.743192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1816281e-dcfc-41db-ba09-2aa9a2c6849f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e4db40dfe440a297c5e817963ff06b', 'request_id': 'req-1816281e-dcfc-41db-ba09-2aa9a2c6849f'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:18.851921 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1816281e-dcfc-41db-ba09-2aa9a2c6849f admin admin] The token cache is being invalidate because project 01e4db40dfe440a297c5e817963ff06b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:07:18.852281 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1816281e-dcfc-41db-ba09-2aa9a2c6849f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:18.853004 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-1816281e-dcfc-41db-ba09-2aa9a2c6849f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:18.854667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1116/2235] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:07:18 2022] DELETE /identity/v3/projects/01e4db40dfe440a297c5e817963ff06b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:07:18.859891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20b3c-34b7-46a5-9587-ea7e314132ea None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:18.860394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20b3c-34b7-46a5-9587-ea7e314132ea None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:18.860529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20b3c-34b7-46a5-9587-ea7e314132ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:18.895113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bee20b3c-34b7-46a5-9587-ea7e314132ea None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:07:18.896822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bee20b3c-34b7-46a5-9587-ea7e314132ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:18.963788 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1120/2236] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:07:18.972227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb8399-302f-4276-a878-3c220f053f37 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:18.972520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb8399-302f-4276-a878-3c220f053f37 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:18.972800 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb8399-302f-4276-a878-3c220f053f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:18.991362 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-50cb8399-302f-4276-a878-3c220f053f37 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:07:18.992574 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-50cb8399-302f-4276-a878-3c220f053f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:19.001447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1117/2237] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:07:19.010394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee20b3c-34b7-46a5-9587-ea7e314132ea None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:19.022178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee20b3c-34b7-46a5-9587-ea7e314132ea None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:19.027080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360b810-76a0-4c0f-964a-c3ba77b3d86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:19.027741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b810-76a0-4c0f-964a-c3ba77b3d86c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:19.028024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b810-76a0-4c0f-964a-c3ba77b3d86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:19.028297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b810-76a0-4c0f-964a-c3ba77b3d86c admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:19.029019 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360b810-76a0-4c0f-964a-c3ba77b3d86c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:07:19.029325 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360b810-76a0-4c0f-964a-c3ba77b3d86c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:19.031132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360b810-76a0-4c0f-964a-c3ba77b3d86c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:19.051848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1121/2238] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:07:19.056372 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb8399-302f-4276-a878-3c220f053f37 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:19.066772 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb8399-302f-4276-a878-3c220f053f37 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:19.071561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074383e6-a506-442f-9c5a-68953bf22fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:19.072432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074383e6-a506-442f-9c5a-68953bf22fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:19.072786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074383e6-a506-442f-9c5a-68953bf22fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:19.073133 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074383e6-a506-442f-9c5a-68953bf22fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:19.073951 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074383e6-a506-442f-9c5a-68953bf22fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:19.077036 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074383e6-a506-442f-9c5a-68953bf22fa4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:19.190033 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1118/2239] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:07:19 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:07:19.194200 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360b810-76a0-4c0f-964a-c3ba77b3d86c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:19.204628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360b810-76a0-4c0f-964a-c3ba77b3d86c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:19.264319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d393e-85ce-4343-9f87-d3500c9e3c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:19.265003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d393e-85ce-4343-9f87-d3500c9e3c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:19.265283 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d393e-85ce-4343-9f87-d3500c9e3c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:19.265553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d393e-85ce-4343-9f87-d3500c9e3c58 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:19.266876 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d393e-85ce-4343-9f87-d3500c9e3c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:19.268772 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d393e-85ce-4343-9f87-d3500c9e3c58 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:19.384348 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1122/2240] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:07:19 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:07:19.388530 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074383e6-a506-442f-9c5a-68953bf22fa4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:19.399869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074383e6-a506-442f-9c5a-68953bf22fa4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:19.404471 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0809f8-9f06-4d59-b52f-f8d88fca1ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:19.405135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0809f8-9f06-4d59-b52f-f8d88fca1ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:19.405512 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0809f8-9f06-4d59-b52f-f8d88fca1ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:19.406087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0809f8-9f06-4d59-b52f-f8d88fca1ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:19.406859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0809f8-9f06-4d59-b52f-f8d88fca1ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:19.408460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0809f8-9f06-4d59-b52f-f8d88fca1ac0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:19.420136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1119/2241] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:07:19.424313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d393e-85ce-4343-9f87-d3500c9e3c58 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:19.434857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d393e-85ce-4343-9f87-d3500c9e3c58 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:19.440281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b926207-3686-478a-b4e3-d546c5b059c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:19.440942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926207-3686-478a-b4e3-d546c5b059c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:19.441230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926207-3686-478a-b4e3-d546c5b059c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:19.441513 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b926207-3686-478a-b4e3-d546c5b059c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:19.442272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b926207-3686-478a-b4e3-d546c5b059c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:19.443897 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b926207-3686-478a-b4e3-d546c5b059c0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:19.454751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1123/2242] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:07:19.459288 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0809f8-9f06-4d59-b52f-f8d88fca1ac0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:19.469321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0809f8-9f06-4d59-b52f-f8d88fca1ac0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:19.474020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7523c17-b20d-4941-ba57-d2644646149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:19.474930 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7523c17-b20d-4941-ba57-d2644646149f admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:19.475215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7523c17-b20d-4941-ba57-d2644646149f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:19.475582 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7523c17-b20d-4941-ba57-d2644646149f admin admin] PATH_INFO: `/v3/projects/31585e8d8c2b4eb0b052b30e2ce5fa63/users/3a47bfbd0a2e459cabaa30d74f45811a/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:19.491584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7523c17-b20d-4941-ba57-d2644646149f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31585e8d8c2b4eb0b052b30e2ce5fa63, user_id=3a47bfbd0a2e459cabaa30d74f45811a, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:19.494343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7523c17-b20d-4941-ba57-d2644646149f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:19.572043 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1120/2243] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:07:19 2022] PUT /identity/v3/projects/31585e8d8c2b4eb0b052b30e2ce5fa63/users/3a47bfbd0a2e459cabaa30d74f45811a/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:07:19.576772 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fcd7b-cb19-405b-9959-859ebac70d24 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:19.577065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fcd7b-cb19-405b-9959-859ebac70d24 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:19.577349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fcd7b-cb19-405b-9959-859ebac70d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:19.595607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a57fcd7b-cb19-405b-9959-859ebac70d24 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:07:19.596811 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a57fcd7b-cb19-405b-9959-859ebac70d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:19.659927 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1124/2244] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:07:19.670237 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7523c17-b20d-4941-ba57-d2644646149f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:19.671935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d7523c17-b20d-4941-ba57-d2644646149f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:19.727003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7523c17-b20d-4941-ba57-d2644646149f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:19.730673 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f82e25-feb8-4029-aab0-c508f65476e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:19.731313 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82e25-feb8-4029-aab0-c508f65476e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:19.731642 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82e25-feb8-4029-aab0-c508f65476e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:19.731924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f82e25-feb8-4029-aab0-c508f65476e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:19.741933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f82e25-feb8-4029-aab0-c508f65476e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:19.743439 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f82e25-feb8-4029-aab0-c508f65476e0 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:19.755562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1121/2245] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:07:20.690715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7bc76-a2a9-464d-87ba-45995c70231f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:20.691219 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7bc76-a2a9-464d-87ba-45995c70231f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:20.691304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7bc76-a2a9-464d-87ba-45995c70231f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:20.692831 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1125/2246] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 11 21:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:07:20.700114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f96bc-d5ac-4fe2-84ff-d4593c1cafba None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:20.700866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f96bc-d5ac-4fe2-84ff-d4593c1cafba None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:20.701199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f96bc-d5ac-4fe2-84ff-d4593c1cafba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:20.789763 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-989f96bc-d5ac-4fe2-84ff-d4593c1cafba None None] MFA Rules not processed for user `f400b94d3fbc40bdace4860fe83a0891`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:07:20.791035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-989f96bc-d5ac-4fe2-84ff-d4593c1cafba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:20.881576 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1122/2247] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 11 21:07:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:07:20.898618 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7bc76-a2a9-464d-87ba-45995c70231f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:20.900385 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d7f7bc76-a2a9-464d-87ba-45995c70231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:20.962305 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7bc76-a2a9-464d-87ba-45995c70231f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:20.966397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1776d89-b112-465c-920f-fb298adee2a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce12ee27315460793dfedd294eb3c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:20.967054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776d89-b112-465c-920f-fb298adee2a9 service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:20.967365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776d89-b112-465c-920f-fb298adee2a9 service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:20.967621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776d89-b112-465c-920f-fb298adee2a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:20.981339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1776d89-b112-465c-920f-fb298adee2a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:20.983491 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1776d89-b112-465c-920f-fb298adee2a9 service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:20.995825 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1126/2248] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:07:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:07:21.265441 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d552c39-bd75-4f0c-af3b-6e92ecd029b2 None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:21.267036 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d552c39-bd75-4f0c-af3b-6e92ecd029b2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:21.267566 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d552c39-bd75-4f0c-af3b-6e92ecd029b2 None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:21.269764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1123/2249] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 11 21:07:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:07:21.289257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb03b0b-cf75-4542-b198-ca6cdf141f2a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:21.292998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb03b0b-cf75-4542-b198-ca6cdf141f2a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:21.292998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb03b0b-cf75-4542-b198-ca6cdf141f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:21.321555 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-feb03b0b-cf75-4542-b198-ca6cdf141f2a None None] MFA Rules not processed for user `8aa998f15cd543338cd0fc8b5a501066`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:07:21.322971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-feb03b0b-cf75-4542-b198-ca6cdf141f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:21.331279 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1127/2250] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 11 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:07:21.344150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d552c39-bd75-4f0c-af3b-6e92ecd029b2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:21.347171 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9d552c39-bd75-4f0c-af3b-6e92ecd029b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:21.362626 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d552c39-bd75-4f0c-af3b-6e92ecd029b2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:21.366795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894023a8-0767-44bd-998e-b5fdac9e7c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:21.367783 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894023a8-0767-44bd-998e-b5fdac9e7c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:21.368068 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894023a8-0767-44bd-998e-b5fdac9e7c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:21.368369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894023a8-0767-44bd-998e-b5fdac9e7c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:21.376202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894023a8-0767-44bd-998e-b5fdac9e7c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:21.377619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894023a8-0767-44bd-998e-b5fdac9e7c1b service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:21.387538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1124/2251] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:07:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:07:21.567562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9988a2-c935-4c7b-9f42-fe489bef366b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:21.568223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9988a2-c935-4c7b-9f42-fe489bef366b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:21.568387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9988a2-c935-4c7b-9f42-fe489bef366b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:21.570043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1128/2252] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 11 21:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:07:21.575879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659aaad-3729-490e-8239-972cacc2a4c0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:21.576382 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659aaad-3729-490e-8239-972cacc2a4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:21.576659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659aaad-3729-490e-8239-972cacc2a4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:21.601209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6659aaad-3729-490e-8239-972cacc2a4c0 None None] MFA Rules not processed for user `f400b94d3fbc40bdace4860fe83a0891`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:07:21.602749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6659aaad-3729-490e-8239-972cacc2a4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:21.616167 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1125/2253] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 11 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:07:21.634717 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9988a2-c935-4c7b-9f42-fe489bef366b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:21.647932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9988a2-c935-4c7b-9f42-fe489bef366b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:21.653656 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f618b7-5e7c-4306-93e6-23fb23170b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:21.654320 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f618b7-5e7c-4306-93e6-23fb23170b22 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:21.654605 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f618b7-5e7c-4306-93e6-23fb23170b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:21.654884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f618b7-5e7c-4306-93e6-23fb23170b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:21.668222 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f618b7-5e7c-4306-93e6-23fb23170b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:21.670628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f618b7-5e7c-4306-93e6-23fb23170b22 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:21.682478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1129/2254] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:07:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:07:26.820869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ffb5f-d6b3-4579-a4a3-b1bba9092596 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:26.821359 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ffb5f-d6b3-4579-a4a3-b1bba9092596 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:26.821655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ffb5f-d6b3-4579-a4a3-b1bba9092596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:26.857144 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-854ffb5f-d6b3-4579-a4a3-b1bba9092596 None None] MFA Rules not processed for user `3a47bfbd0a2e459cabaa30d74f45811a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:07:26.858677 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-854ffb5f-d6b3-4579-a4a3-b1bba9092596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:26.927040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1126/2255] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:07:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:07:26.931430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f618b7-5e7c-4306-93e6-23fb23170b22 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:26.941982 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f618b7-5e7c-4306-93e6-23fb23170b22 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:26.946471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4b765-1dda-40dc-bfdf-3ccb3a4e5d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:26.947117 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4b765-1dda-40dc-bfdf-3ccb3a4e5d51 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:26.947397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4b765-1dda-40dc-bfdf-3ccb3a4e5d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:26.947669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4b765-1dda-40dc-bfdf-3ccb3a4e5d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:26.948358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4b765-1dda-40dc-bfdf-3ccb3a4e5d51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:26.950349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4b765-1dda-40dc-bfdf-3ccb3a4e5d51 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:27.034639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1130/2256] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:07:26 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:07:27.039100 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ffb5f-d6b3-4579-a4a3-b1bba9092596 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:27.050994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ffb5f-d6b3-4579-a4a3-b1bba9092596 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:27.106192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8842de9-b61a-41bb-8f80-cd9575c32b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:27.106867 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8842de9-b61a-41bb-8f80-cd9575c32b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:27.107150 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8842de9-b61a-41bb-8f80-cd9575c32b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:27.107428 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8842de9-b61a-41bb-8f80-cd9575c32b7d admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:27.108110 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8842de9-b61a-41bb-8f80-cd9575c32b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:27.110070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8842de9-b61a-41bb-8f80-cd9575c32b7d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:27.215873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1127/2257] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:07:27 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:07:27.220401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4b765-1dda-40dc-bfdf-3ccb3a4e5d51 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:27.231795 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4b765-1dda-40dc-bfdf-3ccb3a4e5d51 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:27.237239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e1f21-7439-4faf-835a-ac6bec929be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:27.237936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e1f21-7439-4faf-835a-ac6bec929be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:27.238219 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e1f21-7439-4faf-835a-ac6bec929be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:27.238496 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e1f21-7439-4faf-835a-ac6bec929be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:27.239260 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e1f21-7439-4faf-835a-ac6bec929be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:27.240863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e1f21-7439-4faf-835a-ac6bec929be4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:27.254773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1131/2258] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:07:27.259373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8842de9-b61a-41bb-8f80-cd9575c32b7d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:27.271094 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8842de9-b61a-41bb-8f80-cd9575c32b7d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:27.275734 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9e3c3-2da2-48a2-8219-daa17b23434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:27.276641 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9e3c3-2da2-48a2-8219-daa17b23434b admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:27.276921 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9e3c3-2da2-48a2-8219-daa17b23434b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:27.277193 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9e3c3-2da2-48a2-8219-daa17b23434b admin admin] PATH_INFO: `/v3/projects/386fab40624d4318a27dcfa1379427f7/users/055822c3fe864c548bedc59bd7e3edea/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:27.292491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9e3c3-2da2-48a2-8219-daa17b23434b admin admin] RBAC: Authorizing `identity:create_grant(project_id=386fab40624d4318a27dcfa1379427f7, user_id=055822c3fe864c548bedc59bd7e3edea, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:27.295373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9e3c3-2da2-48a2-8219-daa17b23434b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:27.369926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1128/2259] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:07:27 2022] PUT /identity/v3/projects/386fab40624d4318a27dcfa1379427f7/users/055822c3fe864c548bedc59bd7e3edea/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:07:27.373834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e1f21-7439-4faf-835a-ac6bec929be4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:27.384255 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e1f21-7439-4faf-835a-ac6bec929be4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:27.441639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baca34-5d98-42c9-9353-c9b29909b854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:27.448184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baca34-5d98-42c9-9353-c9b29909b854 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:27.448184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baca34-5d98-42c9-9353-c9b29909b854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:27.448184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baca34-5d98-42c9-9353-c9b29909b854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:27.448184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baca34-5d98-42c9-9353-c9b29909b854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:27.448184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baca34-5d98-42c9-9353-c9b29909b854 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:27.456327 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1132/2260] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:07:27.460310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9e3c3-2da2-48a2-8219-daa17b23434b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:27.471803 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9e3c3-2da2-48a2-8219-daa17b23434b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:27.480100 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cade8c2-7ca5-460d-a003-a9c4d8bcda39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:27.481192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cade8c2-7ca5-460d-a003-a9c4d8bcda39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:27.481480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cade8c2-7ca5-460d-a003-a9c4d8bcda39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:27.481791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cade8c2-7ca5-460d-a003-a9c4d8bcda39 admin admin] PATH_INFO: `/v3/projects/386fab40624d4318a27dcfa1379427f7/users/055822c3fe864c548bedc59bd7e3edea/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:27.483903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cade8c2-7ca5-460d-a003-a9c4d8bcda39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386fab40624d4318a27dcfa1379427f7, user_id=055822c3fe864c548bedc59bd7e3edea, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:27.487453 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cade8c2-7ca5-460d-a003-a9c4d8bcda39 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:27.498145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1129/2261] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:07:27 2022] PUT /identity/v3/projects/386fab40624d4318a27dcfa1379427f7/users/055822c3fe864c548bedc59bd7e3edea/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:07:30.038676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e66632-d02e-4a06-b4c4-a4386bc2c1cc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:30.039235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e66632-d02e-4a06-b4c4-a4386bc2c1cc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:30.039235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e66632-d02e-4a06-b4c4-a4386bc2c1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:30.106712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-60e66632-d02e-4a06-b4c4-a4386bc2c1cc None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:07:30.108352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-60e66632-d02e-4a06-b4c4-a4386bc2c1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:30.236222 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1133/2262] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 21:07:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:07:30.250942 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cade8c2-7ca5-460d-a003-a9c4d8bcda39 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:30.253909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2cade8c2-7ca5-460d-a003-a9c4d8bcda39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:30.342020 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cade8c2-7ca5-460d-a003-a9c4d8bcda39 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:30.348279 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e30f9f-4796-4b63-9d31-c795ad729f51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:30.349218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30f9f-4796-4b63-9d31-c795ad729f51 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:30.349878 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30f9f-4796-4b63-9d31-c795ad729f51 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:30.350317 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30f9f-4796-4b63-9d31-c795ad729f51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:30.362700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e30f9f-4796-4b63-9d31-c795ad729f51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:30.364548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e30f9f-4796-4b63-9d31-c795ad729f51 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:30.378291 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1130/2263] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:07:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 21:07:31.088611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b080990-e572-4245-9670-eae50d84dbe8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:31.089553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b080990-e572-4245-9670-eae50d84dbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:31.090019 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b080990-e572-4245-9670-eae50d84dbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:31.113441 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5b080990-e572-4245-9670-eae50d84dbe8 None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:07:31.117716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5b080990-e572-4245-9670-eae50d84dbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:31.136014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1134/2264] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 21:07:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:07:31.168649 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e30f9f-4796-4b63-9d31-c795ad729f51 service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:31.184651 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e30f9f-4796-4b63-9d31-c795ad729f51 service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:31.192328 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1a155-55fd-44da-9294-732510d230c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:31.192793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1a155-55fd-44da-9294-732510d230c2 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:31.193137 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1a155-55fd-44da-9294-732510d230c2 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:31.196200 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1a155-55fd-44da-9294-732510d230c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:31.211411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1a155-55fd-44da-9294-732510d230c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:31.218006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1a155-55fd-44da-9294-732510d230c2 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:31.246332 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1131/2265] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:07:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 21:07:37.426655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ffcc-98eb-422d-8066-e7031ed55735 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:37.427223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ffcc-98eb-422d-8066-e7031ed55735 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:37.427223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4ffcc-98eb-422d-8066-e7031ed55735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:37.464140 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a1b4ffcc-98eb-422d-8066-e7031ed55735 None None] MFA Rules not processed for user `055822c3fe864c548bedc59bd7e3edea`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:07:37.465653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a1b4ffcc-98eb-422d-8066-e7031ed55735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:37.586211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1135/2266] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:07:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:07:37.608704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1a155-55fd-44da-9294-732510d230c2 service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:37.612016 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-aed1a155-55fd-44da-9294-732510d230c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:37.802101 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1a155-55fd-44da-9294-732510d230c2 service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:37.810704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d119966-0dba-47aa-85fa-3448d9671c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:37.811925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119966-0dba-47aa-85fa-3448d9671c64 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:37.812469 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119966-0dba-47aa-85fa-3448d9671c64 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:37.813096 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119966-0dba-47aa-85fa-3448d9671c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:37.953638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d119966-0dba-47aa-85fa-3448d9671c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:37.958587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d119966-0dba-47aa-85fa-3448d9671c64 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:37.990444 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1132/2267] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:07:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:07:40.574393 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4ffcc-98eb-422d-8066-e7031ed55735 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:40.576221 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a1b4ffcc-98eb-422d-8066-e7031ed55735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:40.676242 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4ffcc-98eb-422d-8066-e7031ed55735 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:40.682510 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f44662-569c-459f-9fb8-73f73f6bd446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:40.685308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f44662-569c-459f-9fb8-73f73f6bd446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:40.685308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f44662-569c-459f-9fb8-73f73f6bd446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:40.685308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f44662-569c-459f-9fb8-73f73f6bd446 admin admin] PATH_INFO: `/v3/users/2ab117280ce24acf95a79495af77489f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:40.685308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f44662-569c-459f-9fb8-73f73f6bd446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab117280ce24acf95a79495af77489f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:40.687591 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f44662-569c-459f-9fb8-73f73f6bd446 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:40.883359 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-08f44662-569c-459f-9fb8-73f73f6bd446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab117280ce24acf95a79495af77489f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:40.898063 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-08f44662-569c-459f-9fb8-73f73f6bd446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab117280ce24acf95a79495af77489f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:41.017412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-08f44662-569c-459f-9fb8-73f73f6bd446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab117280ce24acf95a79495af77489f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:41.018641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-08f44662-569c-459f-9fb8-73f73f6bd446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab117280ce24acf95a79495af77489f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:41.020473 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-08f44662-569c-459f-9fb8-73f73f6bd446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab117280ce24acf95a79495af77489f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:41.064675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1136/2268] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:07:40 2022] DELETE /identity/v3/users/2ab117280ce24acf95a79495af77489f => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:07:41.069863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d33a-daff-437e-be93-d480c5beaea7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:41.070886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d33a-daff-437e-be93-d480c5beaea7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:41.071736 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d33a-daff-437e-be93-d480c5beaea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:41.103605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-61a5d33a-daff-437e-be93-d480c5beaea7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:07:41.106928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-61a5d33a-daff-437e-be93-d480c5beaea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:41.448198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1133/2269] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:07:41.476854 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f44662-569c-459f-9fb8-73f73f6bd446 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:41.478521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-08f44662-569c-459f-9fb8-73f73f6bd446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:41.658701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f44662-569c-459f-9fb8-73f73f6bd446 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:41.668246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078b825-6073-4fe2-b363-047d44938eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:41.672125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078b825-6073-4fe2-b363-047d44938eae service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:41.672125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078b825-6073-4fe2-b363-047d44938eae service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:41.672125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078b825-6073-4fe2-b363-047d44938eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:41.689217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078b825-6073-4fe2-b363-047d44938eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:41.695141 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078b825-6073-4fe2-b363-047d44938eae service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:41.716073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1137/2270] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:07:42.636073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5d33a-daff-437e-be93-d480c5beaea7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:42.638147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-61a5d33a-daff-437e-be93-d480c5beaea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:42.673418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5d33a-daff-437e-be93-d480c5beaea7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:42.694704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1dc66-af0d-49e2-923b-cc954c0bc76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:42.701072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1dc66-af0d-49e2-923b-cc954c0bc76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:42.701271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1dc66-af0d-49e2-923b-cc954c0bc76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:42.701670 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1dc66-af0d-49e2-923b-cc954c0bc76a admin admin] PATH_INFO: `/v3/projects/63f9bc608c214250accbae10d8060053` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:42.705288 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1dc66-af0d-49e2-923b-cc954c0bc76a admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f9bc608c214250accbae10d8060053)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:42.707666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1dc66-af0d-49e2-923b-cc954c0bc76a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:43.225321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-00c1dc66-af0d-49e2-923b-cc954c0bc76a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f9bc608c214250accbae10d8060053', 'request_id': 'req-00c1dc66-af0d-49e2-923b-cc954c0bc76a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:43.249128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-00c1dc66-af0d-49e2-923b-cc954c0bc76a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f9bc608c214250accbae10d8060053', 'request_id': 'req-00c1dc66-af0d-49e2-923b-cc954c0bc76a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:43.284035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-00c1dc66-af0d-49e2-923b-cc954c0bc76a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f9bc608c214250accbae10d8060053', 'request_id': 'req-00c1dc66-af0d-49e2-923b-cc954c0bc76a'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:43.385447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-00c1dc66-af0d-49e2-923b-cc954c0bc76a admin admin] The token cache is being invalidate because project 63f9bc608c214250accbae10d8060053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:07:43.385979 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-00c1dc66-af0d-49e2-923b-cc954c0bc76a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:43.389354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-00c1dc66-af0d-49e2-923b-cc954c0bc76a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:43.392751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1134/2271] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:07:42 2022] DELETE /identity/v3/projects/63f9bc608c214250accbae10d8060053 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:07:50.011493 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078b825-6073-4fe2-b363-047d44938eae service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:50.013235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0078b825-6073-4fe2-b363-047d44938eae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:50.137840 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078b825-6073-4fe2-b363-047d44938eae service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:50.202049 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04507617-74b0-481a-a6a6-ecfa927c3b26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59cb32d2807549699e37b27ca97d351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:50.202802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04507617-74b0-481a-a6a6-ecfa927c3b26 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:50.203219 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04507617-74b0-481a-a6a6-ecfa927c3b26 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:50.203962 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04507617-74b0-481a-a6a6-ecfa927c3b26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:50.206390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-04507617-74b0-481a-a6a6-ecfa927c3b26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:50.219056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04507617-74b0-481a-a6a6-ecfa927c3b26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:50.223302 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04507617-74b0-481a-a6a6-ecfa927c3b26 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:50.232083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1138/2272] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:07:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:07:55.682074 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdea9dc-2657-47c1-af85-2d334c6803fe None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:55.682641 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdea9dc-2657-47c1-af85-2d334c6803fe None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:55.682748 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdea9dc-2657-47c1-af85-2d334c6803fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:55.734048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-efdea9dc-2657-47c1-af85-2d334c6803fe None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:07:55.735266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-efdea9dc-2657-47c1-af85-2d334c6803fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:55.802169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1135/2273] 10.222.0.35 () {58 vars in 967 bytes} [Wed May 11 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:07:55.815944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04507617-74b0-481a-a6a6-ecfa927c3b26 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:55.817454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-04507617-74b0-481a-a6a6-ecfa927c3b26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:55.913260 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04507617-74b0-481a-a6a6-ecfa927c3b26 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:55.919203 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1d8e6-1b10-47b0-89cc-aa33379a6dc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:55.919958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1d8e6-1b10-47b0-89cc-aa33379a6dc1 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:55.920242 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1d8e6-1b10-47b0-89cc-aa33379a6dc1 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:55.920518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1d8e6-1b10-47b0-89cc-aa33379a6dc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:55.929318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1d8e6-1b10-47b0-89cc-aa33379a6dc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:55.931069 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1d8e6-1b10-47b0-89cc-aa33379a6dc1 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:55.939925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1139/2274] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:07:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 21:07:58.130449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3c186-1590-4bc7-82fe-9b2d5821bf88 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:58.130926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3c186-1590-4bc7-82fe-9b2d5821bf88 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:58.131012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3c186-1590-4bc7-82fe-9b2d5821bf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:58.150868 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6df3c186-1590-4bc7-82fe-9b2d5821bf88 None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:07:58.152717 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6df3c186-1590-4bc7-82fe-9b2d5821bf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:58.159982 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1136/2275] 10.222.0.35 () {58 vars in 967 bytes} [Wed May 11 21:07:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:07:58.173562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1d8e6-1b10-47b0-89cc-aa33379a6dc1 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:58.186130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1d8e6-1b10-47b0-89cc-aa33379a6dc1 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:58.191790 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a8608-d8a4-4be6-b248-ddac6ef5ea59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:58.192425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a8608-d8a4-4be6-b248-ddac6ef5ea59 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:58.192711 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a8608-d8a4-4be6-b248-ddac6ef5ea59 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:58.192987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a8608-d8a4-4be6-b248-ddac6ef5ea59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:58.200888 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a8608-d8a4-4be6-b248-ddac6ef5ea59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:58.203273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a8608-d8a4-4be6-b248-ddac6ef5ea59 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:58.211287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1140/2276] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:07:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 21:07:59.393739 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3c186-1590-4bc7-82fe-9b2d5821bf88 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:07:59.395216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6df3c186-1590-4bc7-82fe-9b2d5821bf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:07:59.465294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3c186-1590-4bc7-82fe-9b2d5821bf88 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:07:59.470894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9ea06-f49d-4c9f-8c17-04c02fbffc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:07:59.472054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9ea06-f49d-4c9f-8c17-04c02fbffc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:07:59.472337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9ea06-f49d-4c9f-8c17-04c02fbffc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:07:59.472763 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9ea06-f49d-4c9f-8c17-04c02fbffc8c admin admin] PATH_INFO: `/v3/users/74d61067c8034b6cb80bec103bc404a0` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:07:59.474321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9ea06-f49d-4c9f-8c17-04c02fbffc8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d61067c8034b6cb80bec103bc404a0)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:07:59.476543 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9ea06-f49d-4c9f-8c17-04c02fbffc8c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:07:59.647230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e2f9ea06-f49d-4c9f-8c17-04c02fbffc8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d61067c8034b6cb80bec103bc404a0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:59.718626 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e2f9ea06-f49d-4c9f-8c17-04c02fbffc8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d61067c8034b6cb80bec103bc404a0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:59.726169 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e2f9ea06-f49d-4c9f-8c17-04c02fbffc8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d61067c8034b6cb80bec103bc404a0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:59.729454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e2f9ea06-f49d-4c9f-8c17-04c02fbffc8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d61067c8034b6cb80bec103bc404a0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:59.729454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e2f9ea06-f49d-4c9f-8c17-04c02fbffc8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d61067c8034b6cb80bec103bc404a0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:07:59.743910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1137/2277] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:07:59 2022] DELETE /identity/v3/users/74d61067c8034b6cb80bec103bc404a0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:07:59.987349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a8608-d8a4-4be6-b248-ddac6ef5ea59 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:00.001211 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a8608-d8a4-4be6-b248-ddac6ef5ea59 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:00.060099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e4372-ebe6-463f-8606-4a11181f80da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:00.060956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e4372-ebe6-463f-8606-4a11181f80da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:00.061245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e4372-ebe6-463f-8606-4a11181f80da admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:00.061548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e4372-ebe6-463f-8606-4a11181f80da admin admin] PATH_INFO: `/v3/projects/98ca4d11f5b5459a93b0f97cbfcdc3a2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:00.063240 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e4372-ebe6-463f-8606-4a11181f80da admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ca4d11f5b5459a93b0f97cbfcdc3a2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:00.065155 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e4372-ebe6-463f-8606-4a11181f80da admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:00.162932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c25e4372-ebe6-463f-8606-4a11181f80da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'request_id': 'req-c25e4372-ebe6-463f-8606-4a11181f80da'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:00.169319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c25e4372-ebe6-463f-8606-4a11181f80da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'request_id': 'req-c25e4372-ebe6-463f-8606-4a11181f80da'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:00.175567 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c25e4372-ebe6-463f-8606-4a11181f80da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ca4d11f5b5459a93b0f97cbfcdc3a2', 'request_id': 'req-c25e4372-ebe6-463f-8606-4a11181f80da'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:00.255796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c25e4372-ebe6-463f-8606-4a11181f80da admin admin] The token cache is being invalidate because project 98ca4d11f5b5459a93b0f97cbfcdc3a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:08:00.256138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c25e4372-ebe6-463f-8606-4a11181f80da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:00.256802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c25e4372-ebe6-463f-8606-4a11181f80da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:00.258605 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1141/2278] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:07:59 2022] DELETE /identity/v3/projects/98ca4d11f5b5459a93b0f97cbfcdc3a2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:08:00.263620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee8b42-f4ca-450d-9aeb-0247f19319b8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:00.263924 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee8b42-f4ca-450d-9aeb-0247f19319b8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:00.264253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee8b42-f4ca-450d-9aeb-0247f19319b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:00.283155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-42ee8b42-f4ca-450d-9aeb-0247f19319b8 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:08:00.288588 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-42ee8b42-f4ca-450d-9aeb-0247f19319b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:00.353958 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1138/2279] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:08:00.362070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36698-bd9c-46a9-88d1-5c0669fe62a4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:00.362363 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36698-bd9c-46a9-88d1-5c0669fe62a4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:00.362641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36698-bd9c-46a9-88d1-5c0669fe62a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:00.382094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e3a36698-bd9c-46a9-88d1-5c0669fe62a4 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:08:00.383316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e3a36698-bd9c-46a9-88d1-5c0669fe62a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:00.392014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1142/2280] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:08:00.396622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee8b42-f4ca-450d-9aeb-0247f19319b8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:00.407005 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee8b42-f4ca-450d-9aeb-0247f19319b8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:00.412113 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86d86a-6a17-4997-87f0-70f55925ba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:00.412777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d86a-6a17-4997-87f0-70f55925ba0f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:00.413067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d86a-6a17-4997-87f0-70f55925ba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:00.413345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d86a-6a17-4997-87f0-70f55925ba0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:00.417394 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86d86a-6a17-4997-87f0-70f55925ba0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:08:00.417394 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86d86a-6a17-4997-87f0-70f55925ba0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:00.417394 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86d86a-6a17-4997-87f0-70f55925ba0f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:00.429438 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1139/2281] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:08:00.433723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36698-bd9c-46a9-88d1-5c0669fe62a4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:00.443297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36698-bd9c-46a9-88d1-5c0669fe62a4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:00.448442 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70591b-75d7-440b-9bd4-6e9e3315dd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:00.449097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70591b-75d7-440b-9bd4-6e9e3315dd7e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:00.449383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70591b-75d7-440b-9bd4-6e9e3315dd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:00.449699 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70591b-75d7-440b-9bd4-6e9e3315dd7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:00.450415 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70591b-75d7-440b-9bd4-6e9e3315dd7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:00.452304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e70591b-75d7-440b-9bd4-6e9e3315dd7e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:00.557662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1143/2282] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:08:00 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:08:00.562411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86d86a-6a17-4997-87f0-70f55925ba0f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:00.573790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86d86a-6a17-4997-87f0-70f55925ba0f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:00.644982 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900606a-22f4-44ac-9c28-ff3d90d86178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:00.645698 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900606a-22f4-44ac-9c28-ff3d90d86178 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:00.645987 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900606a-22f4-44ac-9c28-ff3d90d86178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:00.646532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900606a-22f4-44ac-9c28-ff3d90d86178 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:00.647219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900606a-22f4-44ac-9c28-ff3d90d86178 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:00.649207 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900606a-22f4-44ac-9c28-ff3d90d86178 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:00.741754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1140/2283] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:08:00 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:08:00.746047 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70591b-75d7-440b-9bd4-6e9e3315dd7e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:00.756675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70591b-75d7-440b-9bd4-6e9e3315dd7e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:00.761438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ae91c-f081-4995-811f-92e30e945314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:00.762144 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ae91c-f081-4995-811f-92e30e945314 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:00.766776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ae91c-f081-4995-811f-92e30e945314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:00.766776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ae91c-f081-4995-811f-92e30e945314 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:00.766776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ae91c-f081-4995-811f-92e30e945314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:00.766776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447ae91c-f081-4995-811f-92e30e945314 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:00.776628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1144/2284] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:08:00.780643 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900606a-22f4-44ac-9c28-ff3d90d86178 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:00.790766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900606a-22f4-44ac-9c28-ff3d90d86178 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:00.795484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7177f6-e1f2-4270-9137-efa0c30507a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:00.796207 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7177f6-e1f2-4270-9137-efa0c30507a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:00.796496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7177f6-e1f2-4270-9137-efa0c30507a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:00.796776 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7177f6-e1f2-4270-9137-efa0c30507a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:00.797498 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7177f6-e1f2-4270-9137-efa0c30507a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:00.799143 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7177f6-e1f2-4270-9137-efa0c30507a5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:00.809471 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1141/2285] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:08:00.814148 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ae91c-f081-4995-811f-92e30e945314 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:00.824425 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ae91c-f081-4995-811f-92e30e945314 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:00.829637 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6688a-42fe-4a11-b99f-5522b25865e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:00.830511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6688a-42fe-4a11-b99f-5522b25865e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:00.830815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6688a-42fe-4a11-b99f-5522b25865e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:00.831180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6688a-42fe-4a11-b99f-5522b25865e9 admin admin] PATH_INFO: `/v3/projects/7324dc311ddf4ba088e88fad6d17f905/users/5c98e92413d34ef5b0349a74a9e5ca0d/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:00.846813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6688a-42fe-4a11-b99f-5522b25865e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7324dc311ddf4ba088e88fad6d17f905, user_id=5c98e92413d34ef5b0349a74a9e5ca0d, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:00.849925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6688a-42fe-4a11-b99f-5522b25865e9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:00.928381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1145/2286] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:08:00 2022] PUT /identity/v3/projects/7324dc311ddf4ba088e88fad6d17f905/users/5c98e92413d34ef5b0349a74a9e5ca0d/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:08:00.939496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed97480-1a6e-4693-8d58-8cd77763d390 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:00.939789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed97480-1a6e-4693-8d58-8cd77763d390 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:00.940072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed97480-1a6e-4693-8d58-8cd77763d390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:00.969182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4ed97480-1a6e-4693-8d58-8cd77763d390 None None] MFA Rules not processed for user `5c98e92413d34ef5b0349a74a9e5ca0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:08:00.970497 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4ed97480-1a6e-4693-8d58-8cd77763d390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:01.035752 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1142/2287] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:08:01.047618 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6688a-42fe-4a11-b99f-5522b25865e9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:01.049368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ccf6688a-42fe-4a11-b99f-5522b25865e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:01.128936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6688a-42fe-4a11-b99f-5522b25865e9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:01.132623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64505dda-eba6-4b7b-83fa-7b6ecfd504e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce12ee27315460793dfedd294eb3c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:01.133285 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505dda-eba6-4b7b-83fa-7b6ecfd504e0 service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:01.133570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505dda-eba6-4b7b-83fa-7b6ecfd504e0 service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:01.133849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505dda-eba6-4b7b-83fa-7b6ecfd504e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:01.142831 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64505dda-eba6-4b7b-83fa-7b6ecfd504e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:01.144452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64505dda-eba6-4b7b-83fa-7b6ecfd504e0 service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:01.153851 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1146/2288] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:08:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:08:02.713978 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73d8cc-caf1-45a5-a48c-5b1c5b787b05 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:02.714591 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73d8cc-caf1-45a5-a48c-5b1c5b787b05 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:02.714591 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73d8cc-caf1-45a5-a48c-5b1c5b787b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:02.732514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fe73d8cc-caf1-45a5-a48c-5b1c5b787b05 None None] MFA Rules not processed for user `df9d6a9b73e64e31b014b5809912bbe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:08:02.734381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fe73d8cc-caf1-45a5-a48c-5b1c5b787b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:02.788275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1143/2289] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:08:08.007422 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1553-95c8-465d-99ed-dcdc7901c621 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:08.007916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1553-95c8-465d-99ed-dcdc7901c621 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:08.008020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc1553-95c8-465d-99ed-dcdc7901c621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:08.027106 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cdcc1553-95c8-465d-99ed-dcdc7901c621 None None] MFA Rules not processed for user `3a47bfbd0a2e459cabaa30d74f45811a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:08:08.028324 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cdcc1553-95c8-465d-99ed-dcdc7901c621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:08.085086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1147/2290] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:08:35.285998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a974a0-f9ec-447d-8618-095cd900b69a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:35.286531 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a974a0-f9ec-447d-8618-095cd900b69a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:35.286635 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a974a0-f9ec-447d-8618-095cd900b69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:35.303843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e4a974a0-f9ec-447d-8618-095cd900b69a None None] MFA Rules not processed for user `baed8aff24b64c788f40e6d7dd1f99c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:08:35.305048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e4a974a0-f9ec-447d-8618-095cd900b69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:35.357210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1144/2291] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:08:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:08:37.298486 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc1553-95c8-465d-99ed-dcdc7901c621 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:37.299999 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cdcc1553-95c8-465d-99ed-dcdc7901c621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:37.358534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc1553-95c8-465d-99ed-dcdc7901c621 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:37.362310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dc78c-359b-4e1f-bf26-74d8f1f947f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:37.366529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dc78c-359b-4e1f-bf26-74d8f1f947f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:37.366529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dc78c-359b-4e1f-bf26-74d8f1f947f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:37.366529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dc78c-359b-4e1f-bf26-74d8f1f947f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:37.366529 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bf7dc78c-359b-4e1f-bf26-74d8f1f947f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:37.428221 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dc78c-359b-4e1f-bf26-74d8f1f947f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:37.429733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dc78c-359b-4e1f-bf26-74d8f1f947f6 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:37.439700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1148/2292] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:08:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:08:40.980188 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a974a0-f9ec-447d-8618-095cd900b69a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:41.048768 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a974a0-f9ec-447d-8618-095cd900b69a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:41.053464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463de1d-4869-447f-80a8-d738b6475fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:41.054674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463de1d-4869-447f-80a8-d738b6475fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:41.055285 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463de1d-4869-447f-80a8-d738b6475fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:41.055936 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463de1d-4869-447f-80a8-d738b6475fa6 admin admin] PATH_INFO: `/v3/users/5c98e92413d34ef5b0349a74a9e5ca0d` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:41.058156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463de1d-4869-447f-80a8-d738b6475fa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c98e92413d34ef5b0349a74a9e5ca0d)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:41.060656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463de1d-4869-447f-80a8-d738b6475fa6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:41.268633 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5463de1d-4869-447f-80a8-d738b6475fa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c98e92413d34ef5b0349a74a9e5ca0d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:41.356761 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5463de1d-4869-447f-80a8-d738b6475fa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c98e92413d34ef5b0349a74a9e5ca0d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:41.365626 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5463de1d-4869-447f-80a8-d738b6475fa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c98e92413d34ef5b0349a74a9e5ca0d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:41.366961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5463de1d-4869-447f-80a8-d738b6475fa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c98e92413d34ef5b0349a74a9e5ca0d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:41.368539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5463de1d-4869-447f-80a8-d738b6475fa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c98e92413d34ef5b0349a74a9e5ca0d'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:41.390629 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1145/2293] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:08:40 2022] DELETE /identity/v3/users/5c98e92413d34ef5b0349a74a9e5ca0d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:08:41.395986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e31f1-7beb-4ab6-b0d8-decc82a91a71 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:41.396541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e31f1-7beb-4ab6-b0d8-decc82a91a71 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:41.396541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e31f1-7beb-4ab6-b0d8-decc82a91a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:41.416938 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9a8e31f1-7beb-4ab6-b0d8-decc82a91a71 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:08:41.418485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9a8e31f1-7beb-4ab6-b0d8-decc82a91a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:41.493574 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1149/2294] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:08:41.502031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463de1d-4869-447f-80a8-d738b6475fa6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:41.503732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5463de1d-4869-447f-80a8-d738b6475fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:41.570233 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463de1d-4869-447f-80a8-d738b6475fa6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:41.574182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241dabc-c0ce-431f-88b8-52b18d5bfdf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:41.574908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241dabc-c0ce-431f-88b8-52b18d5bfdf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:41.575317 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241dabc-c0ce-431f-88b8-52b18d5bfdf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:41.575661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241dabc-c0ce-431f-88b8-52b18d5bfdf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:41.586540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241dabc-c0ce-431f-88b8-52b18d5bfdf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:41.588133 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241dabc-c0ce-431f-88b8-52b18d5bfdf4 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:41.599686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1146/2295] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:08:42.051506 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e31f1-7beb-4ab6-b0d8-decc82a91a71 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:42.053284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9a8e31f1-7beb-4ab6-b0d8-decc82a91a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:42.065586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e31f1-7beb-4ab6-b0d8-decc82a91a71 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:42.070089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252fdb1-6542-4490-89a1-65fa281be2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:42.070946 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252fdb1-6542-4490-89a1-65fa281be2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:42.071226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252fdb1-6542-4490-89a1-65fa281be2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:42.071494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252fdb1-6542-4490-89a1-65fa281be2a1 admin admin] PATH_INFO: `/v3/projects/7324dc311ddf4ba088e88fad6d17f905` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:42.072669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252fdb1-6542-4490-89a1-65fa281be2a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7324dc311ddf4ba088e88fad6d17f905)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:42.074604 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252fdb1-6542-4490-89a1-65fa281be2a1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:42.231963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6252fdb1-6542-4490-89a1-65fa281be2a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7324dc311ddf4ba088e88fad6d17f905', 'request_id': 'req-6252fdb1-6542-4490-89a1-65fa281be2a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:42.238751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6252fdb1-6542-4490-89a1-65fa281be2a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7324dc311ddf4ba088e88fad6d17f905', 'request_id': 'req-6252fdb1-6542-4490-89a1-65fa281be2a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:42.243925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6252fdb1-6542-4490-89a1-65fa281be2a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7324dc311ddf4ba088e88fad6d17f905', 'request_id': 'req-6252fdb1-6542-4490-89a1-65fa281be2a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:42.322899 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6252fdb1-6542-4490-89a1-65fa281be2a1 admin admin] The token cache is being invalidate because project 7324dc311ddf4ba088e88fad6d17f905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:08:42.323182 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6252fdb1-6542-4490-89a1-65fa281be2a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:42.323792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6252fdb1-6542-4490-89a1-65fa281be2a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:08:42.325365 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1150/2296] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:08:42 2022] DELETE /identity/v3/projects/7324dc311ddf4ba088e88fad6d17f905 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:08:42.330379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660458c6-9fa4-4ea5-b56a-d79de505fbb6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:42.330847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660458c6-9fa4-4ea5-b56a-d79de505fbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:42.330943 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660458c6-9fa4-4ea5-b56a-d79de505fbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:42.348042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-660458c6-9fa4-4ea5-b56a-d79de505fbb6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:08:42.350065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-660458c6-9fa4-4ea5-b56a-d79de505fbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:42.406724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1147/2297] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:08:42.415136 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da495782-903a-4ddc-b17b-899bc946c996 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:42.418899 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da495782-903a-4ddc-b17b-899bc946c996 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:42.418899 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da495782-903a-4ddc-b17b-899bc946c996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:42.434416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-da495782-903a-4ddc-b17b-899bc946c996 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:08:42.435591 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-da495782-903a-4ddc-b17b-899bc946c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:42.443370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1151/2298] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:08:42.447398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660458c6-9fa4-4ea5-b56a-d79de505fbb6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:42.456819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660458c6-9fa4-4ea5-b56a-d79de505fbb6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:42.461505 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3af67-c981-47e0-834a-fcf100319470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:42.462734 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3af67-c981-47e0-834a-fcf100319470 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:42.462734 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3af67-c981-47e0-834a-fcf100319470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:42.462921 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3af67-c981-47e0-834a-fcf100319470 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:42.463503 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3af67-c981-47e0-834a-fcf100319470 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:08:42.463810 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3af67-c981-47e0-834a-fcf100319470 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:42.465429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3af67-c981-47e0-834a-fcf100319470 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:42.477122 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1148/2299] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:08:42.481225 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da495782-903a-4ddc-b17b-899bc946c996 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:42.494945 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da495782-903a-4ddc-b17b-899bc946c996 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:42.495826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd20af7-76ca-4688-946d-9f7846cb78d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:42.496494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd20af7-76ca-4688-946d-9f7846cb78d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:42.496778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd20af7-76ca-4688-946d-9f7846cb78d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:42.497059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd20af7-76ca-4688-946d-9f7846cb78d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:42.497792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd20af7-76ca-4688-946d-9f7846cb78d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:42.499728 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd20af7-76ca-4688-946d-9f7846cb78d0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:42.632055 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1152/2300] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:08:42 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:08:42.636311 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3af67-c981-47e0-834a-fcf100319470 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:42.647164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3af67-c981-47e0-834a-fcf100319470 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:42.702425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6c853-d927-4707-aba2-917c5f6597b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:42.703130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6c853-d927-4707-aba2-917c5f6597b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:42.703441 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6c853-d927-4707-aba2-917c5f6597b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:42.703718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6c853-d927-4707-aba2-917c5f6597b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:42.704760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6c853-d927-4707-aba2-917c5f6597b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:42.706737 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6c853-d927-4707-aba2-917c5f6597b4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:42.813231 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1149/2301] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:08:42 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:08:42.817783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd20af7-76ca-4688-946d-9f7846cb78d0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:42.827980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd20af7-76ca-4688-946d-9f7846cb78d0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:42.833452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f24e9b-4302-4030-be96-339014633ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:42.834193 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f24e9b-4302-4030-be96-339014633ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:42.834481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f24e9b-4302-4030-be96-339014633ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:42.834810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f24e9b-4302-4030-be96-339014633ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:42.835491 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f24e9b-4302-4030-be96-339014633ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:42.837128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f24e9b-4302-4030-be96-339014633ed6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:42.848693 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1153/2302] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:08:42.852660 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6c853-d927-4707-aba2-917c5f6597b4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:42.862717 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6c853-d927-4707-aba2-917c5f6597b4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:42.867378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13138807-57dc-4965-bb8a-d0b71321e40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:42.868047 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13138807-57dc-4965-bb8a-d0b71321e40e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:42.868330 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13138807-57dc-4965-bb8a-d0b71321e40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:42.868605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13138807-57dc-4965-bb8a-d0b71321e40e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:42.869340 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13138807-57dc-4965-bb8a-d0b71321e40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:42.870956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13138807-57dc-4965-bb8a-d0b71321e40e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:42.880798 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1150/2303] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:08:42.885243 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f24e9b-4302-4030-be96-339014633ed6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:42.895924 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f24e9b-4302-4030-be96-339014633ed6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:42.901164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135adb7-bdde-4fb1-8330-b69b1c7eda01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:42.902214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135adb7-bdde-4fb1-8330-b69b1c7eda01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:42.902602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135adb7-bdde-4fb1-8330-b69b1c7eda01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:42.903428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135adb7-bdde-4fb1-8330-b69b1c7eda01 admin admin] PATH_INFO: `/v3/projects/5a2c60193ec94c6ea7d7247efe9fc087/users/042459bc6511428aad3faedd436ee565/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:42.919355 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135adb7-bdde-4fb1-8330-b69b1c7eda01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2c60193ec94c6ea7d7247efe9fc087, user_id=042459bc6511428aad3faedd436ee565, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:42.922021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135adb7-bdde-4fb1-8330-b69b1c7eda01 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:43.004373 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1154/2304] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:08:42 2022] PUT /identity/v3/projects/5a2c60193ec94c6ea7d7247efe9fc087/users/042459bc6511428aad3faedd436ee565/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:08:43.014686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ed0e7-756b-46f7-8c55-2049f5b09942 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:43.014984 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ed0e7-756b-46f7-8c55-2049f5b09942 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:43.015266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ed0e7-756b-46f7-8c55-2049f5b09942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:43.044647 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-855ed0e7-756b-46f7-8c55-2049f5b09942 None None] MFA Rules not processed for user `042459bc6511428aad3faedd436ee565`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:08:43.045926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-855ed0e7-756b-46f7-8c55-2049f5b09942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:43.122170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1151/2305] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:08:43.133810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135adb7-bdde-4fb1-8330-b69b1c7eda01 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:08:43.135539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b135adb7-bdde-4fb1-8330-b69b1c7eda01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:43.214014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135adb7-bdde-4fb1-8330-b69b1c7eda01 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:08:43.217995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ff9a5-53a3-400f-946e-0e534cb10634 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:08:43.218642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ff9a5-53a3-400f-946e-0e534cb10634 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:43.218926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ff9a5-53a3-400f-946e-0e534cb10634 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:43.219203 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ff9a5-53a3-400f-946e-0e534cb10634 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:43.227601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ff9a5-53a3-400f-946e-0e534cb10634 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:08:43.229034 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ff9a5-53a3-400f-946e-0e534cb10634 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:08:43.237917 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1155/2306] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:08:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:08:44.986729 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6392986-3596-423e-b0cb-1f2c1cddea13 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:08:44.987320 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6392986-3596-423e-b0cb-1f2c1cddea13 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:08:44.987320 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6392986-3596-423e-b0cb-1f2c1cddea13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:08:45.004475 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b6392986-3596-423e-b0cb-1f2c1cddea13 None None] MFA Rules not processed for user `042459bc6511428aad3faedd436ee565`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:08:45.005865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b6392986-3596-423e-b0cb-1f2c1cddea13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:08:45.020916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1152/2307] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:08:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:09:02.969173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60235702-fb3a-41e7-8527-9e20eca124aa None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:02.969750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60235702-fb3a-41e7-8527-9e20eca124aa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:02.969750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60235702-fb3a-41e7-8527-9e20eca124aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:02.987477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-60235702-fb3a-41e7-8527-9e20eca124aa None None] MFA Rules not processed for user `d7666a6299cc4c44ac7495ed00f137dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:09:02.988594 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-60235702-fb3a-41e7-8527-9e20eca124aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:03.041342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1156/2308] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:09:07.116592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d908dee-9c67-4c7f-9b05-0657eaf44a3a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:07.117117 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d908dee-9c67-4c7f-9b05-0657eaf44a3a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:07.117217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d908dee-9c67-4c7f-9b05-0657eaf44a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:07.134909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1d908dee-9c67-4c7f-9b05-0657eaf44a3a None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:09:07.136110 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1d908dee-9c67-4c7f-9b05-0657eaf44a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:07.194242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1153/2309] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:09:07.322592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60235702-fb3a-41e7-8527-9e20eca124aa None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:09:07.324015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-60235702-fb3a-41e7-8527-9e20eca124aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:07.395431 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60235702-fb3a-41e7-8527-9e20eca124aa None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:09:07.401042 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604b8ac-2b07-47e0-b9cb-94da6b73df13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:09:07.401729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604b8ac-2b07-47e0-b9cb-94da6b73df13 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:07.402077 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604b8ac-2b07-47e0-b9cb-94da6b73df13 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:07.402380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604b8ac-2b07-47e0-b9cb-94da6b73df13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:07.411999 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604b8ac-2b07-47e0-b9cb-94da6b73df13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:09:07.413576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604b8ac-2b07-47e0-b9cb-94da6b73df13 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:09:07.423234 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1157/2310] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:09:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 21:09:08.330495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4732cf-7240-41a2-835f-9f7da8e9cf9a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:08.331337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4732cf-7240-41a2-835f-9f7da8e9cf9a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:08.331631 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4732cf-7240-41a2-835f-9f7da8e9cf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:08.350417 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5d4732cf-7240-41a2-835f-9f7da8e9cf9a None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:09:08.351810 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5d4732cf-7240-41a2-835f-9f7da8e9cf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:08.365695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1154/2311] 10.222.0.35 () {58 vars in 967 bytes} [Wed May 11 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:09:08.375087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604b8ac-2b07-47e0-b9cb-94da6b73df13 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:09:08.385576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604b8ac-2b07-47e0-b9cb-94da6b73df13 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:09:08.390804 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f09f08-8bf2-425c-9b24-392990c925e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:09:08.391886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f09f08-8bf2-425c-9b24-392990c925e0 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:08.394004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f09f08-8bf2-425c-9b24-392990c925e0 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:08.394464 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f09f08-8bf2-425c-9b24-392990c925e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:08.404384 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f09f08-8bf2-425c-9b24-392990c925e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:09:08.406216 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f09f08-8bf2-425c-9b24-392990c925e0 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:09:08.415131 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1158/2312] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:09:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 21:09:09.006145 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be532f8-2e00-418b-97c6-383641e4d100 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:09.006436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be532f8-2e00-418b-97c6-383641e4d100 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:09.006715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be532f8-2e00-418b-97c6-383641e4d100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:09.025425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4be532f8-2e00-418b-97c6-383641e4d100 None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:09:09.026621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4be532f8-2e00-418b-97c6-383641e4d100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:09.033714 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1155/2313] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 21:09:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:09:09.045451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f09f08-8bf2-425c-9b24-392990c925e0 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:09:09.056610 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f09f08-8bf2-425c-9b24-392990c925e0 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:09:09.061655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eb6ec-2bf4-412b-9871-d6263de7eeae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:09:09.062287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eb6ec-2bf4-412b-9871-d6263de7eeae service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:09.062682 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eb6ec-2bf4-412b-9871-d6263de7eeae service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:09.062965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eb6ec-2bf4-412b-9871-d6263de7eeae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:09.071707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7eb6ec-2bf4-412b-9871-d6263de7eeae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:09:09.073307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7eb6ec-2bf4-412b-9871-d6263de7eeae service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:09:09.081058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1159/2314] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:09:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 11 21:09:09.642429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38115a-1b43-4eb6-9f21-5e8038916b90 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:09.642901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38115a-1b43-4eb6-9f21-5e8038916b90 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:09.643010 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38115a-1b43-4eb6-9f21-5e8038916b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:09.661203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bf38115a-1b43-4eb6-9f21-5e8038916b90 None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:09:09.662429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bf38115a-1b43-4eb6-9f21-5e8038916b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:09.669427 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1156/2315] 10.222.0.35 () {58 vars in 967 bytes} [Wed May 11 21:09:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:09:09.681975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eb6ec-2bf4-412b-9871-d6263de7eeae service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:09:09.692148 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eb6ec-2bf4-412b-9871-d6263de7eeae service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:09:09.697073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc59bc8-573d-46f1-8e33-4eed6f0dc7ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:09:09.697725 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc59bc8-573d-46f1-8e33-4eed6f0dc7ec service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:09.698014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc59bc8-573d-46f1-8e33-4eed6f0dc7ec service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:09.698293 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc59bc8-573d-46f1-8e33-4eed6f0dc7ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:09.706072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc59bc8-573d-46f1-8e33-4eed6f0dc7ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:09:09.707642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc59bc8-573d-46f1-8e33-4eed6f0dc7ec service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:09:09.715467 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1160/2316] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:09:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 21:09:12.299835 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38115a-1b43-4eb6-9f21-5e8038916b90 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:09:12.358801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38115a-1b43-4eb6-9f21-5e8038916b90 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:09:12.363726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95269ae2-5e85-4c2b-a4c5-ca1749979457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:09:12.364562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269ae2-5e85-4c2b-a4c5-ca1749979457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:12.364844 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269ae2-5e85-4c2b-a4c5-ca1749979457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:12.365117 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95269ae2-5e85-4c2b-a4c5-ca1749979457 admin admin] PATH_INFO: `/v3/users/042459bc6511428aad3faedd436ee565` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:12.366300 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95269ae2-5e85-4c2b-a4c5-ca1749979457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=042459bc6511428aad3faedd436ee565)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:09:12.368308 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95269ae2-5e85-4c2b-a4c5-ca1749979457 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:09:12.555315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-95269ae2-5e85-4c2b-a4c5-ca1749979457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042459bc6511428aad3faedd436ee565'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:09:12.647050 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-95269ae2-5e85-4c2b-a4c5-ca1749979457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042459bc6511428aad3faedd436ee565'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:09:12.654733 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-95269ae2-5e85-4c2b-a4c5-ca1749979457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042459bc6511428aad3faedd436ee565'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:09:12.656380 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-95269ae2-5e85-4c2b-a4c5-ca1749979457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042459bc6511428aad3faedd436ee565'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:09:12.656380 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-95269ae2-5e85-4c2b-a4c5-ca1749979457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042459bc6511428aad3faedd436ee565'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:09:12.673859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1157/2317] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:09:12 2022] DELETE /identity/v3/users/042459bc6511428aad3faedd436ee565 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:09:12.678292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62f380-70e7-492e-a649-1f70fcc19d90 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:12.678793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62f380-70e7-492e-a649-1f70fcc19d90 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:12.678906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62f380-70e7-492e-a649-1f70fcc19d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:12.696112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ca62f380-70e7-492e-a649-1f70fcc19d90 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:09:12.697400 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ca62f380-70e7-492e-a649-1f70fcc19d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:12.755511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1161/2318] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:09:12.765404 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95269ae2-5e85-4c2b-a4c5-ca1749979457 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:09:12.767810 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-95269ae2-5e85-4c2b-a4c5-ca1749979457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:12.824988 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95269ae2-5e85-4c2b-a4c5-ca1749979457 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:09:12.828578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b306d01-b3d8-4acd-8c13-9a1604ead478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:09:12.829756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b306d01-b3d8-4acd-8c13-9a1604ead478 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:12.830037 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b306d01-b3d8-4acd-8c13-9a1604ead478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:12.830310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b306d01-b3d8-4acd-8c13-9a1604ead478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:12.839152 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b306d01-b3d8-4acd-8c13-9a1604ead478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:09:12.840690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b306d01-b3d8-4acd-8c13-9a1604ead478 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:09:12.851487 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1158/2319] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:09:13.151877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62f380-70e7-492e-a649-1f70fcc19d90 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:09:13.153461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ca62f380-70e7-492e-a649-1f70fcc19d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:13.166510 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62f380-70e7-492e-a649-1f70fcc19d90 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:09:13.171368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:09:13.172313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:13.172706 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:13.173212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] PATH_INFO: `/v3/projects/5a2c60193ec94c6ea7d7247efe9fc087` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:13.174815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a2c60193ec94c6ea7d7247efe9fc087)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:09:13.177480 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:09:13.295867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a2c60193ec94c6ea7d7247efe9fc087', 'request_id': 'req-31ea54af-2fa3-4026-ae83-cd45f4ec416d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:09:13.302096 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a2c60193ec94c6ea7d7247efe9fc087', 'request_id': 'req-31ea54af-2fa3-4026-ae83-cd45f4ec416d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:09:13.307355 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a2c60193ec94c6ea7d7247efe9fc087', 'request_id': 'req-31ea54af-2fa3-4026-ae83-cd45f4ec416d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:09:13.395337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] The token cache is being invalidate because project 5a2c60193ec94c6ea7d7247efe9fc087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:09:13.395583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:09:13.396239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:09:13.397850 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1162/2320] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:09:13 2022] DELETE /identity/v3/projects/5a2c60193ec94c6ea7d7247efe9fc087 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:09:43.402059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615dd3-3816-4269-a11d-e1234496bd07 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:43.402597 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615dd3-3816-4269-a11d-e1234496bd07 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:43.402704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615dd3-3816-4269-a11d-e1234496bd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:43.419363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b4615dd3-3816-4269-a11d-e1234496bd07 None None] MFA Rules not processed for user `df9d6a9b73e64e31b014b5809912bbe8`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:09:43.420596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b4615dd3-3816-4269-a11d-e1234496bd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:43.473667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1159/2321] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:09:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:09:46.231609 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:09:46.233184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:46.290725 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea54af-2fa3-4026-ae83-cd45f4ec416d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:09:46.294315 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9c346-4cb9-44e9-8618-903dd39fcdaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:09:46.294990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9c346-4cb9-44e9-8618-903dd39fcdaa service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:46.295278 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9c346-4cb9-44e9-8618-903dd39fcdaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:46.295561 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9c346-4cb9-44e9-8618-903dd39fcdaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:46.297395 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-52c9c346-4cb9-44e9-8618-903dd39fcdaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:46.371420 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9c346-4cb9-44e9-8618-903dd39fcdaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:09:46.372866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9c346-4cb9-44e9-8618-903dd39fcdaa service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:09:46.384113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1163/2322] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:09:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:09:47.893872 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952675b-3550-4fe6-9fbc-ca007e70fd1f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:47.894412 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952675b-3550-4fe6-9fbc-ca007e70fd1f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:47.894412 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952675b-3550-4fe6-9fbc-ca007e70fd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:47.913276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c952675b-3550-4fe6-9fbc-ca007e70fd1f None None] MFA Rules not processed for user `f9968edcee104432ade2014e39683bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:09:47.914558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c952675b-3550-4fe6-9fbc-ca007e70fd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:47.974234 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1160/2323] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:09:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:09:48.079932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9c346-4cb9-44e9-8618-903dd39fcdaa service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:09:48.081469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-52c9c346-4cb9-44e9-8618-903dd39fcdaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:48.092483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9c346-4cb9-44e9-8618-903dd39fcdaa service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:09:48.096506 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1f64a-539f-49b1-8e9a-5369d651140d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:09:48.097146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1f64a-539f-49b1-8e9a-5369d651140d service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:48.097607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1f64a-539f-49b1-8e9a-5369d651140d service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:48.097913 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1f64a-539f-49b1-8e9a-5369d651140d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:48.099752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c5d1f64a-539f-49b1-8e9a-5369d651140d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:48.113490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1f64a-539f-49b1-8e9a-5369d651140d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:09:48.115548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1f64a-539f-49b1-8e9a-5369d651140d service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:09:48.127253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1164/2324] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:09:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:09:57.565635 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4c5fc-8d36-44c3-9c62-3f81d6489a3a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:57.566160 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4c5fc-8d36-44c3-9c62-3f81d6489a3a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:57.566260 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4c5fc-8d36-44c3-9c62-3f81d6489a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:57.584128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b4a4c5fc-8d36-44c3-9c62-3f81d6489a3a None None] MFA Rules not processed for user `baed8aff24b64c788f40e6d7dd1f99c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:09:57.585305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b4a4c5fc-8d36-44c3-9c62-3f81d6489a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:57.637044 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1161/2325] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:09:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:09:57.797233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1f64a-539f-49b1-8e9a-5369d651140d service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:09:57.798703 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c5d1f64a-539f-49b1-8e9a-5369d651140d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:57.812249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1f64a-539f-49b1-8e9a-5369d651140d service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:09:57.817711 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba287e-3fe9-495b-b5b7-17640627bcf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:09:57.825702 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba287e-3fe9-495b-b5b7-17640627bcf3 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:57.825702 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba287e-3fe9-495b-b5b7-17640627bcf3 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:57.825702 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba287e-3fe9-495b-b5b7-17640627bcf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:57.825702 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3dba287e-3fe9-495b-b5b7-17640627bcf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:57.833919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba287e-3fe9-495b-b5b7-17640627bcf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:09:57.835534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba287e-3fe9-495b-b5b7-17640627bcf3 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:09:57.845351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1165/2326] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:09:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:09:58.313691 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4c5fc-8d36-44c3-9c62-3f81d6489a3a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:09:58.315281 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b4a4c5fc-8d36-44c3-9c62-3f81d6489a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:58.385216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4c5fc-8d36-44c3-9c62-3f81d6489a3a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:09:58.390323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7fb31-f270-436b-b2f0-ae8b5a20a1a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59cb32d2807549699e37b27ca97d351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:09:58.390971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7fb31-f270-436b-b2f0-ae8b5a20a1a6 service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:09:58.391264 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7fb31-f270-436b-b2f0-ae8b5a20a1a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:09:58.391548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7fb31-f270-436b-b2f0-ae8b5a20a1a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:09:58.393316 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cdc7fb31-f270-436b-b2f0-ae8b5a20a1a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:09:58.404735 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7fb31-f270-436b-b2f0-ae8b5a20a1a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:09:58.406390 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7fb31-f270-436b-b2f0-ae8b5a20a1a6 service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:09:58.416045 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1162/2327] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:09:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:10:02.314608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba287e-3fe9-495b-b5b7-17640627bcf3 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:10:02.323981 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba287e-3fe9-495b-b5b7-17640627bcf3 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:10:02.330133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab1fe8-c9a1-405a-a95e-56a10269c58f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:10:02.330133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab1fe8-c9a1-405a-a95e-56a10269c58f service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:10:02.330133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab1fe8-c9a1-405a-a95e-56a10269c58f service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:10:02.330133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab1fe8-c9a1-405a-a95e-56a10269c58f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:10:02.330663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-59ab1fe8-c9a1-405a-a95e-56a10269c58f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:10:02.350933 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab1fe8-c9a1-405a-a95e-56a10269c58f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:10:02.352391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab1fe8-c9a1-405a-a95e-56a10269c58f service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:10:02.360783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1166/2328] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:10:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:10:03.861843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7fb31-f270-436b-b2f0-ae8b5a20a1a6 service placement] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:10:03.874496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7fb31-f270-436b-b2f0-ae8b5a20a1a6 service placement] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:10:03.880595 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d3280-1456-4715-9b85-e91b85c325af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:10:03.881261 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d3280-1456-4715-9b85-e91b85c325af service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:10:03.881783 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d3280-1456-4715-9b85-e91b85c325af service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:10:03.882069 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d3280-1456-4715-9b85-e91b85c325af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:10:03.883946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e00d3280-1456-4715-9b85-e91b85c325af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:10:03.896782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d3280-1456-4715-9b85-e91b85c325af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:10:03.898513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d3280-1456-4715-9b85-e91b85c325af service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:10:03.910119 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1163/2329] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:10:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:10:05.625379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab1fe8-c9a1-405a-a95e-56a10269c58f service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:10:05.626915 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-59ab1fe8-c9a1-405a-a95e-56a10269c58f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:10:05.642734 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab1fe8-c9a1-405a-a95e-56a10269c58f service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:10:05.648848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a0ea1-8770-494a-ad26-778119285fda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:10:05.649777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a0ea1-8770-494a-ad26-778119285fda service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:10:05.650062 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a0ea1-8770-494a-ad26-778119285fda service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:10:05.650340 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a0ea1-8770-494a-ad26-778119285fda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:10:05.652030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-978a0ea1-8770-494a-ad26-778119285fda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:10:05.706872 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a0ea1-8770-494a-ad26-778119285fda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:10:05.709140 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a0ea1-8770-494a-ad26-778119285fda service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:10:05.718110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1167/2330] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:10:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:10:13.508869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d3280-1456-4715-9b85-e91b85c325af service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:10:13.520202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d3280-1456-4715-9b85-e91b85c325af service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:10:13.526180 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a64a84-5ccb-4398-a3d0-b74f3f464f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:10:13.526929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a64a84-5ccb-4398-a3d0-b74f3f464f10 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:10:13.527217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a64a84-5ccb-4398-a3d0-b74f3f464f10 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:10:13.527495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a64a84-5ccb-4398-a3d0-b74f3f464f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:10:13.529275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d9a64a84-5ccb-4398-a3d0-b74f3f464f10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:10:13.541794 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a64a84-5ccb-4398-a3d0-b74f3f464f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:10:13.543379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a64a84-5ccb-4398-a3d0-b74f3f464f10 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:10:13.554666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1164/2331] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:10:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:10:16.472871 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdee04a-8f65-4c2f-8bf7-9f15f95d3648 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:10:16.473934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdee04a-8f65-4c2f-8bf7-9f15f95d3648 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:10:16.474063 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdee04a-8f65-4c2f-8bf7-9f15f95d3648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:10:16.490734 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8cdee04a-8f65-4c2f-8bf7-9f15f95d3648 None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:10:16.491912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8cdee04a-8f65-4c2f-8bf7-9f15f95d3648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:10:16.545370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1168/2332] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:10:16.670498 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a64a84-5ccb-4398-a3d0-b74f3f464f10 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:10:16.671926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d9a64a84-5ccb-4398-a3d0-b74f3f464f10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:10:16.737136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a64a84-5ccb-4398-a3d0-b74f3f464f10 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:10:16.742221 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a824e-55cc-41f4-9667-e8cf878ab599 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:10:16.742866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a824e-55cc-41f4-9667-e8cf878ab599 service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:10:16.743155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a824e-55cc-41f4-9667-e8cf878ab599 service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:10:16.743439 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a824e-55cc-41f4-9667-e8cf878ab599 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:10:16.751296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a824e-55cc-41f4-9667-e8cf878ab599 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:10:16.752884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a824e-55cc-41f4-9667-e8cf878ab599 service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:10:16.761368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1165/2333] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:10:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 21:10:30.970023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdee04a-8f65-4c2f-8bf7-9f15f95d3648 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:10:30.983272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdee04a-8f65-4c2f-8bf7-9f15f95d3648 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:10:30.988702 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c4e6f-1305-44fc-8c86-e9ca6d8680d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:10:30.989354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c4e6f-1305-44fc-8c86-e9ca6d8680d9 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:10:30.989676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c4e6f-1305-44fc-8c86-e9ca6d8680d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:10:30.989957 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c4e6f-1305-44fc-8c86-e9ca6d8680d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:10:30.992484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f81c4e6f-1305-44fc-8c86-e9ca6d8680d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:10:31.004420 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c4e6f-1305-44fc-8c86-e9ca6d8680d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:10:31.006065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c4e6f-1305-44fc-8c86-e9ca6d8680d9 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:10:31.016527 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1169/2334] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:10:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:10:33.675112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a824e-55cc-41f4-9667-e8cf878ab599 service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:10:33.684612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a824e-55cc-41f4-9667-e8cf878ab599 service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:10:33.688400 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21606c-9f16-40b0-a59b-4cb5abc08d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:10:33.689035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21606c-9f16-40b0-a59b-4cb5abc08d79 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:10:33.689319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21606c-9f16-40b0-a59b-4cb5abc08d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:10:33.689626 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21606c-9f16-40b0-a59b-4cb5abc08d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:10:33.691381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8a21606c-9f16-40b0-a59b-4cb5abc08d79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:10:33.701107 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21606c-9f16-40b0-a59b-4cb5abc08d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:10:33.702578 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21606c-9f16-40b0-a59b-4cb5abc08d79 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:10:33.710140 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1166/2335] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:10:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:10:35.944288 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c4e6f-1305-44fc-8c86-e9ca6d8680d9 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:10:35.966140 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c4e6f-1305-44fc-8c86-e9ca6d8680d9 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:10:35.969628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08f1c9-a662-4657-937c-e328c6329ff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:10:35.971069 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08f1c9-a662-4657-937c-e328c6329ff9 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:10:35.971525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08f1c9-a662-4657-937c-e328c6329ff9 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:10:35.971955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08f1c9-a662-4657-937c-e328c6329ff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:10:35.980956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1b08f1c9-a662-4657-937c-e328c6329ff9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:10:35.998236 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08f1c9-a662-4657-937c-e328c6329ff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:10:36.005270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08f1c9-a662-4657-937c-e328c6329ff9 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:10:36.030445 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1170/2336] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:10:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:10:36.816232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc2c0f-66f0-48e4-b72e-3c67544f8364 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:10:36.816721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc2c0f-66f0-48e4-b72e-3c67544f8364 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:10:36.816815 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc2c0f-66f0-48e4-b72e-3c67544f8364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:10:36.836928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-40fc2c0f-66f0-48e4-b72e-3c67544f8364 None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:10:36.838184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-40fc2c0f-66f0-48e4-b72e-3c67544f8364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:10:36.850548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1167/2337] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 21:10:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:10:36.865123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08f1c9-a662-4657-937c-e328c6329ff9 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:10:36.877123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08f1c9-a662-4657-937c-e328c6329ff9 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:10:36.882798 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89cf5d-021a-4308-a453-540bb8862182 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:10:36.883690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89cf5d-021a-4308-a453-540bb8862182 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:10:36.884179 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89cf5d-021a-4308-a453-540bb8862182 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:10:36.884673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89cf5d-021a-4308-a453-540bb8862182 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:10:36.893474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89cf5d-021a-4308-a453-540bb8862182 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:10:36.895090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89cf5d-021a-4308-a453-540bb8862182 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:10:36.906199 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1171/2338] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:10:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 21:10:53.140918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee69fed-cde8-4838-b81d-cc48a9211b25 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:10:53.141962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee69fed-cde8-4838-b81d-cc48a9211b25 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:10:53.142401 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee69fed-cde8-4838-b81d-cc48a9211b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:10:53.168057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-eee69fed-cde8-4838-b81d-cc48a9211b25 None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:10:53.169352 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-eee69fed-cde8-4838-b81d-cc48a9211b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:10:53.177204 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1168/2339] 10.222.0.35 () {58 vars in 967 bytes} [Wed May 11 21:10:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:10:53.192195 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89cf5d-021a-4308-a453-540bb8862182 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:10:53.202418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89cf5d-021a-4308-a453-540bb8862182 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:10:53.207564 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8942e-b79a-4bae-92b6-0b9a0dbc7aa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:10:53.208334 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8942e-b79a-4bae-92b6-0b9a0dbc7aa8 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:10:53.208626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8942e-b79a-4bae-92b6-0b9a0dbc7aa8 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:10:53.208936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8942e-b79a-4bae-92b6-0b9a0dbc7aa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:10:53.218128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8942e-b79a-4bae-92b6-0b9a0dbc7aa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:10:53.219774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8942e-b79a-4bae-92b6-0b9a0dbc7aa8 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:10:53.229042 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1172/2340] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:10:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 21:10:55.348489 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bf1cc-8f37-438d-a92a-9e228477a1d9 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:10:55.349071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bf1cc-8f37-438d-a92a-9e228477a1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:10:55.349071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bf1cc-8f37-438d-a92a-9e228477a1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:10:55.366743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f17bf1cc-8f37-438d-a92a-9e228477a1d9 None None] MFA Rules not processed for user `3a47bfbd0a2e459cabaa30d74f45811a`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:10:55.368048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f17bf1cc-8f37-438d-a92a-9e228477a1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:10:55.420645 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1169/2341] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:10:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:00.214160 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8942e-b79a-4bae-92b6-0b9a0dbc7aa8 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:00.224993 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8942e-b79a-4bae-92b6-0b9a0dbc7aa8 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:00.229373 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c48dd-ce21-4613-b0cc-709ffcab2f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:00.230416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c48dd-ce21-4613-b0cc-709ffcab2f4b service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:00.230891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c48dd-ce21-4613-b0cc-709ffcab2f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:00.231261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c48dd-ce21-4613-b0cc-709ffcab2f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:00.237912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ea9c48dd-ce21-4613-b0cc-709ffcab2f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:00.340469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c48dd-ce21-4613-b0cc-709ffcab2f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:00.342127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c48dd-ce21-4613-b0cc-709ffcab2f4b service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:00.355188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1173/2342] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:04.907885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bf1cc-8f37-438d-a92a-9e228477a1d9 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:04.909449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f17bf1cc-8f37-438d-a92a-9e228477a1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:04.924548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17bf1cc-8f37-438d-a92a-9e228477a1d9 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:04.930070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3705a-1f81-4dff-b295-58bd881c343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:04.931091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3705a-1f81-4dff-b295-58bd881c343f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:04.931382 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3705a-1f81-4dff-b295-58bd881c343f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:04.931661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3705a-1f81-4dff-b295-58bd881c343f admin admin] PATH_INFO: `/v3/users/df9d6a9b73e64e31b014b5809912bbe8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:04.932856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3705a-1f81-4dff-b295-58bd881c343f admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9d6a9b73e64e31b014b5809912bbe8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:04.934858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3705a-1f81-4dff-b295-58bd881c343f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:05.114632 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9e3705a-1f81-4dff-b295-58bd881c343f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9d6a9b73e64e31b014b5809912bbe8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:05.174371 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9e3705a-1f81-4dff-b295-58bd881c343f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9d6a9b73e64e31b014b5809912bbe8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:05.182502 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9e3705a-1f81-4dff-b295-58bd881c343f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9d6a9b73e64e31b014b5809912bbe8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:05.183181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9e3705a-1f81-4dff-b295-58bd881c343f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9d6a9b73e64e31b014b5809912bbe8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:05.183796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9e3705a-1f81-4dff-b295-58bd881c343f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9d6a9b73e64e31b014b5809912bbe8'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:05.201112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1170/2343] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:04 2022] DELETE /identity/v3/users/df9d6a9b73e64e31b014b5809912bbe8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:05.442582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c48dd-ce21-4613-b0cc-709ffcab2f4b service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:05.452500 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c48dd-ce21-4613-b0cc-709ffcab2f4b service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:05.508626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e25741-e0a0-4b79-ab9c-c6b391020fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:05.509466 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e25741-e0a0-4b79-ab9c-c6b391020fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:05.509781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e25741-e0a0-4b79-ab9c-c6b391020fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:05.510059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e25741-e0a0-4b79-ab9c-c6b391020fa8 admin admin] PATH_INFO: `/v3/projects/838ec035db164e50bc335d2cf141d943` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:05.511223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e25741-e0a0-4b79-ab9c-c6b391020fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=838ec035db164e50bc335d2cf141d943)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:05.513139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e25741-e0a0-4b79-ab9c-c6b391020fa8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:05.608973 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37e25741-e0a0-4b79-ab9c-c6b391020fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '838ec035db164e50bc335d2cf141d943', 'request_id': 'req-37e25741-e0a0-4b79-ab9c-c6b391020fa8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:05.614962 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37e25741-e0a0-4b79-ab9c-c6b391020fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '838ec035db164e50bc335d2cf141d943', 'request_id': 'req-37e25741-e0a0-4b79-ab9c-c6b391020fa8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:05.620983 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37e25741-e0a0-4b79-ab9c-c6b391020fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '838ec035db164e50bc335d2cf141d943', 'request_id': 'req-37e25741-e0a0-4b79-ab9c-c6b391020fa8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:05.691999 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37e25741-e0a0-4b79-ab9c-c6b391020fa8 admin admin] The token cache is being invalidate because project 838ec035db164e50bc335d2cf141d943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:05.692284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37e25741-e0a0-4b79-ab9c-c6b391020fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:05.692932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37e25741-e0a0-4b79-ab9c-c6b391020fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:05.694700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1174/2344] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:05 2022] DELETE /identity/v3/projects/838ec035db164e50bc335d2cf141d943 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:05.699565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775f56-c0ed-487c-9885-dba5a5d14975 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:05.703571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775f56-c0ed-487c-9885-dba5a5d14975 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:05.703571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e775f56-c0ed-487c-9885-dba5a5d14975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:05.717817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1e775f56-c0ed-487c-9885-dba5a5d14975 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:05.719008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1e775f56-c0ed-487c-9885-dba5a5d14975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:05.776544 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1171/2345] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:05.784303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2f708-ac27-4e01-a9c6-27b767e9f675 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:05.784595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2f708-ac27-4e01-a9c6-27b767e9f675 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:05.784881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2f708-ac27-4e01-a9c6-27b767e9f675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:05.803334 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5be2f708-ac27-4e01-a9c6-27b767e9f675 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:05.804532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5be2f708-ac27-4e01-a9c6-27b767e9f675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:05.812314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1175/2346] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:05.816249 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e775f56-c0ed-487c-9885-dba5a5d14975 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:05.825734 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e775f56-c0ed-487c-9885-dba5a5d14975 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:05.830354 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca04070-cfd8-4eda-85fd-4758930ee2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:05.831007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca04070-cfd8-4eda-85fd-4758930ee2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:05.831293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca04070-cfd8-4eda-85fd-4758930ee2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:05.831568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca04070-cfd8-4eda-85fd-4758930ee2c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:05.832294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca04070-cfd8-4eda-85fd-4758930ee2c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:11:05.832605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca04070-cfd8-4eda-85fd-4758930ee2c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:05.834245 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca04070-cfd8-4eda-85fd-4758930ee2c1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:05.846456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1172/2347] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:11:05.850720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2f708-ac27-4e01-a9c6-27b767e9f675 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:05.860287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2f708-ac27-4e01-a9c6-27b767e9f675 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:05.864802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b07979-a6fe-476d-b597-92171db258b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:05.865439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b07979-a6fe-476d-b597-92171db258b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:05.865754 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b07979-a6fe-476d-b597-92171db258b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:05.866031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b07979-a6fe-476d-b597-92171db258b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:05.866728 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b07979-a6fe-476d-b597-92171db258b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:05.868617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b07979-a6fe-476d-b597-92171db258b4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:05.973108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1176/2348] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:05 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:11:05.974372 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca04070-cfd8-4eda-85fd-4758930ee2c1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:05.984917 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca04070-cfd8-4eda-85fd-4758930ee2c1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:06.039688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece775-7a91-4d65-94dc-d85ca359e006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:06.040932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece775-7a91-4d65-94dc-d85ca359e006 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:06.041223 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece775-7a91-4d65-94dc-d85ca359e006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:06.041507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daece775-7a91-4d65-94dc-d85ca359e006 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:06.042247 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daece775-7a91-4d65-94dc-d85ca359e006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:06.044226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daece775-7a91-4d65-94dc-d85ca359e006 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:06.147336 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1173/2349] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:05 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:11:06.149125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b07979-a6fe-476d-b597-92171db258b4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:06.159503 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b07979-a6fe-476d-b597-92171db258b4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:06.164345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b68024-eacb-414a-bdba-b59080889b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:06.165006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b68024-eacb-414a-bdba-b59080889b7a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:06.165294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b68024-eacb-414a-bdba-b59080889b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:06.165635 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b68024-eacb-414a-bdba-b59080889b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:06.166314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b68024-eacb-414a-bdba-b59080889b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:06.167907 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b68024-eacb-414a-bdba-b59080889b7a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:06.177985 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1177/2350] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:11:06.182104 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece775-7a91-4d65-94dc-d85ca359e006 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:06.191840 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daece775-7a91-4d65-94dc-d85ca359e006 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:06.197521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdf49d-9063-439a-b939-6a21755d5335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:06.198266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdf49d-9063-439a-b939-6a21755d5335 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:06.198595 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdf49d-9063-439a-b939-6a21755d5335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:06.199005 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdf49d-9063-439a-b939-6a21755d5335 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:06.199780 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdf49d-9063-439a-b939-6a21755d5335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:06.201434 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdf49d-9063-439a-b939-6a21755d5335 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:06.212036 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1174/2351] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:06.216122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b68024-eacb-414a-bdba-b59080889b7a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:06.225850 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b68024-eacb-414a-bdba-b59080889b7a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:06.230511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00920dd-6891-4403-93a5-67580eea70ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:06.231402 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00920dd-6891-4403-93a5-67580eea70ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:06.231680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00920dd-6891-4403-93a5-67580eea70ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:06.231948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00920dd-6891-4403-93a5-67580eea70ce admin admin] PATH_INFO: `/v3/projects/9f27d80e36424c4980e061fb911b2b9f/users/ab9fadbb88814433bff84bc3b71f761c/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:06.245898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00920dd-6891-4403-93a5-67580eea70ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f27d80e36424c4980e061fb911b2b9f, user_id=ab9fadbb88814433bff84bc3b71f761c, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:06.248539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00920dd-6891-4403-93a5-67580eea70ce admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:06.326821 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1178/2352] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:06 2022] PUT /identity/v3/projects/9f27d80e36424c4980e061fb911b2b9f/users/ab9fadbb88814433bff84bc3b71f761c/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:11:06.338375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c7fe4-4650-4f23-a42b-51547babd533 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:06.338676 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c7fe4-4650-4f23-a42b-51547babd533 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:06.338978 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c7fe4-4650-4f23-a42b-51547babd533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:06.365887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-6a5c7fe4-4650-4f23-a42b-51547babd533 None None] MFA Rules not processed for user `ab9fadbb88814433bff84bc3b71f761c`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:06.367112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6a5c7fe4-4650-4f23-a42b-51547babd533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:06.428183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1175/2353] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:06.439046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00920dd-6891-4403-93a5-67580eea70ce admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:06.443440 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e00920dd-6891-4403-93a5-67580eea70ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:06.512332 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00920dd-6891-4403-93a5-67580eea70ce admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:06.517959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3902f-dba4-4474-99ba-d96aaf72411d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:06.518596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3902f-dba4-4474-99ba-d96aaf72411d service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:06.518879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3902f-dba4-4474-99ba-d96aaf72411d service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:06.519153 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3902f-dba4-4474-99ba-d96aaf72411d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:06.527678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3902f-dba4-4474-99ba-d96aaf72411d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:06.529253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3902f-dba4-4474-99ba-d96aaf72411d service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:06.537755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1179/2354] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:06.736219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c7fe4-4650-4f23-a42b-51547babd533 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:06.795361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c7fe4-4650-4f23-a42b-51547babd533 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:06.799836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d7d96-9a94-43e1-8fa2-18b5a3b40403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:06.800687 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d7d96-9a94-43e1-8fa2-18b5a3b40403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:06.800973 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d7d96-9a94-43e1-8fa2-18b5a3b40403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:06.801253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d7d96-9a94-43e1-8fa2-18b5a3b40403 admin admin] PATH_INFO: `/v3/users/ab9fadbb88814433bff84bc3b71f761c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:06.802451 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d7d96-9a94-43e1-8fa2-18b5a3b40403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9fadbb88814433bff84bc3b71f761c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:06.804891 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d7d96-9a94-43e1-8fa2-18b5a3b40403 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:07.060906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-744d7d96-9a94-43e1-8fa2-18b5a3b40403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9fadbb88814433bff84bc3b71f761c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:07.134561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-744d7d96-9a94-43e1-8fa2-18b5a3b40403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9fadbb88814433bff84bc3b71f761c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:07.142147 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-744d7d96-9a94-43e1-8fa2-18b5a3b40403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9fadbb88814433bff84bc3b71f761c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:07.142816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-744d7d96-9a94-43e1-8fa2-18b5a3b40403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9fadbb88814433bff84bc3b71f761c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:07.143464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-744d7d96-9a94-43e1-8fa2-18b5a3b40403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9fadbb88814433bff84bc3b71f761c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:07.161407 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1176/2355] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:06 2022] DELETE /identity/v3/users/ab9fadbb88814433bff84bc3b71f761c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:07.166077 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2666d1-db46-4157-8271-ad1aa3ba3e60 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:07.166368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2666d1-db46-4157-8271-ad1aa3ba3e60 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:07.166653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2666d1-db46-4157-8271-ad1aa3ba3e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:07.189393 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3c2666d1-db46-4157-8271-ad1aa3ba3e60 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:07.190706 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3c2666d1-db46-4157-8271-ad1aa3ba3e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:07.250513 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1180/2356] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:07.260666 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d7d96-9a94-43e1-8fa2-18b5a3b40403 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:07.262120 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-744d7d96-9a94-43e1-8fa2-18b5a3b40403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:07.317731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d7d96-9a94-43e1-8fa2-18b5a3b40403 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:07.321854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf4d2f-6334-49ae-a3c0-8c130af08f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:07.322494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf4d2f-6334-49ae-a3c0-8c130af08f2d service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:07.322779 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf4d2f-6334-49ae-a3c0-8c130af08f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:07.323057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf4d2f-6334-49ae-a3c0-8c130af08f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:07.331821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf4d2f-6334-49ae-a3c0-8c130af08f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:07.333265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf4d2f-6334-49ae-a3c0-8c130af08f2d service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:07.343133 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1177/2357] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:07.752877 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2666d1-db46-4157-8271-ad1aa3ba3e60 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:07.755942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3c2666d1-db46-4157-8271-ad1aa3ba3e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:07.768950 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2666d1-db46-4157-8271-ad1aa3ba3e60 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:07.779127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:07.779127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:07.779127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:07.779127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc admin admin] PATH_INFO: `/v3/projects/9f27d80e36424c4980e061fb911b2b9f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:07.779442 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f27d80e36424c4980e061fb911b2b9f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:07.782478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:07.900757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f27d80e36424c4980e061fb911b2b9f', 'request_id': 'req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:07.906887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f27d80e36424c4980e061fb911b2b9f', 'request_id': 'req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:07.912378 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f27d80e36424c4980e061fb911b2b9f', 'request_id': 'req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:08.002550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc admin admin] The token cache is being invalidate because project 9f27d80e36424c4980e061fb911b2b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:08.002550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:08.003125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4523140a-8e9f-4e8d-a9f6-bcfd839551fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:08.004709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1181/2358] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:07 2022] DELETE /identity/v3/projects/9f27d80e36424c4980e061fb911b2b9f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:08.009636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5ea5e-aec8-4b90-ac17-f664df1737a4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:08.010077 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5ea5e-aec8-4b90-ac17-f664df1737a4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:08.010360 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5ea5e-aec8-4b90-ac17-f664df1737a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:08.028589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-13b5ea5e-aec8-4b90-ac17-f664df1737a4 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:08.029977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-13b5ea5e-aec8-4b90-ac17-f664df1737a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:08.087744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1178/2359] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:08.095375 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742b8df-26d9-400c-b5f3-e77f35bf3a8a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:08.095697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742b8df-26d9-400c-b5f3-e77f35bf3a8a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:08.095951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742b8df-26d9-400c-b5f3-e77f35bf3a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:08.115419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8742b8df-26d9-400c-b5f3-e77f35bf3a8a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:08.116613 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8742b8df-26d9-400c-b5f3-e77f35bf3a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:08.124516 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1182/2360] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:08.128675 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5ea5e-aec8-4b90-ac17-f664df1737a4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:08.139253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5ea5e-aec8-4b90-ac17-f664df1737a4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:08.144390 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9e36f-76ba-4ab4-9c03-4c661db31b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:08.144780 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9e36f-76ba-4ab4-9c03-4c661db31b85 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:08.145064 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9e36f-76ba-4ab4-9c03-4c661db31b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:08.145341 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9e36f-76ba-4ab4-9c03-4c661db31b85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:08.146128 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9e36f-76ba-4ab4-9c03-4c661db31b85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:11:08.146436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9e36f-76ba-4ab4-9c03-4c661db31b85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:08.148683 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9e36f-76ba-4ab4-9c03-4c661db31b85 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:08.160906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1179/2361] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:11:08.166110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742b8df-26d9-400c-b5f3-e77f35bf3a8a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:08.175616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742b8df-26d9-400c-b5f3-e77f35bf3a8a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:08.180438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15266d70-017b-4210-a594-af9a383feb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:08.181153 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15266d70-017b-4210-a594-af9a383feb4e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:08.181440 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15266d70-017b-4210-a594-af9a383feb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:08.181770 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15266d70-017b-4210-a594-af9a383feb4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:08.182466 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15266d70-017b-4210-a594-af9a383feb4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:08.184381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15266d70-017b-4210-a594-af9a383feb4e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:08.254404 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1183/2362] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:08 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:08.258943 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9e36f-76ba-4ab4-9c03-4c661db31b85 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:08.273506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9e36f-76ba-4ab4-9c03-4c661db31b85 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:08.347856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cede6-4864-4966-99f1-0a36d1878e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:08.349093 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cede6-4864-4966-99f1-0a36d1878e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:08.349451 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cede6-4864-4966-99f1-0a36d1878e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:08.349880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cede6-4864-4966-99f1-0a36d1878e3e admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:08.350739 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cede6-4864-4966-99f1-0a36d1878e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:08.353226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cede6-4864-4966-99f1-0a36d1878e3e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:08.440797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1180/2363] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:08 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:08.445550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15266d70-017b-4210-a594-af9a383feb4e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:08.453376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15266d70-017b-4210-a594-af9a383feb4e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:08.458161 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fe759-32a8-48be-a780-50f3ed594cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:08.458826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fe759-32a8-48be-a780-50f3ed594cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:08.459111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fe759-32a8-48be-a780-50f3ed594cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:08.459388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fe759-32a8-48be-a780-50f3ed594cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:08.460720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fe759-32a8-48be-a780-50f3ed594cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:08.463123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fe759-32a8-48be-a780-50f3ed594cb1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:08.473580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1184/2364] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:08.480940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cede6-4864-4966-99f1-0a36d1878e3e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:08.491018 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cede6-4864-4966-99f1-0a36d1878e3e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:08.496050 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cb096-9d76-4eaf-9f21-3ad83e92b7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:08.496717 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cb096-9d76-4eaf-9f21-3ad83e92b7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:08.497000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cb096-9d76-4eaf-9f21-3ad83e92b7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:08.497276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cb096-9d76-4eaf-9f21-3ad83e92b7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:08.498102 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cb096-9d76-4eaf-9f21-3ad83e92b7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:08.499726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cb096-9d76-4eaf-9f21-3ad83e92b7a4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:08.511358 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1181/2365] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:08.518237 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fe759-32a8-48be-a780-50f3ed594cb1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:08.530733 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fe759-32a8-48be-a780-50f3ed594cb1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:08.535723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779c851-a3ce-4452-9e06-84bb9e004d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:08.537109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779c851-a3ce-4452-9e06-84bb9e004d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:08.537394 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779c851-a3ce-4452-9e06-84bb9e004d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:08.537705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779c851-a3ce-4452-9e06-84bb9e004d61 admin admin] PATH_INFO: `/v3/projects/c99030877ac74624b7d041f07f772ebd/users/d921d660ad6f40f09843b28e6153af93/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:08.552828 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779c851-a3ce-4452-9e06-84bb9e004d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99030877ac74624b7d041f07f772ebd, user_id=d921d660ad6f40f09843b28e6153af93, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:08.555605 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779c851-a3ce-4452-9e06-84bb9e004d61 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:08.622074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1185/2366] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:08 2022] PUT /identity/v3/projects/c99030877ac74624b7d041f07f772ebd/users/d921d660ad6f40f09843b28e6153af93/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:08.633690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0b5aa-c9f7-4a89-828c-76f775f4e193 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:08.633982 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0b5aa-c9f7-4a89-828c-76f775f4e193 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:08.634288 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0b5aa-c9f7-4a89-828c-76f775f4e193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:08.662278 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-96c0b5aa-c9f7-4a89-828c-76f775f4e193 None None] MFA Rules not processed for user `d921d660ad6f40f09843b28e6153af93`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:08.663501 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-96c0b5aa-c9f7-4a89-828c-76f775f4e193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:08.725438 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1182/2367] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:08.729879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779c851-a3ce-4452-9e06-84bb9e004d61 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:08.788597 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779c851-a3ce-4452-9e06-84bb9e004d61 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:08.793157 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b4cd8-1c34-4bb7-9dba-64e01e22f5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:08.793845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4cd8-1c34-4bb7-9dba-64e01e22f5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:08.794130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4cd8-1c34-4bb7-9dba-64e01e22f5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:08.794407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4cd8-1c34-4bb7-9dba-64e01e22f5b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:08.795081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b4cd8-1c34-4bb7-9dba-64e01e22f5b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:08.796973 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b4cd8-1c34-4bb7-9dba-64e01e22f5b1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:08.883913 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1186/2368] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:08 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:11:08.887813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0b5aa-c9f7-4a89-828c-76f775f4e193 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:08.898430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0b5aa-c9f7-4a89-828c-76f775f4e193 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:08.952202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db2d77-44ac-47fe-99b6-104c7e7fe96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:08.952862 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db2d77-44ac-47fe-99b6-104c7e7fe96e admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:08.953144 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db2d77-44ac-47fe-99b6-104c7e7fe96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:08.953416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db2d77-44ac-47fe-99b6-104c7e7fe96e admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:08.954136 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db2d77-44ac-47fe-99b6-104c7e7fe96e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:08.956039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db2d77-44ac-47fe-99b6-104c7e7fe96e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:09.031710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1183/2369] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:08 2022] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:09.035601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b4cd8-1c34-4bb7-9dba-64e01e22f5b1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:09.045779 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b4cd8-1c34-4bb7-9dba-64e01e22f5b1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:09.050377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f090e-b7e4-4cb2-86cd-bd8ded5f0cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:09.051036 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f090e-b7e4-4cb2-86cd-bd8ded5f0cde admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:09.051321 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f090e-b7e4-4cb2-86cd-bd8ded5f0cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:09.051596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f090e-b7e4-4cb2-86cd-bd8ded5f0cde admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:09.052316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f090e-b7e4-4cb2-86cd-bd8ded5f0cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:09.054445 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f090e-b7e4-4cb2-86cd-bd8ded5f0cde admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:09.064978 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1187/2370] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:09.069418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db2d77-44ac-47fe-99b6-104c7e7fe96e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:09.079781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db2d77-44ac-47fe-99b6-104c7e7fe96e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:09.084385 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54b8d-e99a-4779-9430-b34a61aadfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:09.085281 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54b8d-e99a-4779-9430-b34a61aadfe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:09.085583 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54b8d-e99a-4779-9430-b34a61aadfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:09.085858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54b8d-e99a-4779-9430-b34a61aadfe6 admin admin] PATH_INFO: `/v3/projects/95f81b68c45743ddb641e6b700abbad0/users/68fc50472e99444785f4ecc78461a916/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:09.100141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54b8d-e99a-4779-9430-b34a61aadfe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f81b68c45743ddb641e6b700abbad0, user_id=68fc50472e99444785f4ecc78461a916, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:09.102911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54b8d-e99a-4779-9430-b34a61aadfe6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:09.176483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1184/2371] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:09 2022] PUT /identity/v3/projects/95f81b68c45743ddb641e6b700abbad0/users/68fc50472e99444785f4ecc78461a916/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:11:09.181262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f090e-b7e4-4cb2-86cd-bd8ded5f0cde admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:09.191108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f090e-b7e4-4cb2-86cd-bd8ded5f0cde admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:09.253462 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537959a0-75f7-411c-8837-619a72406ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:09.254160 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537959a0-75f7-411c-8837-619a72406ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:09.254446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537959a0-75f7-411c-8837-619a72406ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:09.254722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537959a0-75f7-411c-8837-619a72406ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:09.255443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537959a0-75f7-411c-8837-619a72406ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:09.257090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537959a0-75f7-411c-8837-619a72406ba5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:09.266437 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1188/2372] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:09.270783 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54b8d-e99a-4779-9430-b34a61aadfe6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:09.281468 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54b8d-e99a-4779-9430-b34a61aadfe6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:09.286114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d1a11-3ecb-4d7f-bc53-a1d42e7f5880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:09.286997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d1a11-3ecb-4d7f-bc53-a1d42e7f5880 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:09.287280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d1a11-3ecb-4d7f-bc53-a1d42e7f5880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:09.287555 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d1a11-3ecb-4d7f-bc53-a1d42e7f5880 admin admin] PATH_INFO: `/v3/projects/95f81b68c45743ddb641e6b700abbad0/users/68fc50472e99444785f4ecc78461a916/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:09.290721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d1a11-3ecb-4d7f-bc53-a1d42e7f5880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f81b68c45743ddb641e6b700abbad0, user_id=68fc50472e99444785f4ecc78461a916, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:09.292746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d1a11-3ecb-4d7f-bc53-a1d42e7f5880 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:09.303153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1185/2373] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:09 2022] PUT /identity/v3/projects/95f81b68c45743ddb641e6b700abbad0/users/68fc50472e99444785f4ecc78461a916/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:09.316262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d6c11-a7e2-4d13-b1ce-6f775cff6cd7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:09.316696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d6c11-a7e2-4d13-b1ce-6f775cff6cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:09.316981 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d6c11-a7e2-4d13-b1ce-6f775cff6cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:09.346070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0f7d6c11-a7e2-4d13-b1ce-6f775cff6cd7 None None] MFA Rules not processed for user `68fc50472e99444785f4ecc78461a916`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:09.347269 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0f7d6c11-a7e2-4d13-b1ce-6f775cff6cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:09.416720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1189/2374] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:09.428051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d1a11-3ecb-4d7f-bc53-a1d42e7f5880 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:09.430439 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7d3d1a11-3ecb-4d7f-bc53-a1d42e7f5880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:09.486100 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d1a11-3ecb-4d7f-bc53-a1d42e7f5880 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:09.490268 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c868e5f-494c-408e-bbcf-ea001a24aae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:09.490918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c868e5f-494c-408e-bbcf-ea001a24aae7 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:09.491206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c868e5f-494c-408e-bbcf-ea001a24aae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:09.492074 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c868e5f-494c-408e-bbcf-ea001a24aae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:09.501296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c868e5f-494c-408e-bbcf-ea001a24aae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:09.502781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c868e5f-494c-408e-bbcf-ea001a24aae7 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:09.512301 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1186/2375] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:09.737127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d6c11-a7e2-4d13-b1ce-6f775cff6cd7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:09.746523 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d6c11-a7e2-4d13-b1ce-6f775cff6cd7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:09.750132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05132b08-80be-48e9-99fa-65d956704f36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:09.750777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05132b08-80be-48e9-99fa-65d956704f36 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:09.751061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05132b08-80be-48e9-99fa-65d956704f36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:09.751336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05132b08-80be-48e9-99fa-65d956704f36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:09.805963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05132b08-80be-48e9-99fa-65d956704f36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:09.807409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05132b08-80be-48e9-99fa-65d956704f36 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:09.816345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1190/2376] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:21.543906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c868e5f-494c-408e-bbcf-ea001a24aae7 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:21.607018 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c868e5f-494c-408e-bbcf-ea001a24aae7 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:21.613465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149d978-3cf1-4805-b79e-fb74cfd72ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:21.614689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d978-3cf1-4805-b79e-fb74cfd72ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:21.618711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d978-3cf1-4805-b79e-fb74cfd72ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:21.618711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d978-3cf1-4805-b79e-fb74cfd72ed3 admin admin] PATH_INFO: `/v3/users/d921d660ad6f40f09843b28e6153af93` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:21.618711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149d978-3cf1-4805-b79e-fb74cfd72ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d921d660ad6f40f09843b28e6153af93)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:21.621071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149d978-3cf1-4805-b79e-fb74cfd72ed3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:21.829130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4149d978-3cf1-4805-b79e-fb74cfd72ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd921d660ad6f40f09843b28e6153af93'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:21.906107 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4149d978-3cf1-4805-b79e-fb74cfd72ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd921d660ad6f40f09843b28e6153af93'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:21.913994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4149d978-3cf1-4805-b79e-fb74cfd72ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd921d660ad6f40f09843b28e6153af93'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:21.914647 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4149d978-3cf1-4805-b79e-fb74cfd72ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd921d660ad6f40f09843b28e6153af93'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:21.915248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-4149d978-3cf1-4805-b79e-fb74cfd72ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd921d660ad6f40f09843b28e6153af93'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:21.932762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1187/2377] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:21 2022] DELETE /identity/v3/users/d921d660ad6f40f09843b28e6153af93 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:21.937555 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614e208-523a-4549-a7a6-2da90ceaef40 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:21.938111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614e208-523a-4549-a7a6-2da90ceaef40 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:21.938305 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614e208-523a-4549-a7a6-2da90ceaef40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:21.956058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3614e208-523a-4549-a7a6-2da90ceaef40 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:21.957263 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3614e208-523a-4549-a7a6-2da90ceaef40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:22.025467 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1191/2378] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:22.035426 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149d978-3cf1-4805-b79e-fb74cfd72ed3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:22.037130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4149d978-3cf1-4805-b79e-fb74cfd72ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:22.130151 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149d978-3cf1-4805-b79e-fb74cfd72ed3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:22.135443 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57270596-4d67-411a-9dce-d56ef990490b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:22.136568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57270596-4d67-411a-9dce-d56ef990490b service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:22.137034 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57270596-4d67-411a-9dce-d56ef990490b service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:22.137498 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57270596-4d67-411a-9dce-d56ef990490b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:22.152615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57270596-4d67-411a-9dce-d56ef990490b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:22.154235 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57270596-4d67-411a-9dce-d56ef990490b service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:22.172339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1188/2379] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:22.640776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614e208-523a-4549-a7a6-2da90ceaef40 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:22.642588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3614e208-523a-4549-a7a6-2da90ceaef40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:22.666854 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614e208-523a-4549-a7a6-2da90ceaef40 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:22.675097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:22.676222 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:22.676709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:22.677187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] PATH_INFO: `/v3/projects/c99030877ac74624b7d041f07f772ebd` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:22.679318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99030877ac74624b7d041f07f772ebd)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:22.685937 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:22.819352 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99030877ac74624b7d041f07f772ebd', 'request_id': 'req-b2ed41e8-9727-488e-b5d2-207d88b62126'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:22.827779 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99030877ac74624b7d041f07f772ebd', 'request_id': 'req-b2ed41e8-9727-488e-b5d2-207d88b62126'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:22.833275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99030877ac74624b7d041f07f772ebd', 'request_id': 'req-b2ed41e8-9727-488e-b5d2-207d88b62126'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:22.921483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] The token cache is being invalidate because project c99030877ac74624b7d041f07f772ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:22.921803 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:22.922437 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:22.923983 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1192/2380] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:22 2022] DELETE /identity/v3/projects/c99030877ac74624b7d041f07f772ebd => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:22.928203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57270596-4d67-411a-9dce-d56ef990490b service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:22.938758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57270596-4d67-411a-9dce-d56ef990490b service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:22.999429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037120a1-5a09-4382-b53e-8f4ec280bc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:23.000358 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037120a1-5a09-4382-b53e-8f4ec280bc9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:23.000646 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037120a1-5a09-4382-b53e-8f4ec280bc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:23.000923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037120a1-5a09-4382-b53e-8f4ec280bc9c admin admin] PATH_INFO: `/v3/users/68fc50472e99444785f4ecc78461a916` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:23.002166 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037120a1-5a09-4382-b53e-8f4ec280bc9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fc50472e99444785f4ecc78461a916)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:23.004102 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037120a1-5a09-4382-b53e-8f4ec280bc9c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:23.182491 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-037120a1-5a09-4382-b53e-8f4ec280bc9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fc50472e99444785f4ecc78461a916'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:23.264142 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-037120a1-5a09-4382-b53e-8f4ec280bc9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fc50472e99444785f4ecc78461a916'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:23.271309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-037120a1-5a09-4382-b53e-8f4ec280bc9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fc50472e99444785f4ecc78461a916'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:23.273685 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-037120a1-5a09-4382-b53e-8f4ec280bc9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fc50472e99444785f4ecc78461a916'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:23.273685 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-037120a1-5a09-4382-b53e-8f4ec280bc9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fc50472e99444785f4ecc78461a916'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:23.289299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1189/2381] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:22 2022] DELETE /identity/v3/users/68fc50472e99444785f4ecc78461a916 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:11:23.701906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:23.704123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:23.717144 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed41e8-9727-488e-b5d2-207d88b62126 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:23.774885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:23.775999 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:23.776288 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:23.776565 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e admin admin] PATH_INFO: `/v3/projects/95f81b68c45743ddb641e6b700abbad0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:23.777771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f81b68c45743ddb641e6b700abbad0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:23.779708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:23.901092 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f81b68c45743ddb641e6b700abbad0', 'request_id': 'req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:23.907645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f81b68c45743ddb641e6b700abbad0', 'request_id': 'req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:23.913335 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f81b68c45743ddb641e6b700abbad0', 'request_id': 'req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:24.007908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e admin admin] The token cache is being invalidate because project 95f81b68c45743ddb641e6b700abbad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:24.008120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:24.008723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-94f9402e-5d7d-42e0-8715-7cc8e1c1825e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:24.010294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1193/2382] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:23 2022] DELETE /identity/v3/projects/95f81b68c45743ddb641e6b700abbad0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:24.015324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25b461-b14d-4707-9af1-15674ec3e72a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:24.015790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25b461-b14d-4707-9af1-15674ec3e72a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:24.015919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25b461-b14d-4707-9af1-15674ec3e72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:24.033805 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-bb25b461-b14d-4707-9af1-15674ec3e72a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:24.034982 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-bb25b461-b14d-4707-9af1-15674ec3e72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:24.101196 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1190/2383] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:24.109683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4073f1-9f07-44fd-afa3-27160f08a7be None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:24.109997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4073f1-9f07-44fd-afa3-27160f08a7be None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:24.110279 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4073f1-9f07-44fd-afa3-27160f08a7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:24.128607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4a4073f1-9f07-44fd-afa3-27160f08a7be None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:24.135245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4a4073f1-9f07-44fd-afa3-27160f08a7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:24.138286 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1194/2384] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:24.142685 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25b461-b14d-4707-9af1-15674ec3e72a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:24.153395 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25b461-b14d-4707-9af1-15674ec3e72a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:24.158018 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c58d1-bed7-4992-a03e-f9665f5de825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:24.158676 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c58d1-bed7-4992-a03e-f9665f5de825 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:24.158962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c58d1-bed7-4992-a03e-f9665f5de825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:24.159240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c58d1-bed7-4992-a03e-f9665f5de825 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:24.159972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c58d1-bed7-4992-a03e-f9665f5de825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:11:24.160302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c58d1-bed7-4992-a03e-f9665f5de825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:24.161945 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c58d1-bed7-4992-a03e-f9665f5de825 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:24.176674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1191/2385] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:11:24.177781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4073f1-9f07-44fd-afa3-27160f08a7be None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:24.187123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4073f1-9f07-44fd-afa3-27160f08a7be None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:24.192001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d85734-76a3-4688-bc38-ff31fa051437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:24.192846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85734-76a3-4688-bc38-ff31fa051437 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:24.193131 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85734-76a3-4688-bc38-ff31fa051437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:24.193514 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85734-76a3-4688-bc38-ff31fa051437 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:24.194273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d85734-76a3-4688-bc38-ff31fa051437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:24.196682 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d85734-76a3-4688-bc38-ff31fa051437 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:24.305055 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1195/2386] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:24 2022] POST /identity/v3/projects => generated 407 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:11:24.306334 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c58d1-bed7-4992-a03e-f9665f5de825 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:24.317839 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c58d1-bed7-4992-a03e-f9665f5de825 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:24.377990 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fbad7-bded-4acc-b196-24af9b7adf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:24.378884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fbad7-bded-4acc-b196-24af9b7adf1d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:24.379228 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fbad7-bded-4acc-b196-24af9b7adf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:24.379512 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fbad7-bded-4acc-b196-24af9b7adf1d admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:24.380208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fbad7-bded-4acc-b196-24af9b7adf1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:24.382166 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fbad7-bded-4acc-b196-24af9b7adf1d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:24.527694 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1192/2387] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:24 2022] POST /identity/v3/users => generated 304 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:11:24.531696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d85734-76a3-4688-bc38-ff31fa051437 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:24.542772 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d85734-76a3-4688-bc38-ff31fa051437 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:24.548582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bd002-6f78-40a1-9451-8491adcac0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:24.548582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bd002-6f78-40a1-9451-8491adcac0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:24.548582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bd002-6f78-40a1-9451-8491adcac0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:24.548582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bd002-6f78-40a1-9451-8491adcac0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:24.549319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bd002-6f78-40a1-9451-8491adcac0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:24.550959 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bd002-6f78-40a1-9451-8491adcac0f1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:24.565002 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1196/2388] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:24.566384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fbad7-bded-4acc-b196-24af9b7adf1d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:24.576889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fbad7-bded-4acc-b196-24af9b7adf1d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:24.582288 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a90b0-8fcf-44eb-8693-17967cbc83ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:24.583074 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a90b0-8fcf-44eb-8693-17967cbc83ee admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:24.583369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a90b0-8fcf-44eb-8693-17967cbc83ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:24.583931 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a90b0-8fcf-44eb-8693-17967cbc83ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:24.584381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a90b0-8fcf-44eb-8693-17967cbc83ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:24.586028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a90b0-8fcf-44eb-8693-17967cbc83ee admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:24.599707 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1193/2389] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:24.600838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bd002-6f78-40a1-9451-8491adcac0f1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:24.612984 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bd002-6f78-40a1-9451-8491adcac0f1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:24.620876 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e785f26-3102-4bf2-bd9d-04d4591e408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:24.621822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e785f26-3102-4bf2-bd9d-04d4591e408a admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:24.622106 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e785f26-3102-4bf2-bd9d-04d4591e408a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:24.622383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e785f26-3102-4bf2-bd9d-04d4591e408a admin admin] PATH_INFO: `/v3/projects/9df75da318e04dfe8ee3f1f8d17300e4/users/2126f1577df14930911c850490b5db95/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:24.638654 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e785f26-3102-4bf2-bd9d-04d4591e408a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df75da318e04dfe8ee3f1f8d17300e4, user_id=2126f1577df14930911c850490b5db95, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:24.641519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e785f26-3102-4bf2-bd9d-04d4591e408a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:24.758215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1197/2390] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:24 2022] PUT /identity/v3/projects/9df75da318e04dfe8ee3f1f8d17300e4/users/2126f1577df14930911c850490b5db95/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:24.768481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c190b3-e536-4f99-a21a-83a531711afb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:24.768777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c190b3-e536-4f99-a21a-83a531711afb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:24.769059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c190b3-e536-4f99-a21a-83a531711afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:24.795592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-74c190b3-e536-4f99-a21a-83a531711afb None None] MFA Rules not processed for user `2126f1577df14930911c850490b5db95`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:24.796786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-74c190b3-e536-4f99-a21a-83a531711afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:24.863625 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1194/2391] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:24.868728 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e785f26-3102-4bf2-bd9d-04d4591e408a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:24.937630 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e785f26-3102-4bf2-bd9d-04d4591e408a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:24.952964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220443f-c947-4da8-a0ef-06e45e4b42dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:24.952964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220443f-c947-4da8-a0ef-06e45e4b42dc admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:24.952964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220443f-c947-4da8-a0ef-06e45e4b42dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:24.952964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220443f-c947-4da8-a0ef-06e45e4b42dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:24.953393 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220443f-c947-4da8-a0ef-06e45e4b42dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:24.953393 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220443f-c947-4da8-a0ef-06e45e4b42dc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:25.038694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1198/2392] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:24 2022] POST /identity/v3/projects => generated 409 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:25.043246 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c190b3-e536-4f99-a21a-83a531711afb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:25.053802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c190b3-e536-4f99-a21a-83a531711afb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:25.109510 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c1794-c505-4b85-b9a0-22e57b88f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:25.110155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c1794-c505-4b85-b9a0-22e57b88f377 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:25.110440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c1794-c505-4b85-b9a0-22e57b88f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:25.110720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c1794-c505-4b85-b9a0-22e57b88f377 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:25.111423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c1794-c505-4b85-b9a0-22e57b88f377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:25.113496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c1794-c505-4b85-b9a0-22e57b88f377 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:25.215078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1195/2393] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:25 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:25.218893 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220443f-c947-4da8-a0ef-06e45e4b42dc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:25.229547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220443f-c947-4da8-a0ef-06e45e4b42dc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:25.234120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a4196-81a2-41a0-95e2-190ced839e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:25.234771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a4196-81a2-41a0-95e2-190ced839e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:25.235057 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a4196-81a2-41a0-95e2-190ced839e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:25.235332 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a4196-81a2-41a0-95e2-190ced839e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:25.236047 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a4196-81a2-41a0-95e2-190ced839e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:25.237657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a4196-81a2-41a0-95e2-190ced839e5e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:25.248773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1199/2394] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:25.252898 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c1794-c505-4b85-b9a0-22e57b88f377 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:25.262817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c1794-c505-4b85-b9a0-22e57b88f377 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:25.267445 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243fe36-40cc-4e30-b4d0-3cd7dca263b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:25.268413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243fe36-40cc-4e30-b4d0-3cd7dca263b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:25.268695 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243fe36-40cc-4e30-b4d0-3cd7dca263b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:25.268965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243fe36-40cc-4e30-b4d0-3cd7dca263b4 admin admin] PATH_INFO: `/v3/projects/b103788c84244cc9bb2dae80d237929c/users/7f825b5143884552845ebe04eafea8b9/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:25.283719 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243fe36-40cc-4e30-b4d0-3cd7dca263b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b103788c84244cc9bb2dae80d237929c, user_id=7f825b5143884552845ebe04eafea8b9, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:25.286451 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243fe36-40cc-4e30-b4d0-3cd7dca263b4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:25.367618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1196/2395] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:25 2022] PUT /identity/v3/projects/b103788c84244cc9bb2dae80d237929c/users/7f825b5143884552845ebe04eafea8b9/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:11:25.371501 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a4196-81a2-41a0-95e2-190ced839e5e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:25.381205 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a4196-81a2-41a0-95e2-190ced839e5e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:25.435879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e084c-8e0f-488d-ae4a-252dd8a5a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:25.436577 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e084c-8e0f-488d-ae4a-252dd8a5a5ee admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:25.436885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e084c-8e0f-488d-ae4a-252dd8a5a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:25.437166 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e084c-8e0f-488d-ae4a-252dd8a5a5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:25.437936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e084c-8e0f-488d-ae4a-252dd8a5a5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:25.439571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e084c-8e0f-488d-ae4a-252dd8a5a5ee admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:25.450208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1200/2396] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:25.454464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243fe36-40cc-4e30-b4d0-3cd7dca263b4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:25.465270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243fe36-40cc-4e30-b4d0-3cd7dca263b4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:25.470153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea57aa4-52d5-491a-9d95-2f4fbb8060e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:25.477130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea57aa4-52d5-491a-9d95-2f4fbb8060e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:25.477130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea57aa4-52d5-491a-9d95-2f4fbb8060e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:25.477130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea57aa4-52d5-491a-9d95-2f4fbb8060e8 admin admin] PATH_INFO: `/v3/projects/b103788c84244cc9bb2dae80d237929c/users/7f825b5143884552845ebe04eafea8b9/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:25.477130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea57aa4-52d5-491a-9d95-2f4fbb8060e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b103788c84244cc9bb2dae80d237929c, user_id=7f825b5143884552845ebe04eafea8b9, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:25.477130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea57aa4-52d5-491a-9d95-2f4fbb8060e8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:25.486995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1197/2397] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:25 2022] PUT /identity/v3/projects/b103788c84244cc9bb2dae80d237929c/users/7f825b5143884552845ebe04eafea8b9/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:25.498367 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2e7e9-c65d-40f7-9fb0-cd3c115e0c4c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:25.498729 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2e7e9-c65d-40f7-9fb0-cd3c115e0c4c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:25.499075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2e7e9-c65d-40f7-9fb0-cd3c115e0c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:25.526486 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5ca2e7e9-c65d-40f7-9fb0-cd3c115e0c4c None None] MFA Rules not processed for user `7f825b5143884552845ebe04eafea8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:25.528815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5ca2e7e9-c65d-40f7-9fb0-cd3c115e0c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:25.593119 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1201/2398] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:25 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:25.604406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea57aa4-52d5-491a-9d95-2f4fbb8060e8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:25.606115 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6ea57aa4-52d5-491a-9d95-2f4fbb8060e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:25.678090 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea57aa4-52d5-491a-9d95-2f4fbb8060e8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:25.681659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7aa3f-f60d-40df-bb4a-a26db441d768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:25.682306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7aa3f-f60d-40df-bb4a-a26db441d768 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:25.682594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7aa3f-f60d-40df-bb4a-a26db441d768 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:25.682879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7aa3f-f60d-40df-bb4a-a26db441d768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:25.691764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7aa3f-f60d-40df-bb4a-a26db441d768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:25.693184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7aa3f-f60d-40df-bb4a-a26db441d768 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:25.702760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1198/2399] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:25 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:26.018667 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2e7e9-c65d-40f7-9fb0-cd3c115e0c4c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:26.028519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2e7e9-c65d-40f7-9fb0-cd3c115e0c4c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:26.032093 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212d210-37ad-45bb-a480-e2d0af031bca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:26.032780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212d210-37ad-45bb-a480-e2d0af031bca service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:26.033064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212d210-37ad-45bb-a480-e2d0af031bca service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:26.033342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212d210-37ad-45bb-a480-e2d0af031bca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:26.089810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212d210-37ad-45bb-a480-e2d0af031bca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:26.091399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212d210-37ad-45bb-a480-e2d0af031bca service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:26.100700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1202/2400] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:28.774961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7aa3f-f60d-40df-bb4a-a26db441d768 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:28.776673 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9ca7aa3f-f60d-40df-bb4a-a26db441d768 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:28.834570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7aa3f-f60d-40df-bb4a-a26db441d768 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:28.838911 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5bee5-cf94-45e7-903b-f6b67408437d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:28.840131 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5bee5-cf94-45e7-903b-f6b67408437d service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:28.840422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5bee5-cf94-45e7-903b-f6b67408437d service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:28.840712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5bee5-cf94-45e7-903b-f6b67408437d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:28.846734 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2ff5bee5-cf94-45e7-903b-f6b67408437d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:28.909033 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5bee5-cf94-45e7-903b-f6b67408437d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:28.910514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5bee5-cf94-45e7-903b-f6b67408437d service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:28.920001 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1199/2401] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:33.225967 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212d210-37ad-45bb-a480-e2d0af031bca service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:33.227439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4212d210-37ad-45bb-a480-e2d0af031bca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:33.241701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212d210-37ad-45bb-a480-e2d0af031bca service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:33.246105 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cdf77-adc8-4fcc-aa6e-e0e430e6478b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:33.247012 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cdf77-adc8-4fcc-aa6e-e0e430e6478b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:33.247273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cdf77-adc8-4fcc-aa6e-e0e430e6478b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:33.247544 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cdf77-adc8-4fcc-aa6e-e0e430e6478b admin admin] PATH_INFO: `/v3/users/baed8aff24b64c788f40e6d7dd1f99c3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:33.248705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cdf77-adc8-4fcc-aa6e-e0e430e6478b admin admin] RBAC: Authorizing `identity:delete_user(user_id=baed8aff24b64c788f40e6d7dd1f99c3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:33.250724 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cdf77-adc8-4fcc-aa6e-e0e430e6478b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:33.508679 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7b4cdf77-adc8-4fcc-aa6e-e0e430e6478b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baed8aff24b64c788f40e6d7dd1f99c3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:33.515286 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7b4cdf77-adc8-4fcc-aa6e-e0e430e6478b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baed8aff24b64c788f40e6d7dd1f99c3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:33.584232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7b4cdf77-adc8-4fcc-aa6e-e0e430e6478b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baed8aff24b64c788f40e6d7dd1f99c3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:33.584856 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7b4cdf77-adc8-4fcc-aa6e-e0e430e6478b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baed8aff24b64c788f40e6d7dd1f99c3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:33.585491 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7b4cdf77-adc8-4fcc-aa6e-e0e430e6478b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baed8aff24b64c788f40e6d7dd1f99c3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:33.602954 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1203/2402] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:33 2022] DELETE /identity/v3/users/baed8aff24b64c788f40e6d7dd1f99c3 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:33.864256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5bee5-cf94-45e7-903b-f6b67408437d service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:33.876923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5bee5-cf94-45e7-903b-f6b67408437d service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:33.936159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6c978-bfef-467b-8512-b61941ec3c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:33.937024 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c978-bfef-467b-8512-b61941ec3c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:33.937308 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c978-bfef-467b-8512-b61941ec3c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:33.937638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c978-bfef-467b-8512-b61941ec3c81 admin admin] PATH_INFO: `/v3/projects/ad1ed05b84e545989b4753dab7bd4b3f` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:33.939194 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6c978-bfef-467b-8512-b61941ec3c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1ed05b84e545989b4753dab7bd4b3f)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:33.941234 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6c978-bfef-467b-8512-b61941ec3c81 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:34.037762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eca6c978-bfef-467b-8512-b61941ec3c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1ed05b84e545989b4753dab7bd4b3f', 'request_id': 'req-eca6c978-bfef-467b-8512-b61941ec3c81'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:34.048769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eca6c978-bfef-467b-8512-b61941ec3c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1ed05b84e545989b4753dab7bd4b3f', 'request_id': 'req-eca6c978-bfef-467b-8512-b61941ec3c81'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:34.055615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eca6c978-bfef-467b-8512-b61941ec3c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1ed05b84e545989b4753dab7bd4b3f', 'request_id': 'req-eca6c978-bfef-467b-8512-b61941ec3c81'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:34.143623 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eca6c978-bfef-467b-8512-b61941ec3c81 admin admin] The token cache is being invalidate because project ad1ed05b84e545989b4753dab7bd4b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:34.143912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eca6c978-bfef-467b-8512-b61941ec3c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:34.144537 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-eca6c978-bfef-467b-8512-b61941ec3c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:34.146116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1200/2403] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:33 2022] DELETE /identity/v3/projects/ad1ed05b84e545989b4753dab7bd4b3f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:34.151404 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606298d-c8d2-4fb5-8224-5a94d563caa6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:34.151696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606298d-c8d2-4fb5-8224-5a94d563caa6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:34.151970 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606298d-c8d2-4fb5-8224-5a94d563caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:34.170501 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e606298d-c8d2-4fb5-8224-5a94d563caa6 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:34.171708 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e606298d-c8d2-4fb5-8224-5a94d563caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:34.231735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1204/2404] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:34.239570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068090eb-a2bf-45aa-98d1-374471c34130 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:34.239865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068090eb-a2bf-45aa-98d1-374471c34130 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:34.240146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068090eb-a2bf-45aa-98d1-374471c34130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:34.268135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-068090eb-a2bf-45aa-98d1-374471c34130 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:34.268135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-068090eb-a2bf-45aa-98d1-374471c34130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:34.268967 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1201/2405] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:34.274005 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606298d-c8d2-4fb5-8224-5a94d563caa6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:34.283611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606298d-c8d2-4fb5-8224-5a94d563caa6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:34.290133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53763d2b-5490-419e-b6fe-d37875df6461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:34.291345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53763d2b-5490-419e-b6fe-d37875df6461 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:34.291859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53763d2b-5490-419e-b6fe-d37875df6461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:34.292359 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53763d2b-5490-419e-b6fe-d37875df6461 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:34.293633 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53763d2b-5490-419e-b6fe-d37875df6461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:11:34.293970 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53763d2b-5490-419e-b6fe-d37875df6461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:34.295641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53763d2b-5490-419e-b6fe-d37875df6461 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:34.307495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1205/2406] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:11:34.311967 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068090eb-a2bf-45aa-98d1-374471c34130 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:34.321225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068090eb-a2bf-45aa-98d1-374471c34130 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:34.326104 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9220e-be1a-46be-9b3a-d0020447c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:34.326741 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9220e-be1a-46be-9b3a-d0020447c471 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:34.327022 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9220e-be1a-46be-9b3a-d0020447c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:34.327294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9220e-be1a-46be-9b3a-d0020447c471 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:34.336411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9220e-be1a-46be-9b3a-d0020447c471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:34.336411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9220e-be1a-46be-9b3a-d0020447c471 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:34.480044 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1202/2407] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:34 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:34.484344 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53763d2b-5490-419e-b6fe-d37875df6461 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:34.496516 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53763d2b-5490-419e-b6fe-d37875df6461 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:34.566017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a774d-7827-4d22-af55-e94d4bd8376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:34.566923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a774d-7827-4d22-af55-e94d4bd8376b admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:34.567386 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a774d-7827-4d22-af55-e94d4bd8376b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:34.567856 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a774d-7827-4d22-af55-e94d4bd8376b admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:34.568777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a774d-7827-4d22-af55-e94d4bd8376b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:34.578000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a774d-7827-4d22-af55-e94d4bd8376b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:34.777454 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1206/2408] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:34 2022] POST /identity/v3/users => generated 283 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:34.781337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9220e-be1a-46be-9b3a-d0020447c471 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:34.803517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9220e-be1a-46be-9b3a-d0020447c471 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:34.808532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4b673-ad3f-4e9b-9ff5-155675900948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:34.809361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4b673-ad3f-4e9b-9ff5-155675900948 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:34.809786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4b673-ad3f-4e9b-9ff5-155675900948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:34.810142 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4b673-ad3f-4e9b-9ff5-155675900948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:34.810956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4b673-ad3f-4e9b-9ff5-155675900948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:34.812743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4b673-ad3f-4e9b-9ff5-155675900948 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:34.828900 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1203/2409] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:34.830359 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a774d-7827-4d22-af55-e94d4bd8376b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:34.857975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a774d-7827-4d22-af55-e94d4bd8376b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:34.863110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469a91e-06c3-4cf4-b652-d64fcb2b8876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:34.863891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469a91e-06c3-4cf4-b652-d64fcb2b8876 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:34.864248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469a91e-06c3-4cf4-b652-d64fcb2b8876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:34.864654 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469a91e-06c3-4cf4-b652-d64fcb2b8876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:34.865492 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469a91e-06c3-4cf4-b652-d64fcb2b8876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:34.867340 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469a91e-06c3-4cf4-b652-d64fcb2b8876 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:34.878765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1207/2410] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:34.891366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4b673-ad3f-4e9b-9ff5-155675900948 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:34.903144 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4b673-ad3f-4e9b-9ff5-155675900948 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:34.908188 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56362d61-4dba-44a0-be99-30b3f9c06beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:34.909860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56362d61-4dba-44a0-be99-30b3f9c06beb admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:34.910054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56362d61-4dba-44a0-be99-30b3f9c06beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:34.910339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56362d61-4dba-44a0-be99-30b3f9c06beb admin admin] PATH_INFO: `/v3/projects/082503cbe3a94f9e9b2bb0248f1ee293/users/f20e82a312084f418ca4a97d4e354632/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:34.928552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56362d61-4dba-44a0-be99-30b3f9c06beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=082503cbe3a94f9e9b2bb0248f1ee293, user_id=f20e82a312084f418ca4a97d4e354632, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:34.931366 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56362d61-4dba-44a0-be99-30b3f9c06beb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:35.089671 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1204/2411] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:34 2022] PUT /identity/v3/projects/082503cbe3a94f9e9b2bb0248f1ee293/users/f20e82a312084f418ca4a97d4e354632/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:35.110484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea0b3-0a06-455f-919e-c5859dc84a4d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:35.110980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea0b3-0a06-455f-919e-c5859dc84a4d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:35.111656 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea0b3-0a06-455f-919e-c5859dc84a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:35.159489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-297ea0b3-0a06-455f-919e-c5859dc84a4d None None] MFA Rules not processed for user `f20e82a312084f418ca4a97d4e354632`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:35.160778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-297ea0b3-0a06-455f-919e-c5859dc84a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:35.234054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1208/2412] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:11:35.236427 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56362d61-4dba-44a0-be99-30b3f9c06beb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:35.238489 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-56362d61-4dba-44a0-be99-30b3f9c06beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:35.238690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ea0b3-0a06-455f-919e-c5859dc84a4d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:35.305948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56362d61-4dba-44a0-be99-30b3f9c06beb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:35.311598 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb578e7-ddb9-4402-ac57-15bfa8a54668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:35.312234 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ea0b3-0a06-455f-919e-c5859dc84a4d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:35.312830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb578e7-ddb9-4402-ac57-15bfa8a54668 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:35.313338 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb578e7-ddb9-4402-ac57-15bfa8a54668 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:35.313860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb578e7-ddb9-4402-ac57-15bfa8a54668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:35.316659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dfb578e7-ddb9-4402-ac57-15bfa8a54668 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:35.317851 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7efd0-0f66-40f3-9b28-375f587a6cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:35.318596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7efd0-0f66-40f3-9b28-375f587a6cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:35.319021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7efd0-0f66-40f3-9b28-375f587a6cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:35.319306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7efd0-0f66-40f3-9b28-375f587a6cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:35.320876 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7efd0-0f66-40f3-9b28-375f587a6cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:35.324682 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7efd0-0f66-40f3-9b28-375f587a6cb2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:35.337821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb578e7-ddb9-4402-ac57-15bfa8a54668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:35.339795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb578e7-ddb9-4402-ac57-15bfa8a54668 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:35.357888 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1205/2413] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:35.432714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1209/2414] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:35 2022] POST /identity/v3/projects => generated 363 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:35.436750 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb578e7-ddb9-4402-ac57-15bfa8a54668 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:35.446661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb578e7-ddb9-4402-ac57-15bfa8a54668 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:35.534370 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981d36f-fa0f-45c5-9496-4591b2a0b802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:35.535176 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981d36f-fa0f-45c5-9496-4591b2a0b802 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:35.535471 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981d36f-fa0f-45c5-9496-4591b2a0b802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:35.535773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981d36f-fa0f-45c5-9496-4591b2a0b802 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:35.536495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981d36f-fa0f-45c5-9496-4591b2a0b802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:35.539344 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981d36f-fa0f-45c5-9496-4591b2a0b802 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:35.654284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1206/2415] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:35 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:35.658414 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7efd0-0f66-40f3-9b28-375f587a6cb2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:35.672068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7efd0-0f66-40f3-9b28-375f587a6cb2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:35.676906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b26887-c158-490f-b427-60afe5a7c5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:35.680127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b26887-c158-490f-b427-60afe5a7c5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:35.680127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b26887-c158-490f-b427-60afe5a7c5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:35.680127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b26887-c158-490f-b427-60afe5a7c5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:35.680127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b26887-c158-490f-b427-60afe5a7c5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:35.685391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b26887-c158-490f-b427-60afe5a7c5b8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:35.701272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1210/2416] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:35.705519 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981d36f-fa0f-45c5-9496-4591b2a0b802 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:35.718493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981d36f-fa0f-45c5-9496-4591b2a0b802 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:35.723369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb46f82-b6df-411e-9593-8a580810390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:35.724258 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb46f82-b6df-411e-9593-8a580810390b admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:35.724542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb46f82-b6df-411e-9593-8a580810390b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:35.724817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb46f82-b6df-411e-9593-8a580810390b admin admin] PATH_INFO: `/v3/projects/457e971be5fa499a82fac42bca2bdd69/users/0592ac82ab3d4a28ade2d709085ee567/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:35.742847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb46f82-b6df-411e-9593-8a580810390b admin admin] RBAC: Authorizing `identity:create_grant(project_id=457e971be5fa499a82fac42bca2bdd69, user_id=0592ac82ab3d4a28ade2d709085ee567, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:35.745504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb46f82-b6df-411e-9593-8a580810390b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:35.839069 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1207/2417] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:35 2022] PUT /identity/v3/projects/457e971be5fa499a82fac42bca2bdd69/users/0592ac82ab3d4a28ade2d709085ee567/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:35.845212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b26887-c158-490f-b427-60afe5a7c5b8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:35.856695 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b26887-c158-490f-b427-60afe5a7c5b8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:35.924261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec21f2-e3eb-4c81-a2f7-383613891133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:35.924950 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec21f2-e3eb-4c81-a2f7-383613891133 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:35.925274 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec21f2-e3eb-4c81-a2f7-383613891133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:35.925516 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec21f2-e3eb-4c81-a2f7-383613891133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:35.926303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec21f2-e3eb-4c81-a2f7-383613891133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:35.929303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec21f2-e3eb-4c81-a2f7-383613891133 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:35.939489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1211/2418] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:35.943686 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb46f82-b6df-411e-9593-8a580810390b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:35.954441 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb46f82-b6df-411e-9593-8a580810390b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:35.961361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1201552-4eed-4619-880b-0e20421b021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:35.962477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201552-4eed-4619-880b-0e20421b021d admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:35.962940 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201552-4eed-4619-880b-0e20421b021d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:35.963388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1201552-4eed-4619-880b-0e20421b021d admin admin] PATH_INFO: `/v3/projects/457e971be5fa499a82fac42bca2bdd69/users/0592ac82ab3d4a28ade2d709085ee567/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:35.966283 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1201552-4eed-4619-880b-0e20421b021d admin admin] RBAC: Authorizing `identity:create_grant(project_id=457e971be5fa499a82fac42bca2bdd69, user_id=0592ac82ab3d4a28ade2d709085ee567, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:35.969007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1201552-4eed-4619-880b-0e20421b021d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:35.982781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1208/2419] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:35 2022] PUT /identity/v3/projects/457e971be5fa499a82fac42bca2bdd69/users/0592ac82ab3d4a28ade2d709085ee567/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:35.992792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd79a41-2e8f-44c6-a101-fc81b49c8118 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:35.993194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd79a41-2e8f-44c6-a101-fc81b49c8118 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:35.993632 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd79a41-2e8f-44c6-a101-fc81b49c8118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:36.026418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7fd79a41-2e8f-44c6-a101-fc81b49c8118 None None] MFA Rules not processed for user `0592ac82ab3d4a28ade2d709085ee567`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:36.027762 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7fd79a41-2e8f-44c6-a101-fc81b49c8118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:36.113602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1212/2420] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:36.124232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1201552-4eed-4619-880b-0e20421b021d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:36.126054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c1201552-4eed-4619-880b-0e20421b021d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:36.183726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1201552-4eed-4619-880b-0e20421b021d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:36.187680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c614a-96fc-4888-b0f0-8e59cbec4e52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:36.188375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c614a-96fc-4888-b0f0-8e59cbec4e52 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:36.188661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c614a-96fc-4888-b0f0-8e59cbec4e52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:36.188939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c614a-96fc-4888-b0f0-8e59cbec4e52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:36.198913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c614a-96fc-4888-b0f0-8e59cbec4e52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:36.200394 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c614a-96fc-4888-b0f0-8e59cbec4e52 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:36.210943 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1209/2421] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:36.421673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd79a41-2e8f-44c6-a101-fc81b49c8118 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:36.431304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd79a41-2e8f-44c6-a101-fc81b49c8118 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:36.435049 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d1f52-b43e-45ff-a7a9-fa428a72a734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:36.435758 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1f52-b43e-45ff-a7a9-fa428a72a734 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:36.436111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1f52-b43e-45ff-a7a9-fa428a72a734 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:36.436468 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1f52-b43e-45ff-a7a9-fa428a72a734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:36.495769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d1f52-b43e-45ff-a7a9-fa428a72a734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:36.497251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d1f52-b43e-45ff-a7a9-fa428a72a734 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:36.506170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1213/2422] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:36.596367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c614a-96fc-4888-b0f0-8e59cbec4e52 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:36.597836 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8f4c614a-96fc-4888-b0f0-8e59cbec4e52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:36.663403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c614a-96fc-4888-b0f0-8e59cbec4e52 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:36.669655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52596c2-ab40-43d7-86c6-650b5ddcaac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:36.671320 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52596c2-ab40-43d7-86c6-650b5ddcaac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:36.672323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52596c2-ab40-43d7-86c6-650b5ddcaac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:36.672323 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52596c2-ab40-43d7-86c6-650b5ddcaac6 admin admin] PATH_INFO: `/v3/users/2126f1577df14930911c850490b5db95` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:36.673566 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52596c2-ab40-43d7-86c6-650b5ddcaac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2126f1577df14930911c850490b5db95)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:36.675525 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52596c2-ab40-43d7-86c6-650b5ddcaac6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:36.889884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e52596c2-ab40-43d7-86c6-650b5ddcaac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2126f1577df14930911c850490b5db95'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:36.995440 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e52596c2-ab40-43d7-86c6-650b5ddcaac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2126f1577df14930911c850490b5db95'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:37.003609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e52596c2-ab40-43d7-86c6-650b5ddcaac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2126f1577df14930911c850490b5db95'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:37.004544 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e52596c2-ab40-43d7-86c6-650b5ddcaac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2126f1577df14930911c850490b5db95'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:37.005272 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e52596c2-ab40-43d7-86c6-650b5ddcaac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2126f1577df14930911c850490b5db95'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:37.022996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1210/2423] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:36 2022] DELETE /identity/v3/users/2126f1577df14930911c850490b5db95 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:37.027815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba4f47-8041-43d1-ac3a-cbaca408d78b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:37.028110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba4f47-8041-43d1-ac3a-cbaca408d78b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:37.030284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba4f47-8041-43d1-ac3a-cbaca408d78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:37.048495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a8ba4f47-8041-43d1-ac3a-cbaca408d78b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:37.049745 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a8ba4f47-8041-43d1-ac3a-cbaca408d78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:37.119217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1214/2424] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:37.129509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52596c2-ab40-43d7-86c6-650b5ddcaac6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:37.134998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e52596c2-ab40-43d7-86c6-650b5ddcaac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:37.190300 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52596c2-ab40-43d7-86c6-650b5ddcaac6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:37.193891 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2674f-1e3d-4975-ae72-53436f9447a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:37.194541 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2674f-1e3d-4975-ae72-53436f9447a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:37.194855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2674f-1e3d-4975-ae72-53436f9447a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:37.198587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2674f-1e3d-4975-ae72-53436f9447a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:37.204693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2674f-1e3d-4975-ae72-53436f9447a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:37.206242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2674f-1e3d-4975-ae72-53436f9447a8 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:37.216114 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1211/2425] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:37.709042 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba4f47-8041-43d1-ac3a-cbaca408d78b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:37.716308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a8ba4f47-8041-43d1-ac3a-cbaca408d78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:37.732519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba4f47-8041-43d1-ac3a-cbaca408d78b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:37.737731 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:37.738753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:37.739288 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:37.739639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] PATH_INFO: `/v3/projects/9df75da318e04dfe8ee3f1f8d17300e4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:37.740903 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df75da318e04dfe8ee3f1f8d17300e4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:37.743101 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:37.899459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df75da318e04dfe8ee3f1f8d17300e4', 'request_id': 'req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:37.906791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df75da318e04dfe8ee3f1f8d17300e4', 'request_id': 'req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:37.914719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df75da318e04dfe8ee3f1f8d17300e4', 'request_id': 'req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:37.981785 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] The token cache is being invalidate because project 9df75da318e04dfe8ee3f1f8d17300e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:37.982070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:37.982885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:37.984608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1215/2426] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:37 2022] DELETE /identity/v3/projects/9df75da318e04dfe8ee3f1f8d17300e4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:37.994948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2674f-1e3d-4975-ae72-53436f9447a8 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:38.004866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2674f-1e3d-4975-ae72-53436f9447a8 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:38.067871 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41242694-ec60-49e0-a0be-ee8e0af7caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:38.068895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41242694-ec60-49e0-a0be-ee8e0af7caa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:38.069180 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41242694-ec60-49e0-a0be-ee8e0af7caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:38.069459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41242694-ec60-49e0-a0be-ee8e0af7caa7 admin admin] PATH_INFO: `/v3/users/7f825b5143884552845ebe04eafea8b9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:38.071498 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41242694-ec60-49e0-a0be-ee8e0af7caa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f825b5143884552845ebe04eafea8b9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:38.074069 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41242694-ec60-49e0-a0be-ee8e0af7caa7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:38.268653 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-41242694-ec60-49e0-a0be-ee8e0af7caa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f825b5143884552845ebe04eafea8b9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:38.349939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-41242694-ec60-49e0-a0be-ee8e0af7caa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f825b5143884552845ebe04eafea8b9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:38.365095 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-41242694-ec60-49e0-a0be-ee8e0af7caa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f825b5143884552845ebe04eafea8b9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:38.365095 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-41242694-ec60-49e0-a0be-ee8e0af7caa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f825b5143884552845ebe04eafea8b9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:38.365095 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-41242694-ec60-49e0-a0be-ee8e0af7caa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f825b5143884552845ebe04eafea8b9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:38.381133 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1212/2427] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:37 2022] DELETE /identity/v3/users/7f825b5143884552845ebe04eafea8b9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:39.047817 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:39.051742 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:39.067148 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a0cc4-fcd5-4514-b2fb-e99feff8033b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:39.134048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7011cd-03fe-44fe-a877-cde782e72717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:39.142232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7011cd-03fe-44fe-a877-cde782e72717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:39.153370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7011cd-03fe-44fe-a877-cde782e72717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:39.153370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7011cd-03fe-44fe-a877-cde782e72717 admin admin] PATH_INFO: `/v3/projects/b103788c84244cc9bb2dae80d237929c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:39.153370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7011cd-03fe-44fe-a877-cde782e72717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b103788c84244cc9bb2dae80d237929c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:39.153370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7011cd-03fe-44fe-a877-cde782e72717 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:39.294704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ab7011cd-03fe-44fe-a877-cde782e72717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b103788c84244cc9bb2dae80d237929c', 'request_id': 'req-ab7011cd-03fe-44fe-a877-cde782e72717'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:39.301183 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ab7011cd-03fe-44fe-a877-cde782e72717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b103788c84244cc9bb2dae80d237929c', 'request_id': 'req-ab7011cd-03fe-44fe-a877-cde782e72717'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:39.311807 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ab7011cd-03fe-44fe-a877-cde782e72717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b103788c84244cc9bb2dae80d237929c', 'request_id': 'req-ab7011cd-03fe-44fe-a877-cde782e72717'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:39.387214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ab7011cd-03fe-44fe-a877-cde782e72717 admin admin] The token cache is being invalidate because project b103788c84244cc9bb2dae80d237929c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:39.387726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ab7011cd-03fe-44fe-a877-cde782e72717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:39.388718 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ab7011cd-03fe-44fe-a877-cde782e72717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:39.390694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1216/2428] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:39 2022] DELETE /identity/v3/projects/b103788c84244cc9bb2dae80d237929c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:39.395407 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f360da-d017-4fa4-82ec-cb3c09e38d4b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:39.396282 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f360da-d017-4fa4-82ec-cb3c09e38d4b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:39.396784 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f360da-d017-4fa4-82ec-cb3c09e38d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:39.419680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-e2f360da-d017-4fa4-82ec-cb3c09e38d4b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:39.426496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e2f360da-d017-4fa4-82ec-cb3c09e38d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:39.487205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1213/2429] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:11:39.495523 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ac66-82b8-49b9-a488-883162186619 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:39.495816 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ac66-82b8-49b9-a488-883162186619 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:39.496117 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ac66-82b8-49b9-a488-883162186619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:39.515197 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bc49ac66-82b8-49b9-a488-883162186619 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:39.516327 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bc49ac66-82b8-49b9-a488-883162186619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:39.527532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1217/2430] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:11:39.532818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f360da-d017-4fa4-82ec-cb3c09e38d4b None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:39.543379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f360da-d017-4fa4-82ec-cb3c09e38d4b None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:39.548532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79643fb7-57a4-46a0-a3ef-d7e4d0ad46c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:39.549625 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79643fb7-57a4-46a0-a3ef-d7e4d0ad46c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:39.550365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79643fb7-57a4-46a0-a3ef-d7e4d0ad46c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:39.551001 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79643fb7-57a4-46a0-a3ef-d7e4d0ad46c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:39.552037 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79643fb7-57a4-46a0-a3ef-d7e4d0ad46c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:11:39.552556 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79643fb7-57a4-46a0-a3ef-d7e4d0ad46c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:39.554676 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79643fb7-57a4-46a0-a3ef-d7e4d0ad46c3 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:39.570237 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1214/2431] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:11:39.574485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49ac66-82b8-49b9-a488-883162186619 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:39.587191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49ac66-82b8-49b9-a488-883162186619 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:39.597595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6c7cd-3f01-4100-94ed-02dfde2b0830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:39.597595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6c7cd-3f01-4100-94ed-02dfde2b0830 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:39.597595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6c7cd-3f01-4100-94ed-02dfde2b0830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:39.597595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6c7cd-3f01-4100-94ed-02dfde2b0830 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:39.599458 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6c7cd-3f01-4100-94ed-02dfde2b0830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:39.603520 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6c7cd-3f01-4100-94ed-02dfde2b0830 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:39.715686 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1218/2432] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:39 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:11:39.720562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79643fb7-57a4-46a0-a3ef-d7e4d0ad46c3 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:39.731387 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79643fb7-57a4-46a0-a3ef-d7e4d0ad46c3 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:39.787798 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84315363-97dd-4fa1-b1de-5c95d848bfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:39.790301 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84315363-97dd-4fa1-b1de-5c95d848bfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:39.790944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84315363-97dd-4fa1-b1de-5c95d848bfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:39.790944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84315363-97dd-4fa1-b1de-5c95d848bfb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:39.791619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84315363-97dd-4fa1-b1de-5c95d848bfb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:39.793634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84315363-97dd-4fa1-b1de-5c95d848bfb2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:39.863187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6c7cd-3f01-4100-94ed-02dfde2b0830 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:39.865437 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0af6c7cd-3f01-4100-94ed-02dfde2b0830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:39.888419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6c7cd-3f01-4100-94ed-02dfde2b0830 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:39.899984 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20aae9-2860-485c-9d7f-d1227121a909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:39.900875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20aae9-2860-485c-9d7f-d1227121a909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:39.902224 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20aae9-2860-485c-9d7f-d1227121a909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:39.902504 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20aae9-2860-485c-9d7f-d1227121a909 admin admin] PATH_INFO: `/v3/users/f9968edcee104432ade2014e39683bb5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:39.904000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20aae9-2860-485c-9d7f-d1227121a909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9968edcee104432ade2014e39683bb5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:39.906109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20aae9-2860-485c-9d7f-d1227121a909 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:39.930132 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1215/2433] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:39 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:39.930132 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84315363-97dd-4fa1-b1de-5c95d848bfb2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:39.930132 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-84315363-97dd-4fa1-b1de-5c95d848bfb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:39.984254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84315363-97dd-4fa1-b1de-5c95d848bfb2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:39.987830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95574071-7061-499b-b566-061fe3d0a382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:39.988476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95574071-7061-499b-b566-061fe3d0a382 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:39.988765 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95574071-7061-499b-b566-061fe3d0a382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:39.989046 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95574071-7061-499b-b566-061fe3d0a382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:39.990875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-95574071-7061-499b-b566-061fe3d0a382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:40.002665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95574071-7061-499b-b566-061fe3d0a382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:40.004100 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95574071-7061-499b-b566-061fe3d0a382 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:40.014322 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1216/2434] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:40.015181 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95574071-7061-499b-b566-061fe3d0a382 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:40.025059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95574071-7061-499b-b566-061fe3d0a382 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:40.030080 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5978e43-4248-4c0c-8c14-b898d24c63b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:40.030728 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5978e43-4248-4c0c-8c14-b898d24c63b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:40.031015 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5978e43-4248-4c0c-8c14-b898d24c63b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:40.031298 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5978e43-4248-4c0c-8c14-b898d24c63b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:40.032042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5978e43-4248-4c0c-8c14-b898d24c63b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:40.033648 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5978e43-4248-4c0c-8c14-b898d24c63b1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:40.043923 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1217/2435] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:40.048289 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5978e43-4248-4c0c-8c14-b898d24c63b1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:40.058906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5978e43-4248-4c0c-8c14-b898d24c63b1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:40.064433 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52dc3d-6095-4cac-b9de-ea69bd6ceaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:40.064702 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52dc3d-6095-4cac-b9de-ea69bd6ceaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:40.064988 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52dc3d-6095-4cac-b9de-ea69bd6ceaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:40.065273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52dc3d-6095-4cac-b9de-ea69bd6ceaf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:40.066162 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52dc3d-6095-4cac-b9de-ea69bd6ceaf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:40.067833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52dc3d-6095-4cac-b9de-ea69bd6ceaf7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:40.083630 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1218/2436] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:40.087350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52dc3d-6095-4cac-b9de-ea69bd6ceaf7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:40.099389 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52dc3d-6095-4cac-b9de-ea69bd6ceaf7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:40.105501 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924299c-ac5f-47bf-b9c9-4e52170eee30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:40.106422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924299c-ac5f-47bf-b9c9-4e52170eee30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:40.106711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924299c-ac5f-47bf-b9c9-4e52170eee30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:40.106992 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924299c-ac5f-47bf-b9c9-4e52170eee30 admin admin] PATH_INFO: `/v3/projects/c197f91800534e79abfe24f9cc89df66/users/39c244aca79c45329fec51b0fd4d66c5/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:40.122817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924299c-ac5f-47bf-b9c9-4e52170eee30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c197f91800534e79abfe24f9cc89df66, user_id=39c244aca79c45329fec51b0fd4d66c5, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:40.125597 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924299c-ac5f-47bf-b9c9-4e52170eee30 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:40.171700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7a20aae9-2860-485c-9d7f-d1227121a909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9968edcee104432ade2014e39683bb5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.180171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7a20aae9-2860-485c-9d7f-d1227121a909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9968edcee104432ade2014e39683bb5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.189481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1219/2437] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:40 2022] PUT /identity/v3/projects/c197f91800534e79abfe24f9cc89df66/users/39c244aca79c45329fec51b0fd4d66c5/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:40.202816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd616-1341-44d2-a626-0b6947a2f19f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:40.202935 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd616-1341-44d2-a626-0b6947a2f19f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:40.203124 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cd616-1341-44d2-a626-0b6947a2f19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:40.231704 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d09cd616-1341-44d2-a626-0b6947a2f19f None None] MFA Rules not processed for user `39c244aca79c45329fec51b0fd4d66c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:40.232976 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d09cd616-1341-44d2-a626-0b6947a2f19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:40.286826 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7a20aae9-2860-485c-9d7f-d1227121a909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9968edcee104432ade2014e39683bb5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.287521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7a20aae9-2860-485c-9d7f-d1227121a909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9968edcee104432ade2014e39683bb5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.288208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7a20aae9-2860-485c-9d7f-d1227121a909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9968edcee104432ade2014e39683bb5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.302565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1220/2438] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:11:40.307558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cd616-1341-44d2-a626-0b6947a2f19f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:40.313747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1219/2439] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:39 2022] DELETE /identity/v3/users/f9968edcee104432ade2014e39683bb5 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:40.313893 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d09cd616-1341-44d2-a626-0b6947a2f19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:40.313983 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20aae9-2860-485c-9d7f-d1227121a909 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:40.313983 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7a20aae9-2860-485c-9d7f-d1227121a909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:40.389955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20aae9-2860-485c-9d7f-d1227121a909 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:40.395897 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f5fc0-c329-4ed9-a845-4763493e1355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:40.397098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f5fc0-c329-4ed9-a845-4763493e1355 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:40.397635 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f5fc0-c329-4ed9-a845-4763493e1355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:40.398172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f5fc0-c329-4ed9-a845-4763493e1355 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:40.399070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f5fc0-c329-4ed9-a845-4763493e1355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:40.402128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f5fc0-c329-4ed9-a845-4763493e1355 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:40.404012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cd616-1341-44d2-a626-0b6947a2f19f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:40.410155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5c5b3-e56b-40a5-9b88-266868eca9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:40.415665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5c5b3-e56b-40a5-9b88-266868eca9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:40.415665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5c5b3-e56b-40a5-9b88-266868eca9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:40.415665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5c5b3-e56b-40a5-9b88-266868eca9d0 admin admin] PATH_INFO: `/v3/users/f20e82a312084f418ca4a97d4e354632` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:40.415665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5c5b3-e56b-40a5-9b88-266868eca9d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20e82a312084f418ca4a97d4e354632)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:40.416054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5c5b3-e56b-40a5-9b88-266868eca9d0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:40.525783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1220/2440] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:40 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:40.530380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f5fc0-c329-4ed9-a845-4763493e1355 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:40.600390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f5fc0-c329-4ed9-a845-4763493e1355 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:40.606045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394982fe-b8e4-40ed-9cb5-3327722f9516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:40.606811 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394982fe-b8e4-40ed-9cb5-3327722f9516 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:40.607165 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394982fe-b8e4-40ed-9cb5-3327722f9516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:40.607516 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394982fe-b8e4-40ed-9cb5-3327722f9516 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:40.608213 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394982fe-b8e4-40ed-9cb5-3327722f9516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:40.610310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394982fe-b8e4-40ed-9cb5-3327722f9516 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:40.656999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9f5c5b3-e56b-40a5-9b88-266868eca9d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20e82a312084f418ca4a97d4e354632'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.677775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1221/2441] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:40 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:11:40.678690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394982fe-b8e4-40ed-9cb5-3327722f9516 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:40.680902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-394982fe-b8e4-40ed-9cb5-3327722f9516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:40.692755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394982fe-b8e4-40ed-9cb5-3327722f9516 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:40.697939 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:40.698806 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:40.699088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:40.699363 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] PATH_INFO: `/v3/projects/513637db58d34fe198b2de93d2cbbeaa` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:40.700535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=513637db58d34fe198b2de93d2cbbeaa)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:40.702575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:40.717090 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9f5c5b3-e56b-40a5-9b88-266868eca9d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20e82a312084f418ca4a97d4e354632'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.725586 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9f5c5b3-e56b-40a5-9b88-266868eca9d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20e82a312084f418ca4a97d4e354632'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.726900 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9f5c5b3-e56b-40a5-9b88-266868eca9d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20e82a312084f418ca4a97d4e354632'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.727804 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f9f5c5b3-e56b-40a5-9b88-266868eca9d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20e82a312084f418ca4a97d4e354632'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.749028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1221/2442] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:40 2022] DELETE /identity/v3/users/f20e82a312084f418ca4a97d4e354632 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:40.751890 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5c5b3-e56b-40a5-9b88-266868eca9d0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:40.751890 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f9f5c5b3-e56b-40a5-9b88-266868eca9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:40.817379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513637db58d34fe198b2de93d2cbbeaa', 'request_id': 'req-8e51c224-7296-48c3-9cc5-3f725edb8b6f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.819575 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5c5b3-e56b-40a5-9b88-266868eca9d0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:40.825626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513637db58d34fe198b2de93d2cbbeaa', 'request_id': 'req-8e51c224-7296-48c3-9cc5-3f725edb8b6f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.831576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513637db58d34fe198b2de93d2cbbeaa', 'request_id': 'req-8e51c224-7296-48c3-9cc5-3f725edb8b6f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.883102 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5a718-439b-474c-bea5-0d1f341a3f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:40.884099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5a718-439b-474c-bea5-0d1f341a3f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:40.884533 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5a718-439b-474c-bea5-0d1f341a3f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:40.884825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5a718-439b-474c-bea5-0d1f341a3f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:40.885616 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5a718-439b-474c-bea5-0d1f341a3f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:40.887230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5a718-439b-474c-bea5-0d1f341a3f7f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:40.900557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1222/2443] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:40.900557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32172a-b054-4bfb-9fea-a9c36c891933 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:40.900557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32172a-b054-4bfb-9fea-a9c36c891933 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:40.900557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32172a-b054-4bfb-9fea-a9c36c891933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:40.906814 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] The token cache is being invalidate because project 513637db58d34fe198b2de93d2cbbeaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:40.907423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.908238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:40.910563 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1222/2444] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:40 2022] DELETE /identity/v3/projects/513637db58d34fe198b2de93d2cbbeaa => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:40.911522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:40.916049 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:40.917368 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-de32172a-b054-4bfb-9fea-a9c36c891933 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:40.918561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-de32172a-b054-4bfb-9fea-a9c36c891933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:40.926471 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1223/2445] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:40.931038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51c224-7296-48c3-9cc5-3f725edb8b6f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:40.931161 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7824dbd-629e-4240-acb7-552ba1b45736 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:40.931379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7824dbd-629e-4240-acb7-552ba1b45736 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:40.931658 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7824dbd-629e-4240-acb7-552ba1b45736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:40.936292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bf1bf-3627-4b3d-97c0-f9b1028cb2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:40.937281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bf1bf-3627-4b3d-97c0-f9b1028cb2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:40.937702 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bf1bf-3627-4b3d-97c0-f9b1028cb2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:40.938111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bf1bf-3627-4b3d-97c0-f9b1028cb2ca admin admin] PATH_INFO: `/v3/projects/84e8eb8075684d34bedb78f6d3b88838/users/8eeeb4c2f6404f03945f9e763485568e/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:40.950909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f7824dbd-629e-4240-acb7-552ba1b45736 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:40.952108 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f7824dbd-629e-4240-acb7-552ba1b45736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:40.953291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bf1bf-3627-4b3d-97c0-f9b1028cb2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e8eb8075684d34bedb78f6d3b88838, user_id=8eeeb4c2f6404f03945f9e763485568e, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:40.956105 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bf1bf-3627-4b3d-97c0-f9b1028cb2ca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:40.961582 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1224/2446] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:40.961582 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7824dbd-629e-4240-acb7-552ba1b45736 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:40.962558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f7824dbd-629e-4240-acb7-552ba1b45736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:41.008980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1223/2447] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:40 2022] PUT /identity/v3/projects/84e8eb8075684d34bedb78f6d3b88838/users/8eeeb4c2f6404f03945f9e763485568e/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:41.010585 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518f43c-fb89-454e-ae47-9f6990ea9bc7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:41.011016 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518f43c-fb89-454e-ae47-9f6990ea9bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:41.011302 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518f43c-fb89-454e-ae47-9f6990ea9bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:41.026943 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7824dbd-629e-4240-acb7-552ba1b45736 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:41.029946 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b518f43c-fb89-454e-ae47-9f6990ea9bc7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:41.031159 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b518f43c-fb89-454e-ae47-9f6990ea9bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:41.080327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e8e9b-89e6-43fd-8abd-25f935c1a3a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:41.081049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e8e9b-89e6-43fd-8abd-25f935c1a3a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:41.081399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e8e9b-89e6-43fd-8abd-25f935c1a3a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:41.081722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e8e9b-89e6-43fd-8abd-25f935c1a3a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:41.095616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1224/2448] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:41.095616 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518f43c-fb89-454e-ae47-9f6990ea9bc7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:41.102999 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518f43c-fb89-454e-ae47-9f6990ea9bc7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:41.107736 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d933db-c048-4836-9a58-cea5f2ebf8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:41.108399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d933db-c048-4836-9a58-cea5f2ebf8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:41.108685 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d933db-c048-4836-9a58-cea5f2ebf8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:41.108961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d933db-c048-4836-9a58-cea5f2ebf8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:41.109714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d933db-c048-4836-9a58-cea5f2ebf8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:41.111314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d933db-c048-4836-9a58-cea5f2ebf8d0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:41.121995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1225/2449] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:41.122960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d933db-c048-4836-9a58-cea5f2ebf8d0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:41.133778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d933db-c048-4836-9a58-cea5f2ebf8d0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:41.138775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadaaaa2-f357-40cc-98e4-5f903b699bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:41.139572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaaaa2-f357-40cc-98e4-5f903b699bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:41.139865 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaaaa2-f357-40cc-98e4-5f903b699bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:41.140138 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaaaa2-f357-40cc-98e4-5f903b699bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:41.140854 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadaaaa2-f357-40cc-98e4-5f903b699bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:11:41.141159 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadaaaa2-f357-40cc-98e4-5f903b699bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:41.142787 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadaaaa2-f357-40cc-98e4-5f903b699bf1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:41.157484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1226/2450] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:11:41.157764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e8e9b-89e6-43fd-8abd-25f935c1a3a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:41.158167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadaaaa2-f357-40cc-98e4-5f903b699bf1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:41.159353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e8e9b-89e6-43fd-8abd-25f935c1a3a6 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:41.169045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadaaaa2-f357-40cc-98e4-5f903b699bf1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:41.170558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1225/2451] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:41.171209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e8e9b-89e6-43fd-8abd-25f935c1a3a6 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:41.175401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e1abb-d61c-47f6-90ea-98ab1c53c4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:41.177152 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e1abb-d61c-47f6-90ea-98ab1c53c4df admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:41.177510 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e1abb-d61c-47f6-90ea-98ab1c53c4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:41.177896 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e1abb-d61c-47f6-90ea-98ab1c53c4df admin admin] PATH_INFO: `/v3/projects/84e8eb8075684d34bedb78f6d3b88838/users/8eeeb4c2f6404f03945f9e763485568e/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:41.180996 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e1abb-d61c-47f6-90ea-98ab1c53c4df admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e8eb8075684d34bedb78f6d3b88838, user_id=8eeeb4c2f6404f03945f9e763485568e, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:41.181237 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e8e9b-89e6-43fd-8abd-25f935c1a3a6 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:41.184517 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e1abb-d61c-47f6-90ea-98ab1c53c4df admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:41.186451 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca0abe-7475-407d-a6a8-12cd63160cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:41.187378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca0abe-7475-407d-a6a8-12cd63160cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:41.187843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca0abe-7475-407d-a6a8-12cd63160cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:41.188270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca0abe-7475-407d-a6a8-12cd63160cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:41.189143 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca0abe-7475-407d-a6a8-12cd63160cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:41.191240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca0abe-7475-407d-a6a8-12cd63160cd0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:41.197462 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1227/2452] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:41 2022] PUT /identity/v3/projects/84e8eb8075684d34bedb78f6d3b88838/users/8eeeb4c2f6404f03945f9e763485568e/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:41.207699 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d855f4d-6522-440c-b461-c093049307f6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:41.207983 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d855f4d-6522-440c-b461-c093049307f6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:41.208260 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d855f4d-6522-440c-b461-c093049307f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:41.234836 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6d855f4d-6522-440c-b461-c093049307f6 None None] MFA Rules not processed for user `8eeeb4c2f6404f03945f9e763485568e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:41.238109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6d855f4d-6522-440c-b461-c093049307f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:41.302483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1228/2453] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:11:41.313459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d855f4d-6522-440c-b461-c093049307f6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:41.314839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6d855f4d-6522-440c-b461-c093049307f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:41.337760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1226/2454] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:41 2022] POST /identity/v3/projects => generated 405 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:41.341886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca0abe-7475-407d-a6a8-12cd63160cd0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:41.399025 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d855f4d-6522-440c-b461-c093049307f6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:41.426541 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca0abe-7475-407d-a6a8-12cd63160cd0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:41.435191 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af0a90-5d27-4a54-8bc9-4182b3bbd9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:41.436173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0a90-5d27-4a54-8bc9-4182b3bbd9ac admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:41.437148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0a90-5d27-4a54-8bc9-4182b3bbd9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:41.437653 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0a90-5d27-4a54-8bc9-4182b3bbd9ac admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:41.439088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af0a90-5d27-4a54-8bc9-4182b3bbd9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:41.441552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af0a90-5d27-4a54-8bc9-4182b3bbd9ac admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:41.483574 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27959a-b14c-4dbb-9e47-52f37478a38c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:41.484245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27959a-b14c-4dbb-9e47-52f37478a38c service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:41.484530 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27959a-b14c-4dbb-9e47-52f37478a38c service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:41.484808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27959a-b14c-4dbb-9e47-52f37478a38c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:41.535233 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1227/2455] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:41 2022] POST /identity/v3/users => generated 303 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:41.542198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af0a90-5d27-4a54-8bc9-4182b3bbd9ac admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:41.560024 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af0a90-5d27-4a54-8bc9-4182b3bbd9ac admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:41.576729 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bc0c2-6f3e-42e0-9947-c263245bd783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:41.577825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bc0c2-6f3e-42e0-9947-c263245bd783 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:41.578752 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bc0c2-6f3e-42e0-9947-c263245bd783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:41.579256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bc0c2-6f3e-42e0-9947-c263245bd783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:41.580226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bc0c2-6f3e-42e0-9947-c263245bd783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:41.586750 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27959a-b14c-4dbb-9e47-52f37478a38c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:41.589048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27959a-b14c-4dbb-9e47-52f37478a38c service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:41.598810 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bc0c2-6f3e-42e0-9947-c263245bd783 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:41.605273 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1229/2456] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:11:41.614561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1228/2457] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:41.616291 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27959a-b14c-4dbb-9e47-52f37478a38c service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:41.627951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27959a-b14c-4dbb-9e47-52f37478a38c service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:41.633137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc0e15-9d2e-4e34-9e9f-206931ca9d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:41.633899 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc0e15-9d2e-4e34-9e9f-206931ca9d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:41.634297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc0e15-9d2e-4e34-9e9f-206931ca9d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:41.634513 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc0e15-9d2e-4e34-9e9f-206931ca9d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:41.635232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc0e15-9d2e-4e34-9e9f-206931ca9d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:41.636886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc0e15-9d2e-4e34-9e9f-206931ca9d36 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:41.647009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1230/2458] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:41.659135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bc0c2-6f3e-42e0-9947-c263245bd783 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:41.669327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bc0c2-6f3e-42e0-9947-c263245bd783 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:41.684070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f5d65-02ae-4e94-9eac-e1f1e475f3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:41.685014 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f5d65-02ae-4e94-9eac-e1f1e475f3bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:41.685305 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f5d65-02ae-4e94-9eac-e1f1e475f3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:41.685441 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc0e15-9d2e-4e34-9e9f-206931ca9d36 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:41.685680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f5d65-02ae-4e94-9eac-e1f1e475f3bf admin admin] PATH_INFO: `/v3/projects/fee613fa1c524241abc6f7429fae54d2/users/2d9396a3c2ba425c9db62b6b0e0389b6/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:41.687252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ebc0e15-9d2e-4e34-9e9f-206931ca9d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:41.707223 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f5d65-02ae-4e94-9eac-e1f1e475f3bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee613fa1c524241abc6f7429fae54d2, user_id=2d9396a3c2ba425c9db62b6b0e0389b6, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:41.710971 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f5d65-02ae-4e94-9eac-e1f1e475f3bf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:41.720124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc0e15-9d2e-4e34-9e9f-206931ca9d36 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:41.728429 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:41.729844 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:41.730153 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:41.730494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] PATH_INFO: `/v3/projects/082503cbe3a94f9e9b2bb0248f1ee293` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:41.735265 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=082503cbe3a94f9e9b2bb0248f1ee293)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:41.738390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:41.810144 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1229/2459] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:41 2022] PUT /identity/v3/projects/fee613fa1c524241abc6f7429fae54d2/users/2d9396a3c2ba425c9db62b6b0e0389b6/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:41.830005 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037bb75-7b7c-4b21-8da0-8dc11cb714cd None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:41.830754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037bb75-7b7c-4b21-8da0-8dc11cb714cd None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:41.831687 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037bb75-7b7c-4b21-8da0-8dc11cb714cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:41.861693 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082503cbe3a94f9e9b2bb0248f1ee293', 'request_id': 'req-598b36dd-4665-47db-a967-c499e7575476'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:41.886183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1037bb75-7b7c-4b21-8da0-8dc11cb714cd None None] MFA Rules not processed for user `2d9396a3c2ba425c9db62b6b0e0389b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:41.888045 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1037bb75-7b7c-4b21-8da0-8dc11cb714cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:41.902532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082503cbe3a94f9e9b2bb0248f1ee293', 'request_id': 'req-598b36dd-4665-47db-a967-c499e7575476'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:41.923398 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082503cbe3a94f9e9b2bb0248f1ee293', 'request_id': 'req-598b36dd-4665-47db-a967-c499e7575476'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:42.002743 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] The token cache is being invalidate because project 082503cbe3a94f9e9b2bb0248f1ee293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:42.003058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:42.004044 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:42.009443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1231/2460] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:41 2022] DELETE /identity/v3/projects/082503cbe3a94f9e9b2bb0248f1ee293 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:42.010380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:42.012607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:42.029279 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1230/2461] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:42.033975 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037bb75-7b7c-4b21-8da0-8dc11cb714cd None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:42.109986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037bb75-7b7c-4b21-8da0-8dc11cb714cd None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:42.111251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b36dd-4665-47db-a967-c499e7575476 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:42.115271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee90112-67e7-4ba6-b5c0-26ee821a88d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:42.116000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee90112-67e7-4ba6-b5c0-26ee821a88d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:42.116288 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee90112-67e7-4ba6-b5c0-26ee821a88d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:42.116609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee90112-67e7-4ba6-b5c0-26ee821a88d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:42.117364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee90112-67e7-4ba6-b5c0-26ee821a88d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:42.120094 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee90112-67e7-4ba6-b5c0-26ee821a88d9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:42.128312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965317c-9fe3-4093-be8b-a9443121b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:42.129229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965317c-9fe3-4093-be8b-a9443121b2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:42.129521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965317c-9fe3-4093-be8b-a9443121b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:42.132738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965317c-9fe3-4093-be8b-a9443121b2c8 admin admin] PATH_INFO: `/v3/users/0592ac82ab3d4a28ade2d709085ee567` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:42.135761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965317c-9fe3-4093-be8b-a9443121b2c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0592ac82ab3d4a28ade2d709085ee567)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:42.139823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5965317c-9fe3-4093-be8b-a9443121b2c8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:42.259847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1231/2462] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:42 2022] POST /identity/v3/projects => generated 405 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:11:42.261306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee90112-67e7-4ba6-b5c0-26ee821a88d9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:42.264318 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-eee90112-67e7-4ba6-b5c0-26ee821a88d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:42.336625 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee90112-67e7-4ba6-b5c0-26ee821a88d9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:42.341489 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dadf8-58df-49e9-a7a0-c5ff818b19cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:42.342276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dadf8-58df-49e9-a7a0-c5ff818b19cd admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:42.342661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dadf8-58df-49e9-a7a0-c5ff818b19cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:42.343003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dadf8-58df-49e9-a7a0-c5ff818b19cd admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:42.343766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dadf8-58df-49e9-a7a0-c5ff818b19cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:42.345838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dadf8-58df-49e9-a7a0-c5ff818b19cd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:42.393331 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5965317c-9fe3-4093-be8b-a9443121b2c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0592ac82ab3d4a28ade2d709085ee567'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:42.400611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5965317c-9fe3-4093-be8b-a9443121b2c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0592ac82ab3d4a28ade2d709085ee567'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:42.522580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1232/2463] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:42 2022] POST /identity/v3/users => generated 309 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:42.524142 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dadf8-58df-49e9-a7a0-c5ff818b19cd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:42.527480 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7e4dadf8-58df-49e9-a7a0-c5ff818b19cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:42.534353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5965317c-9fe3-4093-be8b-a9443121b2c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0592ac82ab3d4a28ade2d709085ee567'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:42.534987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5965317c-9fe3-4093-be8b-a9443121b2c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0592ac82ab3d4a28ade2d709085ee567'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:42.535606 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5965317c-9fe3-4093-be8b-a9443121b2c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0592ac82ab3d4a28ade2d709085ee567'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:42.545933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dadf8-58df-49e9-a7a0-c5ff818b19cd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:42.558998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dba77-113a-41aa-80ab-1ef6337bc0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:42.560753 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dba77-113a-41aa-80ab-1ef6337bc0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:42.561597 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dba77-113a-41aa-80ab-1ef6337bc0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:42.564680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1232/2464] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:42 2022] DELETE /identity/v3/users/0592ac82ab3d4a28ade2d709085ee567 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:42.564680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965317c-9fe3-4093-be8b-a9443121b2c8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:42.564680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5965317c-9fe3-4093-be8b-a9443121b2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:42.565963 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dba77-113a-41aa-80ab-1ef6337bc0dd admin admin] PATH_INFO: `/v3/users/39c244aca79c45329fec51b0fd4d66c5` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:42.568179 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dba77-113a-41aa-80ab-1ef6337bc0dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c244aca79c45329fec51b0fd4d66c5)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:42.572539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dba77-113a-41aa-80ab-1ef6337bc0dd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:42.650794 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5965317c-9fe3-4093-be8b-a9443121b2c8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:42.657717 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10736e-fa8d-44c8-9c21-c9a43b518baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:42.659068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10736e-fa8d-44c8-9c21-c9a43b518baf admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:42.659600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10736e-fa8d-44c8-9c21-c9a43b518baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:42.659979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10736e-fa8d-44c8-9c21-c9a43b518baf admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:42.661205 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10736e-fa8d-44c8-9c21-c9a43b518baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:42.663520 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10736e-fa8d-44c8-9c21-c9a43b518baf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:42.675896 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1233/2465] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:42.682520 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10736e-fa8d-44c8-9c21-c9a43b518baf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:42.693990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10736e-fa8d-44c8-9c21-c9a43b518baf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:42.699485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94647a05-deef-42a6-9610-c923eb6c1af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:42.700498 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94647a05-deef-42a6-9610-c923eb6c1af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:42.700821 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94647a05-deef-42a6-9610-c923eb6c1af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:42.701115 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94647a05-deef-42a6-9610-c923eb6c1af7 admin admin] PATH_INFO: `/v3/projects/df07a7d6459a429785f672822af5a5d7/users/ed7afa554acd42cab84592a0e302c061/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:42.717132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94647a05-deef-42a6-9610-c923eb6c1af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df07a7d6459a429785f672822af5a5d7, user_id=ed7afa554acd42cab84592a0e302c061, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:42.719890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94647a05-deef-42a6-9610-c923eb6c1af7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:42.775898 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0e7dba77-113a-41aa-80ab-1ef6337bc0dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c244aca79c45329fec51b0fd4d66c5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:42.791974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1234/2466] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:42 2022] PUT /identity/v3/projects/df07a7d6459a429785f672822af5a5d7/users/ed7afa554acd42cab84592a0e302c061/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:42.795971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94647a05-deef-42a6-9610-c923eb6c1af7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:42.858402 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0e7dba77-113a-41aa-80ab-1ef6337bc0dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c244aca79c45329fec51b0fd4d66c5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:42.858569 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94647a05-deef-42a6-9610-c923eb6c1af7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:42.863557 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06fd2d-4ec2-478f-bc15-b6152d4f03be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:42.864224 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06fd2d-4ec2-478f-bc15-b6152d4f03be admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:42.864512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06fd2d-4ec2-478f-bc15-b6152d4f03be admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:42.867469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06fd2d-4ec2-478f-bc15-b6152d4f03be admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:42.867469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06fd2d-4ec2-478f-bc15-b6152d4f03be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:42.867703 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0e7dba77-113a-41aa-80ab-1ef6337bc0dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c244aca79c45329fec51b0fd4d66c5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:42.867703 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0e7dba77-113a-41aa-80ab-1ef6337bc0dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c244aca79c45329fec51b0fd4d66c5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:42.867895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06fd2d-4ec2-478f-bc15-b6152d4f03be admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:42.868544 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-0e7dba77-113a-41aa-80ab-1ef6337bc0dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c244aca79c45329fec51b0fd4d66c5'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:42.877517 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1235/2467] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:11:42.881515 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06fd2d-4ec2-478f-bc15-b6152d4f03be admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:42.883287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4f06fd2d-4ec2-478f-bc15-b6152d4f03be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:42.885724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1233/2468] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:42 2022] DELETE /identity/v3/users/39c244aca79c45329fec51b0fd4d66c5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:42.890066 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e99a-5b0a-4314-8822-9957e5ab20b3 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:42.890355 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e99a-5b0a-4314-8822-9957e5ab20b3 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:42.890632 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12e99a-5b0a-4314-8822-9957e5ab20b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:42.898775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06fd2d-4ec2-478f-bc15-b6152d4f03be admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:42.913764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7b12e99a-5b0a-4314-8822-9957e5ab20b3 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:42.914184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7b12e99a-5b0a-4314-8822-9957e5ab20b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:42.960230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79027e-28fa-47ce-8207-a044f03efafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:42.961323 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79027e-28fa-47ce-8207-a044f03efafb admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:42.961693 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79027e-28fa-47ce-8207-a044f03efafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:42.961980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79027e-28fa-47ce-8207-a044f03efafb admin admin] PATH_INFO: `/v3/projects/df07a7d6459a429785f672822af5a5d7/users/ed7afa554acd42cab84592a0e302c061/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:42.964427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79027e-28fa-47ce-8207-a044f03efafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=df07a7d6459a429785f672822af5a5d7, user_id=ed7afa554acd42cab84592a0e302c061, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:42.967144 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79027e-28fa-47ce-8207-a044f03efafb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:42.984087 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1236/2469] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:42 2022] PUT /identity/v3/projects/df07a7d6459a429785f672822af5a5d7/users/ed7afa554acd42cab84592a0e302c061/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:11:42.994965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65ba50-11cd-4a64-824a-859665a6d9d8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:42.995259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65ba50-11cd-4a64-824a-859665a6d9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:42.995535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65ba50-11cd-4a64-824a-859665a6d9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:43.013295 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1234/2470] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:11:43.027486 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12e99a-5b0a-4314-8822-9957e5ab20b3 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:43.029133 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7b12e99a-5b0a-4314-8822-9957e5ab20b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:43.029292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7b65ba50-11cd-4a64-824a-859665a6d9d8 None None] MFA Rules not processed for user `ed7afa554acd42cab84592a0e302c061`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:43.030565 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7b65ba50-11cd-4a64-824a-859665a6d9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:43.127149 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12e99a-5b0a-4314-8822-9957e5ab20b3 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:43.156627 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1237/2471] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:11:43.168648 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65ba50-11cd-4a64-824a-859665a6d9d8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:43.170519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7b65ba50-11cd-4a64-824a-859665a6d9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:43.196376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8508eaa-8ac3-4512-aa8f-2e8af6e45c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:43.197302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8508eaa-8ac3-4512-aa8f-2e8af6e45c83 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:43.197767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8508eaa-8ac3-4512-aa8f-2e8af6e45c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:43.198191 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8508eaa-8ac3-4512-aa8f-2e8af6e45c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:43.236590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65ba50-11cd-4a64-824a-859665a6d9d8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:43.240371 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80b4dc-c163-4417-ad81-64ff3cf0c584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:43.241021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80b4dc-c163-4417-ad81-64ff3cf0c584 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:43.241300 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80b4dc-c163-4417-ad81-64ff3cf0c584 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:43.242165 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80b4dc-c163-4417-ad81-64ff3cf0c584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:43.252302 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80b4dc-c163-4417-ad81-64ff3cf0c584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:43.254224 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80b4dc-c163-4417-ad81-64ff3cf0c584 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:43.266808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1238/2472] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:43 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:11:43.267691 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80b4dc-c163-4417-ad81-64ff3cf0c584 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:43.269110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8e80b4dc-c163-4417-ad81-64ff3cf0c584 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:43.277994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8508eaa-8ac3-4512-aa8f-2e8af6e45c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:43.279452 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8508eaa-8ac3-4512-aa8f-2e8af6e45c83 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:43.291731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1235/2473] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:11:43.306490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80b4dc-c163-4417-ad81-64ff3cf0c584 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:43.314180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec476b65-46b6-49d5-9a3a-a3c781c29a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:43.315213 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec476b65-46b6-49d5-9a3a-a3c781c29a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:43.315493 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec476b65-46b6-49d5-9a3a-a3c781c29a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:43.315769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec476b65-46b6-49d5-9a3a-a3c781c29a84 admin admin] PATH_INFO: `/v3/projects/457e971be5fa499a82fac42bca2bdd69` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:43.327038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec476b65-46b6-49d5-9a3a-a3c781c29a84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=457e971be5fa499a82fac42bca2bdd69)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:43.339696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec476b65-46b6-49d5-9a3a-a3c781c29a84 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:43.432008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8508eaa-8ac3-4512-aa8f-2e8af6e45c83 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:43.442390 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8508eaa-8ac3-4512-aa8f-2e8af6e45c83 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:43.448204 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71662b-d1c5-4358-8fb3-a173d488d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:43.449082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71662b-d1c5-4358-8fb3-a173d488d3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:43.449406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71662b-d1c5-4358-8fb3-a173d488d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:43.449715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71662b-d1c5-4358-8fb3-a173d488d3d1 admin admin] PATH_INFO: `/v3/users/2d9396a3c2ba425c9db62b6b0e0389b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:43.450920 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71662b-d1c5-4358-8fb3-a173d488d3d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9396a3c2ba425c9db62b6b0e0389b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:43.452922 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71662b-d1c5-4358-8fb3-a173d488d3d1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:43.488152 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ec476b65-46b6-49d5-9a3a-a3c781c29a84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457e971be5fa499a82fac42bca2bdd69', 'request_id': 'req-ec476b65-46b6-49d5-9a3a-a3c781c29a84'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:43.496377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ec476b65-46b6-49d5-9a3a-a3c781c29a84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457e971be5fa499a82fac42bca2bdd69', 'request_id': 'req-ec476b65-46b6-49d5-9a3a-a3c781c29a84'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:43.502548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ec476b65-46b6-49d5-9a3a-a3c781c29a84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457e971be5fa499a82fac42bca2bdd69', 'request_id': 'req-ec476b65-46b6-49d5-9a3a-a3c781c29a84'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:43.579456 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ec476b65-46b6-49d5-9a3a-a3c781c29a84 admin admin] The token cache is being invalidate because project 457e971be5fa499a82fac42bca2bdd69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:43.579749 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ec476b65-46b6-49d5-9a3a-a3c781c29a84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:43.580934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ec476b65-46b6-49d5-9a3a-a3c781c29a84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:43.582747 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1239/2474] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:43 2022] DELETE /identity/v3/projects/457e971be5fa499a82fac42bca2bdd69 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:43.590478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040635f-dad6-421c-b09c-6c0554d124fb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:43.590773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040635f-dad6-421c-b09c-6c0554d124fb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:43.591752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040635f-dad6-421c-b09c-6c0554d124fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:43.609380 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea71662b-d1c5-4358-8fb3-a173d488d3d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9396a3c2ba425c9db62b6b0e0389b6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:43.613188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8040635f-dad6-421c-b09c-6c0554d124fb None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:43.614265 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8040635f-dad6-421c-b09c-6c0554d124fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:43.675871 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1240/2475] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:43.683415 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a0f41-7fb5-4ac1-a974-a59a133b3683 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:43.683702 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a0f41-7fb5-4ac1-a974-a59a133b3683 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:43.683975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a0f41-7fb5-4ac1-a974-a59a133b3683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:43.700756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea71662b-d1c5-4358-8fb3-a173d488d3d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9396a3c2ba425c9db62b6b0e0389b6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:43.702777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d63a0f41-7fb5-4ac1-a974-a59a133b3683 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:43.704063 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d63a0f41-7fb5-4ac1-a974-a59a133b3683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:43.711561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea71662b-d1c5-4358-8fb3-a173d488d3d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9396a3c2ba425c9db62b6b0e0389b6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:43.712376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea71662b-d1c5-4358-8fb3-a173d488d3d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9396a3c2ba425c9db62b6b0e0389b6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:43.713140 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ea71662b-d1c5-4358-8fb3-a173d488d3d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9396a3c2ba425c9db62b6b0e0389b6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:43.716575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1241/2476] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:11:43.719801 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a0f41-7fb5-4ac1-a974-a59a133b3683 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:43.733888 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a0f41-7fb5-4ac1-a974-a59a133b3683 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:43.742821 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0550d1-06a8-4636-b880-06615158676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:43.743746 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0550d1-06a8-4636-b880-06615158676b admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:43.744188 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0550d1-06a8-4636-b880-06615158676b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:43.744622 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0550d1-06a8-4636-b880-06615158676b admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:43.747130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0550d1-06a8-4636-b880-06615158676b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:11:43.747624 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0550d1-06a8-4636-b880-06615158676b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:43.750532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0550d1-06a8-4636-b880-06615158676b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:43.760396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1236/2477] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:43 2022] DELETE /identity/v3/users/2d9396a3c2ba425c9db62b6b0e0389b6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:11:43.765356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fa231-4319-4e41-8290-4d4477e2cde7 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:43.765807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fa231-4319-4e41-8290-4d4477e2cde7 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:43.766194 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fa231-4319-4e41-8290-4d4477e2cde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:43.773677 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1242/2478] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:11:43.774911 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0550d1-06a8-4636-b880-06615158676b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:43.777232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9a0550d1-06a8-4636-b880-06615158676b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:43.792540 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0550d1-06a8-4636-b880-06615158676b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:43.798879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-328fa231-4319-4e41-8290-4d4477e2cde7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:43.800244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-328fa231-4319-4e41-8290-4d4477e2cde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:43.882952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3416f6-5277-4c5f-a0af-35b5e1cfb80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:43.883503 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3416f6-5277-4c5f-a0af-35b5e1cfb80d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:43.883791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3416f6-5277-4c5f-a0af-35b5e1cfb80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:43.884073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3416f6-5277-4c5f-a0af-35b5e1cfb80d admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:43.884991 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3416f6-5277-4c5f-a0af-35b5e1cfb80d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:43.886982 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3416f6-5277-4c5f-a0af-35b5e1cfb80d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:43.888345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1237/2479] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:43.908155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fa231-4319-4e41-8290-4d4477e2cde7 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:43.914163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-328fa231-4319-4e41-8290-4d4477e2cde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:44.000547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1243/2480] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:43 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:44.002531 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3416f6-5277-4c5f-a0af-35b5e1cfb80d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:44.006081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6f3416f6-5277-4c5f-a0af-35b5e1cfb80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:44.011345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fa231-4319-4e41-8290-4d4477e2cde7 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:44.086184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56ba90-a493-462f-8bf2-d70434079209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:44.087116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56ba90-a493-462f-8bf2-d70434079209 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:44.087501 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56ba90-a493-462f-8bf2-d70434079209 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:44.087900 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56ba90-a493-462f-8bf2-d70434079209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:44.097067 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3416f6-5277-4c5f-a0af-35b5e1cfb80d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:44.102625 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56ba90-a493-462f-8bf2-d70434079209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:44.102625 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56ba90-a493-462f-8bf2-d70434079209 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:44.102843 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:44.103489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:44.103776 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:44.104065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] PATH_INFO: `/v3/projects/c197f91800534e79abfe24f9cc89df66` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:44.105276 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c197f91800534e79abfe24f9cc89df66)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:44.107240 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:44.111825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1238/2481] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:44.112631 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56ba90-a493-462f-8bf2-d70434079209 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:44.122876 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56ba90-a493-462f-8bf2-d70434079209 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:44.128359 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a2483-00df-4079-82dc-16dcd5b4510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:44.129122 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a2483-00df-4079-82dc-16dcd5b4510d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:44.129577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a2483-00df-4079-82dc-16dcd5b4510d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:44.130830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a2483-00df-4079-82dc-16dcd5b4510d admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:44.130830 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a2483-00df-4079-82dc-16dcd5b4510d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:44.133725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a2483-00df-4079-82dc-16dcd5b4510d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:44.239392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c197f91800534e79abfe24f9cc89df66', 'request_id': 'req-45f4ad92-4a2e-4890-bc29-56204c26b06d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.247497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c197f91800534e79abfe24f9cc89df66', 'request_id': 'req-45f4ad92-4a2e-4890-bc29-56204c26b06d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.255315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1239/2482] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:44 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:44.262173 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c197f91800534e79abfe24f9cc89df66', 'request_id': 'req-45f4ad92-4a2e-4890-bc29-56204c26b06d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.267967 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a2483-00df-4079-82dc-16dcd5b4510d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:44.272605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a2483-00df-4079-82dc-16dcd5b4510d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:44.334766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bd471-aeb2-4fb5-b2b7-a206f0b84778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:44.335706 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bd471-aeb2-4fb5-b2b7-a206f0b84778 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:44.335706 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bd471-aeb2-4fb5-b2b7-a206f0b84778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:44.335916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bd471-aeb2-4fb5-b2b7-a206f0b84778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:44.336707 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bd471-aeb2-4fb5-b2b7-a206f0b84778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:44.338672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bd471-aeb2-4fb5-b2b7-a206f0b84778 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:44.353750 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1240/2483] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:44.354790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bd471-aeb2-4fb5-b2b7-a206f0b84778 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:44.358340 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] The token cache is being invalidate because project c197f91800534e79abfe24f9cc89df66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:44.358634 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.359479 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.362098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1244/2484] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:44 2022] DELETE /identity/v3/projects/c197f91800534e79abfe24f9cc89df66 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:44.365172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:44.367704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:44.390481 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bd471-aeb2-4fb5-b2b7-a206f0b84778 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:44.392030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4ad92-4a2e-4890-bc29-56204c26b06d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:44.397640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7ec57-0d89-48f7-8d3b-39bcad037b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:44.398670 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b18e0-c0c6-4e4a-924b-44725a945350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:44.401251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7ec57-0d89-48f7-8d3b-39bcad037b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:44.401251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7ec57-0d89-48f7-8d3b-39bcad037b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:44.401520 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b18e0-c0c6-4e4a-924b-44725a945350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:44.401653 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7ec57-0d89-48f7-8d3b-39bcad037b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:44.401748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b18e0-c0c6-4e4a-924b-44725a945350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:44.401748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b18e0-c0c6-4e4a-924b-44725a945350 admin admin] PATH_INFO: `/v3/users/8eeeb4c2f6404f03945f9e763485568e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:44.401938 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7ec57-0d89-48f7-8d3b-39bcad037b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:44.402356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b18e0-c0c6-4e4a-924b-44725a945350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eeeb4c2f6404f03945f9e763485568e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:44.403235 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7ec57-0d89-48f7-8d3b-39bcad037b71 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:44.404823 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b18e0-c0c6-4e4a-924b-44725a945350 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:44.419202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1241/2485] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:11:44.423252 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7ec57-0d89-48f7-8d3b-39bcad037b71 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:44.425347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-91c7ec57-0d89-48f7-8d3b-39bcad037b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:44.438794 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7ec57-0d89-48f7-8d3b-39bcad037b71 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:44.443640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e501b-f86a-4d58-a98d-3f6668ccdd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:44.444667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e501b-f86a-4d58-a98d-3f6668ccdd2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:44.445017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e501b-f86a-4d58-a98d-3f6668ccdd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:44.445299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e501b-f86a-4d58-a98d-3f6668ccdd2b admin admin] PATH_INFO: `/v3/projects/472f375a8ade48f2b5e32c4780fd03b5/users/e54d9da609ad49948846a43ff36604ab/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:44.460232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e501b-f86a-4d58-a98d-3f6668ccdd2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=472f375a8ade48f2b5e32c4780fd03b5, user_id=e54d9da609ad49948846a43ff36604ab, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:44.468220 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e501b-f86a-4d58-a98d-3f6668ccdd2b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:44.584183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1242/2486] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:44 2022] PUT /identity/v3/projects/472f375a8ade48f2b5e32c4780fd03b5/users/e54d9da609ad49948846a43ff36604ab/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:11:44.590584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e501b-f86a-4d58-a98d-3f6668ccdd2b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:44.592358 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0f2e501b-f86a-4d58-a98d-3f6668ccdd2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:44.653885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed3b18e0-c0c6-4e4a-924b-44725a945350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eeeb4c2f6404f03945f9e763485568e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.657782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e501b-f86a-4d58-a98d-3f6668ccdd2b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:44.660735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed3b18e0-c0c6-4e4a-924b-44725a945350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eeeb4c2f6404f03945f9e763485568e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.662508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4dd56-0e5f-494b-adb0-c34d491bc1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:44.663879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4dd56-0e5f-494b-adb0-c34d491bc1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:44.664160 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4dd56-0e5f-494b-adb0-c34d491bc1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:44.664433 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4dd56-0e5f-494b-adb0-c34d491bc1fb admin admin] PATH_INFO: `/v3/users/d7666a6299cc4c44ac7495ed00f137dd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:44.665683 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4dd56-0e5f-494b-adb0-c34d491bc1fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7666a6299cc4c44ac7495ed00f137dd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:44.667597 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4dd56-0e5f-494b-adb0-c34d491bc1fb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:44.749767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed3b18e0-c0c6-4e4a-924b-44725a945350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eeeb4c2f6404f03945f9e763485568e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.750343 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed3b18e0-c0c6-4e4a-924b-44725a945350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eeeb4c2f6404f03945f9e763485568e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.750918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ed3b18e0-c0c6-4e4a-924b-44725a945350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eeeb4c2f6404f03945f9e763485568e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.767905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1245/2487] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:44 2022] DELETE /identity/v3/users/8eeeb4c2f6404f03945f9e763485568e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:44.771051 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b18e0-c0c6-4e4a-924b-44725a945350 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:44.771051 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ed3b18e0-c0c6-4e4a-924b-44725a945350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:44.834167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b18e0-c0c6-4e4a-924b-44725a945350 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:44.843932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:44.843932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:44.843932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:44.843932 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] PATH_INFO: `/v3/projects/fee613fa1c524241abc6f7429fae54d2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:44.844391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee613fa1c524241abc6f7429fae54d2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:44.844521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:44.868615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-25a4dd56-0e5f-494b-adb0-c34d491bc1fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7666a6299cc4c44ac7495ed00f137dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.945399 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-25a4dd56-0e5f-494b-adb0-c34d491bc1fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7666a6299cc4c44ac7495ed00f137dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.953484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-25a4dd56-0e5f-494b-adb0-c34d491bc1fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7666a6299cc4c44ac7495ed00f137dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.956218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-25a4dd56-0e5f-494b-adb0-c34d491bc1fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7666a6299cc4c44ac7495ed00f137dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.956218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-25a4dd56-0e5f-494b-adb0-c34d491bc1fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7666a6299cc4c44ac7495ed00f137dd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.966958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee613fa1c524241abc6f7429fae54d2', 'request_id': 'req-88f22e96-ca04-45b9-94ab-095ef3d98243'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.979320 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee613fa1c524241abc6f7429fae54d2', 'request_id': 'req-88f22e96-ca04-45b9-94ab-095ef3d98243'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:44.982931 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1243/2488] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:44 2022] DELETE /identity/v3/users/d7666a6299cc4c44ac7495ed00f137dd => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:44.984571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7cbab-bafe-422a-8377-c3941d3444c2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:44.984991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7cbab-bafe-422a-8377-c3941d3444c2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:44.985337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7cbab-bafe-422a-8377-c3941d3444c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:44.991977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee613fa1c524241abc6f7429fae54d2', 'request_id': 'req-88f22e96-ca04-45b9-94ab-095ef3d98243'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.026248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4cb7cbab-bafe-422a-8377-c3941d3444c2 None None] MFA Rules not processed for user `e54d9da609ad49948846a43ff36604ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:45.027847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4cb7cbab-bafe-422a-8377-c3941d3444c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:45.045995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] The token cache is being invalidate because project fee613fa1c524241abc6f7429fae54d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:45.046534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.047319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.049571 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1246/2489] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:44 2022] DELETE /identity/v3/projects/fee613fa1c524241abc6f7429fae54d2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:45.053415 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:45.057517 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:45.108956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1244/2490] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:45.123403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7cbab-bafe-422a-8377-c3941d3444c2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:45.124856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4cb7cbab-bafe-422a-8377-c3941d3444c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:45.138667 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f22e96-ca04-45b9-94ab-095ef3d98243 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:45.190064 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7cbab-bafe-422a-8377-c3941d3444c2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:45.193879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5db0c-0b94-4626-81a4-e38985e78960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:45.194630 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5db0c-0b94-4626-81a4-e38985e78960 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:45.194929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5db0c-0b94-4626-81a4-e38985e78960 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:45.195210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5db0c-0b94-4626-81a4-e38985e78960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:45.198085 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5631d17-f433-493a-a617-8d800b811d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:45.198961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5631d17-f433-493a-a617-8d800b811d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:45.199247 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5631d17-f433-493a-a617-8d800b811d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:45.199525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5631d17-f433-493a-a617-8d800b811d73 admin admin] PATH_INFO: `/v3/users/ed7afa554acd42cab84592a0e302c061` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:45.201562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5631d17-f433-493a-a617-8d800b811d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7afa554acd42cab84592a0e302c061)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:45.203537 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5631d17-f433-493a-a617-8d800b811d73 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:45.214163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5db0c-0b94-4626-81a4-e38985e78960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:45.215317 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5db0c-0b94-4626-81a4-e38985e78960 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:45.226544 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1245/2491] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:45.227769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5db0c-0b94-4626-81a4-e38985e78960 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:45.229200 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3bf5db0c-0b94-4626-81a4-e38985e78960 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:45.244698 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5db0c-0b94-4626-81a4-e38985e78960 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:45.251383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:45.252251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:45.252538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:45.252812 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] PATH_INFO: `/v3/projects/84e8eb8075684d34bedb78f6d3b88838` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:45.254078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e8eb8075684d34bedb78f6d3b88838)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:45.256037 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:45.434271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e8eb8075684d34bedb78f6d3b88838', 'request_id': 'req-7324545b-fc69-475a-867c-e4ae08c3d89c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.434522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5631d17-f433-493a-a617-8d800b811d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7afa554acd42cab84592a0e302c061'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.440343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e8eb8075684d34bedb78f6d3b88838', 'request_id': 'req-7324545b-fc69-475a-867c-e4ae08c3d89c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.441209 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5631d17-f433-493a-a617-8d800b811d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7afa554acd42cab84592a0e302c061'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.445901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e8eb8075684d34bedb78f6d3b88838', 'request_id': 'req-7324545b-fc69-475a-867c-e4ae08c3d89c'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.504082 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5631d17-f433-493a-a617-8d800b811d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7afa554acd42cab84592a0e302c061'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.504697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5631d17-f433-493a-a617-8d800b811d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7afa554acd42cab84592a0e302c061'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.505304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5631d17-f433-493a-a617-8d800b811d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7afa554acd42cab84592a0e302c061'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.523055 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1247/2492] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:45 2022] DELETE /identity/v3/users/ed7afa554acd42cab84592a0e302c061 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:45.523979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5631d17-f433-493a-a617-8d800b811d73 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:45.525234 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a5631d17-f433-493a-a617-8d800b811d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:45.572535 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] The token cache is being invalidate because project 84e8eb8075684d34bedb78f6d3b88838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:45.572948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.573697 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.579182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1246/2493] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:45 2022] DELETE /identity/v3/projects/84e8eb8075684d34bedb78f6d3b88838 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:45.579182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:45.579182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:45.590353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5631d17-f433-493a-a617-8d800b811d73 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:45.594821 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e0159-b0b1-4d92-842d-44860db2f595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:45.595695 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e0159-b0b1-4d92-842d-44860db2f595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:45.595975 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e0159-b0b1-4d92-842d-44860db2f595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:45.596251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e0159-b0b1-4d92-842d-44860db2f595 admin admin] PATH_INFO: `/v3/users/e54d9da609ad49948846a43ff36604ab` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:45.597474 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e0159-b0b1-4d92-842d-44860db2f595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e54d9da609ad49948846a43ff36604ab)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:45.604582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e0159-b0b1-4d92-842d-44860db2f595 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:45.646645 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324545b-fc69-475a-867c-e4ae08c3d89c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:45.652155 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:45.653015 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:45.653300 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:45.653610 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2 admin admin] PATH_INFO: `/v3/projects/54d75c229dc14e59b53a1ec63a0f00f8` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:45.654788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d75c229dc14e59b53a1ec63a0f00f8)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:45.656757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:45.826941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe8e0159-b0b1-4d92-842d-44860db2f595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e54d9da609ad49948846a43ff36604ab'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.833928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d75c229dc14e59b53a1ec63a0f00f8', 'request_id': 'req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.837595 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe8e0159-b0b1-4d92-842d-44860db2f595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e54d9da609ad49948846a43ff36604ab'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.842271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d75c229dc14e59b53a1ec63a0f00f8', 'request_id': 'req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.847870 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d75c229dc14e59b53a1ec63a0f00f8', 'request_id': 'req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.939535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe8e0159-b0b1-4d92-842d-44860db2f595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e54d9da609ad49948846a43ff36604ab'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.940177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe8e0159-b0b1-4d92-842d-44860db2f595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e54d9da609ad49948846a43ff36604ab'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.940777 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe8e0159-b0b1-4d92-842d-44860db2f595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e54d9da609ad49948846a43ff36604ab'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.958603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1248/2494] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:45 2022] DELETE /identity/v3/users/e54d9da609ad49948846a43ff36604ab => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:45.959857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d1b75-3e7e-4b5f-a407-9d52be993769 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:45.960147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d1b75-3e7e-4b5f-a407-9d52be993769 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:45.960424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d1b75-3e7e-4b5f-a407-9d52be993769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:45.979637 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e61d1b75-3e7e-4b5f-a407-9d52be993769 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:45.980850 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e61d1b75-3e7e-4b5f-a407-9d52be993769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:45.997868 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2 admin admin] The token cache is being invalidate because project 54d75c229dc14e59b53a1ec63a0f00f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:45.998161 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:45.998807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-09cadda7-7e81-41e6-8e20-0a1ac793f4b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:46.000477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1247/2495] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:45 2022] DELETE /identity/v3/projects/54d75c229dc14e59b53a1ec63a0f00f8 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:46.005024 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3c85d-cd82-4f1f-98ef-f0eb2bd817db None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.007542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3c85d-cd82-4f1f-98ef-f0eb2bd817db None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.007542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3c85d-cd82-4f1f-98ef-f0eb2bd817db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.024019 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4ad3c85d-cd82-4f1f-98ef-f0eb2bd817db None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:46.025213 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4ad3c85d-cd82-4f1f-98ef-f0eb2bd817db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:46.041909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1249/2496] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:46.043904 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d1b75-3e7e-4b5f-a407-9d52be993769 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.048006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e61d1b75-3e7e-4b5f-a407-9d52be993769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:46.059916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d1b75-3e7e-4b5f-a407-9d52be993769 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.064345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.065238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.065625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.065909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea admin admin] PATH_INFO: `/v3/projects/df07a7d6459a429785f672822af5a5d7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.067078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=df07a7d6459a429785f672822af5a5d7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.068984 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:46.082581 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1248/2497] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:46.087332 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7183c73-cf37-4767-be72-fb250bc9f483 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.087735 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7183c73-cf37-4767-be72-fb250bc9f483 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.088015 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7183c73-cf37-4767-be72-fb250bc9f483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.105908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-c7183c73-cf37-4767-be72-fb250bc9f483 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:46.107137 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c7183c73-cf37-4767-be72-fb250bc9f483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:46.115259 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1249/2498] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:46.116504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56f295-7130-4f06-aa98-979a714e3362 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.116785 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56f295-7130-4f06-aa98-979a714e3362 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.117059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56f295-7130-4f06-aa98-979a714e3362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.135012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8e56f295-7130-4f06-aa98-979a714e3362 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:46.136234 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8e56f295-7130-4f06-aa98-979a714e3362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:46.144490 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1250/2499] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:46.145404 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56f295-7130-4f06-aa98-979a714e3362 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.146648 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8e56f295-7130-4f06-aa98-979a714e3362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:46.185171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df07a7d6459a429785f672822af5a5d7', 'request_id': 'req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:46.191349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df07a7d6459a429785f672822af5a5d7', 'request_id': 'req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:46.197560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df07a7d6459a429785f672822af5a5d7', 'request_id': 'req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:46.201570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56f295-7130-4f06-aa98-979a714e3362 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.250041 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7aa0e-f282-4892-947a-825dd4db6cff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.250693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7aa0e-f282-4892-947a-825dd4db6cff service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.250978 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7aa0e-f282-4892-947a-825dd4db6cff service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.251260 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7aa0e-f282-4892-947a-825dd4db6cff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.265848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea admin admin] The token cache is being invalidate because project df07a7d6459a429785f672822af5a5d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:46.266221 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:46.266963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-07007a8b-1c28-4d0f-b0cc-6ae53b845dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:46.268728 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1250/2500] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:46 2022] DELETE /identity/v3/projects/df07a7d6459a429785f672822af5a5d7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:46.270088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e16d4-8afc-48cb-85e2-f1fb81cb957e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.270379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e16d4-8afc-48cb-85e2-f1fb81cb957e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.270878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e16d4-8afc-48cb-85e2-f1fb81cb957e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.290111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1f9e16d4-8afc-48cb-85e2-f1fb81cb957e None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:46.291391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1f9e16d4-8afc-48cb-85e2-f1fb81cb957e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:46.311208 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7aa0e-f282-4892-947a-825dd4db6cff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.312589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7aa0e-f282-4892-947a-825dd4db6cff service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:46.326082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1251/2501] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:46.326848 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7aa0e-f282-4892-947a-825dd4db6cff service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.337025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7aa0e-f282-4892-947a-825dd4db6cff service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.345158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4d2c0-1df0-433e-8562-03470f62d431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.345856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4d2c0-1df0-433e-8562-03470f62d431 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.346143 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4d2c0-1df0-433e-8562-03470f62d431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.346427 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4d2c0-1df0-433e-8562-03470f62d431 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.347186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4d2c0-1df0-433e-8562-03470f62d431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:11:46.347499 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4d2c0-1df0-433e-8562-03470f62d431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.349133 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4d2c0-1df0-433e-8562-03470f62d431 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:46.354808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1251/2502] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:46.356061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482a7b-6c3c-47df-8d6a-b97b88216689 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.356459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482a7b-6c3c-47df-8d6a-b97b88216689 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.356836 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42482a7b-6c3c-47df-8d6a-b97b88216689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.362570 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1252/2503] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:11:46.363443 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4d2c0-1df0-433e-8562-03470f62d431 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.373254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4d2c0-1df0-433e-8562-03470f62d431 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.378507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd40ae-a819-4320-a0e2-3ed0f3fa32ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.379164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-42482a7b-6c3c-47df-8d6a-b97b88216689 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:46.379287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd40ae-a819-4320-a0e2-3ed0f3fa32ab admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.379522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd40ae-a819-4320-a0e2-3ed0f3fa32ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.379969 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd40ae-a819-4320-a0e2-3ed0f3fa32ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.380385 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-42482a7b-6c3c-47df-8d6a-b97b88216689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:46.380563 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd40ae-a819-4320-a0e2-3ed0f3fa32ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:11:46.380847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd40ae-a819-4320-a0e2-3ed0f3fa32ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.382554 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd40ae-a819-4320-a0e2-3ed0f3fa32ab admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:46.395337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1252/2504] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:46.395337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42482a7b-6c3c-47df-8d6a-b97b88216689 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.395337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-42482a7b-6c3c-47df-8d6a-b97b88216689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:46.395787 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1253/2505] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:11:46.397175 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19fb2a-77f0-479a-ad6b-f1f86c0d33b4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.397473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19fb2a-77f0-479a-ad6b-f1f86c0d33b4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.398297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19fb2a-77f0-479a-ad6b-f1f86c0d33b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.403861 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42482a7b-6c3c-47df-8d6a-b97b88216689 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.409570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a715606-2d4c-4ed0-ac12-a30c89faf082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.410235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a715606-2d4c-4ed0-ac12-a30c89faf082 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.410519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a715606-2d4c-4ed0-ac12-a30c89faf082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.410795 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a715606-2d4c-4ed0-ac12-a30c89faf082 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.411581 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a715606-2d4c-4ed0-ac12-a30c89faf082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.414094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a715606-2d4c-4ed0-ac12-a30c89faf082 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:46.418158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8d19fb2a-77f0-479a-ad6b-f1f86c0d33b4 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:46.419405 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8d19fb2a-77f0-479a-ad6b-f1f86c0d33b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:46.431477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1254/2506] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:46.431477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19fb2a-77f0-479a-ad6b-f1f86c0d33b4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.440725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19fb2a-77f0-479a-ad6b-f1f86c0d33b4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.443381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d812d27-a295-4eda-b310-9244b043a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.444028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d812d27-a295-4eda-b310-9244b043a6df admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.444319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d812d27-a295-4eda-b310-9244b043a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.444628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d812d27-a295-4eda-b310-9244b043a6df admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.445310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d812d27-a295-4eda-b310-9244b043a6df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.447428 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d812d27-a295-4eda-b310-9244b043a6df admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:46.524645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1253/2507] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:46 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:46.525643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a715606-2d4c-4ed0-ac12-a30c89faf082 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.559526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1255/2508] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:46 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:46.560972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d812d27-a295-4eda-b310-9244b043a6df admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.595328 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a715606-2d4c-4ed0-ac12-a30c89faf082 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.633186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d812d27-a295-4eda-b310-9244b043a6df admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.638373 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ab56e-96bf-46f6-ba21-c3429609d88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.639060 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ab56e-96bf-46f6-ba21-c3429609d88d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.639350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ab56e-96bf-46f6-ba21-c3429609d88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.639629 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ab56e-96bf-46f6-ba21-c3429609d88d admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.640353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ab56e-96bf-46f6-ba21-c3429609d88d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.642507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ab56e-96bf-46f6-ba21-c3429609d88d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:46.665560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be00d6-5c60-4776-899b-2bcbb6d5d3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.666372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be00d6-5c60-4776-899b-2bcbb6d5d3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.666681 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be00d6-5c60-4776-899b-2bcbb6d5d3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.666967 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be00d6-5c60-4776-899b-2bcbb6d5d3c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.667694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be00d6-5c60-4776-899b-2bcbb6d5d3c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:11:46.668009 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be00d6-5c60-4776-899b-2bcbb6d5d3c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.669643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be00d6-5c60-4776-899b-2bcbb6d5d3c1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:46.681452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1254/2509] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:11:46.682491 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be00d6-5c60-4776-899b-2bcbb6d5d3c1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.691910 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be00d6-5c60-4776-899b-2bcbb6d5d3c1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.696999 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606d640-d617-439b-a05f-d0a6934cbea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.697701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606d640-d617-439b-a05f-d0a6934cbea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.697982 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606d640-d617-439b-a05f-d0a6934cbea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.698262 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606d640-d617-439b-a05f-d0a6934cbea7 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.698936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606d640-d617-439b-a05f-d0a6934cbea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.700835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606d640-d617-439b-a05f-d0a6934cbea7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:46.745452 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1256/2510] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:46 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:46.746337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ab56e-96bf-46f6-ba21-c3429609d88d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.755953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ab56e-96bf-46f6-ba21-c3429609d88d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.761115 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980d497-e593-48e2-8b80-4dc4faa782bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.761786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980d497-e593-48e2-8b80-4dc4faa782bb admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.762099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980d497-e593-48e2-8b80-4dc4faa782bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.762384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980d497-e593-48e2-8b80-4dc4faa782bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.763183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980d497-e593-48e2-8b80-4dc4faa782bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.765342 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980d497-e593-48e2-8b80-4dc4faa782bb admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:46.820418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1255/2511] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:46 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:46.821518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606d640-d617-439b-a05f-d0a6934cbea7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.831018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606d640-d617-439b-a05f-d0a6934cbea7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.836364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe8a5e-125a-4157-8e8c-68c50905fb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.837010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe8a5e-125a-4157-8e8c-68c50905fb71 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.837297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe8a5e-125a-4157-8e8c-68c50905fb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.837620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe8a5e-125a-4157-8e8c-68c50905fb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.838338 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe8a5e-125a-4157-8e8c-68c50905fb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.839944 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe8a5e-125a-4157-8e8c-68c50905fb71 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:46.854226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1256/2512] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:46.854226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe8a5e-125a-4157-8e8c-68c50905fb71 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.861209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1257/2513] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:46 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:46.869237 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe8a5e-125a-4157-8e8c-68c50905fb71 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.869691 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980d497-e593-48e2-8b80-4dc4faa782bb admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.869691 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8980d497-e593-48e2-8b80-4dc4faa782bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:46.925180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd91111-f991-4364-871a-0ff57c56441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.925916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd91111-f991-4364-871a-0ff57c56441d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.926202 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd91111-f991-4364-871a-0ff57c56441d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.926599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd91111-f991-4364-871a-0ff57c56441d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.927357 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd91111-f991-4364-871a-0ff57c56441d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.929007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd91111-f991-4364-871a-0ff57c56441d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:46.939020 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1257/2514] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:46.939912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd91111-f991-4364-871a-0ff57c56441d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.940788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980d497-e593-48e2-8b80-4dc4faa782bb admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.946757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.947287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.947573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.947853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] PATH_INFO: `/v3/projects/472f375a8ade48f2b5e32c4780fd03b5` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.949045 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=472f375a8ade48f2b5e32c4780fd03b5)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.950056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd91111-f991-4364-871a-0ff57c56441d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.951005 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:46.955102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b6f55-1278-43b0-88c5-9a97caea978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.955762 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b6f55-1278-43b0-88c5-9a97caea978d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.956030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b6f55-1278-43b0-88c5-9a97caea978d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.956305 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b6f55-1278-43b0-88c5-9a97caea978d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.957015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b6f55-1278-43b0-88c5-9a97caea978d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.958683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b6f55-1278-43b0-88c5-9a97caea978d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:46.968999 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1258/2515] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:46.969798 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b6f55-1278-43b0-88c5-9a97caea978d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:46.979426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b6f55-1278-43b0-88c5-9a97caea978d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:46.984063 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec3d5e-3719-4850-a9c2-b421c7b8b019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:46.984711 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec3d5e-3719-4850-a9c2-b421c7b8b019 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:46.989757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec3d5e-3719-4850-a9c2-b421c7b8b019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:46.989757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec3d5e-3719-4850-a9c2-b421c7b8b019 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:46.989757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec3d5e-3719-4850-a9c2-b421c7b8b019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:46.989757 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec3d5e-3719-4850-a9c2-b421c7b8b019 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:47.088454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '472f375a8ade48f2b5e32c4780fd03b5', 'request_id': 'req-ad0b1c8f-7900-4df4-b1a3-71094e068746'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:47.094561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '472f375a8ade48f2b5e32c4780fd03b5', 'request_id': 'req-ad0b1c8f-7900-4df4-b1a3-71094e068746'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:47.099813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '472f375a8ade48f2b5e32c4780fd03b5', 'request_id': 'req-ad0b1c8f-7900-4df4-b1a3-71094e068746'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:47.116067 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1259/2516] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:46 2022] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:47.117696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec3d5e-3719-4850-a9c2-b421c7b8b019 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:47.127078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec3d5e-3719-4850-a9c2-b421c7b8b019 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:47.162068 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] The token cache is being invalidate because project 472f375a8ade48f2b5e32c4780fd03b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:47.162357 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:47.162991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:47.164559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1258/2517] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:46 2022] DELETE /identity/v3/projects/472f375a8ade48f2b5e32c4780fd03b5 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:47.165295 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:47.169115 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:47.182435 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904cd30-ed37-4ce2-a3db-2214d9093815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:47.183100 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904cd30-ed37-4ce2-a3db-2214d9093815 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.183377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904cd30-ed37-4ce2-a3db-2214d9093815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.183653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904cd30-ed37-4ce2-a3db-2214d9093815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.184449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904cd30-ed37-4ce2-a3db-2214d9093815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:47.186267 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904cd30-ed37-4ce2-a3db-2214d9093815 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:47.199737 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1260/2518] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:47.199737 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904cd30-ed37-4ce2-a3db-2214d9093815 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:47.201432 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c904cd30-ed37-4ce2-a3db-2214d9093815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:47.213266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904cd30-ed37-4ce2-a3db-2214d9093815 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:47.218209 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386de579-f7ee-42f1-9763-e01eb67bb4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:47.218991 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386de579-f7ee-42f1-9763-e01eb67bb4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.219370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386de579-f7ee-42f1-9763-e01eb67bb4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.219744 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386de579-f7ee-42f1-9763-e01eb67bb4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.220641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386de579-f7ee-42f1-9763-e01eb67bb4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:47.222398 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386de579-f7ee-42f1-9763-e01eb67bb4d3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:47.231938 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b1c8f-7900-4df4-b1a3-71094e068746 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:47.232306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1261/2519] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:47.233761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec13df-e48d-400b-b671-6016ed1f9b79 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.234121 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec13df-e48d-400b-b671-6016ed1f9b79 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.234498 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec13df-e48d-400b-b671-6016ed1f9b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.236740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21729e82-4e09-4063-9257-70d126506ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:47.237687 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21729e82-4e09-4063-9257-70d126506ece admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.237968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21729e82-4e09-4063-9257-70d126506ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.238250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21729e82-4e09-4063-9257-70d126506ece admin admin] PATH_INFO: `/v3/projects/ec3e98a71a8740f1a93a1e12b8ab7b12/users/4899c8aa713e45a39205a30d10c589a9/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.252475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b5ec13df-e48d-400b-b671-6016ed1f9b79 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:47.253109 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21729e82-4e09-4063-9257-70d126506ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3e98a71a8740f1a93a1e12b8ab7b12, user_id=4899c8aa713e45a39205a30d10c589a9, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:47.253686 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b5ec13df-e48d-400b-b671-6016ed1f9b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:47.255838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21729e82-4e09-4063-9257-70d126506ece admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:47.261988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1262/2520] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:47.262863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec13df-e48d-400b-b671-6016ed1f9b79 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:47.264089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b5ec13df-e48d-400b-b671-6016ed1f9b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:47.275326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec13df-e48d-400b-b671-6016ed1f9b79 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:47.280088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de04e26-6b01-40af-b9e7-69449b11a086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:47.280939 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de04e26-6b01-40af-b9e7-69449b11a086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.281217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de04e26-6b01-40af-b9e7-69449b11a086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.281511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de04e26-6b01-40af-b9e7-69449b11a086 admin admin] PATH_INFO: `/v3/projects/239c6c8c35ab43c49a07d035b15002a9/users/fe15b01a48f84e59b5d7ff8824b11c2e/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.295945 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de04e26-6b01-40af-b9e7-69449b11a086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239c6c8c35ab43c49a07d035b15002a9, user_id=fe15b01a48f84e59b5d7ff8824b11c2e, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:47.298661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de04e26-6b01-40af-b9e7-69449b11a086 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:47.305942 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1259/2521] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:47 2022] PUT /identity/v3/projects/ec3e98a71a8740f1a93a1e12b8ab7b12/users/4899c8aa713e45a39205a30d10c589a9/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:47.306800 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21729e82-4e09-4063-9257-70d126506ece admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:47.366082 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21729e82-4e09-4063-9257-70d126506ece admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:47.371463 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0635540-e943-4f28-a410-0ba5fdce56b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:47.372113 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0635540-e943-4f28-a410-0ba5fdce56b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.372394 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0635540-e943-4f28-a410-0ba5fdce56b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.372671 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0635540-e943-4f28-a410-0ba5fdce56b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.373478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0635540-e943-4f28-a410-0ba5fdce56b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:47.375129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0635540-e943-4f28-a410-0ba5fdce56b1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:47.385560 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1260/2522] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:47.443369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67ac94-5d00-4a28-8a0a-ce22bdd639f8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.443369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67ac94-5d00-4a28-8a0a-ce22bdd639f8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.443369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67ac94-5d00-4a28-8a0a-ce22bdd639f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.443792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1263/2523] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:47 2022] PUT /identity/v3/projects/239c6c8c35ab43c49a07d035b15002a9/users/fe15b01a48f84e59b5d7ff8824b11c2e/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:47.443792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683ea9e-057d-4a63-bdd0-572b83f53800 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.443792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683ea9e-057d-4a63-bdd0-572b83f53800 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.443792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683ea9e-057d-4a63-bdd0-572b83f53800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.443792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8683ea9e-057d-4a63-bdd0-572b83f53800 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:47.444863 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8683ea9e-057d-4a63-bdd0-572b83f53800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:47.444989 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-0c67ac94-5d00-4a28-8a0a-ce22bdd639f8 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:47.444989 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-0c67ac94-5d00-4a28-8a0a-ce22bdd639f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:47.484725 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1261/2524] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:47.485597 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67ac94-5d00-4a28-8a0a-ce22bdd639f8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:47.486059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1264/2525] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:47.487498 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b913c-3c7e-4690-a4f1-f74432830fd3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.487936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b913c-3c7e-4690-a4f1-f74432830fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.488220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b913c-3c7e-4690-a4f1-f74432830fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.496504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67ac94-5d00-4a28-8a0a-ce22bdd639f8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:47.501774 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f533e-9a43-44ec-a9b0-27a59d800ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:47.502667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f533e-9a43-44ec-a9b0-27a59d800ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.502950 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f533e-9a43-44ec-a9b0-27a59d800ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.503232 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f533e-9a43-44ec-a9b0-27a59d800ffd admin admin] PATH_INFO: `/v3/projects/51bb9f314eae4efa92247d105429ab43/users/20b8289fc2bb4ff29a76beb85def2822/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.514162 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b19b913c-3c7e-4690-a4f1-f74432830fd3 None None] MFA Rules not processed for user `fe15b01a48f84e59b5d7ff8824b11c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:47.515353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b19b913c-3c7e-4690-a4f1-f74432830fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:47.518819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f533e-9a43-44ec-a9b0-27a59d800ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=51bb9f314eae4efa92247d105429ab43, user_id=20b8289fc2bb4ff29a76beb85def2822, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:47.522222 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f533e-9a43-44ec-a9b0-27a59d800ffd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:47.579748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1265/2526] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:47.580730 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b913c-3c7e-4690-a4f1-f74432830fd3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:47.590786 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b913c-3c7e-4690-a4f1-f74432830fd3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:47.595604 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2fdbc-b207-4f8d-bd12-e77cb5bd16c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:47.596265 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2fdbc-b207-4f8d-bd12-e77cb5bd16c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.596547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2fdbc-b207-4f8d-bd12-e77cb5bd16c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.596825 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2fdbc-b207-4f8d-bd12-e77cb5bd16c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.597627 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2fdbc-b207-4f8d-bd12-e77cb5bd16c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:11:47.597940 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2fdbc-b207-4f8d-bd12-e77cb5bd16c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:47.599567 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2fdbc-b207-4f8d-bd12-e77cb5bd16c6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:47.614908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1266/2527] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:11:47.614908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2fdbc-b207-4f8d-bd12-e77cb5bd16c6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:47.614908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6ce2fdbc-b207-4f8d-bd12-e77cb5bd16c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:47.670798 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2fdbc-b207-4f8d-bd12-e77cb5bd16c6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:47.677430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1262/2528] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:47 2022] PUT /identity/v3/projects/51bb9f314eae4efa92247d105429ab43/users/20b8289fc2bb4ff29a76beb85def2822/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:47.678353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f533e-9a43-44ec-a9b0-27a59d800ffd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:47.680573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b43f533e-9a43-44ec-a9b0-27a59d800ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:47.718931 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8480da5-5b83-47a6-bb80-5c2de9e64e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:47.719572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480da5-5b83-47a6-bb80-5c2de9e64e29 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.719848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480da5-5b83-47a6-bb80-5c2de9e64e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.720120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8480da5-5b83-47a6-bb80-5c2de9e64e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.751820 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f533e-9a43-44ec-a9b0-27a59d800ffd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:47.757788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0290786-3d87-4121-95c9-d0e0764014d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:47.758451 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0290786-3d87-4121-95c9-d0e0764014d0 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.758748 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0290786-3d87-4121-95c9-d0e0764014d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.759032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0290786-3d87-4121-95c9-d0e0764014d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.778545 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8480da5-5b83-47a6-bb80-5c2de9e64e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:47.780058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8480da5-5b83-47a6-bb80-5c2de9e64e29 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:47.790408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1267/2529] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:47.796278 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8480da5-5b83-47a6-bb80-5c2de9e64e29 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:47.801298 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8480da5-5b83-47a6-bb80-5c2de9e64e29 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:47.807418 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff4cd0-2a4d-4225-b218-7135a8b8629f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:47.808053 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff4cd0-2a4d-4225-b218-7135a8b8629f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.808348 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff4cd0-2a4d-4225-b218-7135a8b8629f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.808619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff4cd0-2a4d-4225-b218-7135a8b8629f admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.809303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff4cd0-2a4d-4225-b218-7135a8b8629f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:47.811346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff4cd0-2a4d-4225-b218-7135a8b8629f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:47.816863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0290786-3d87-4121-95c9-d0e0764014d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:47.818655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0290786-3d87-4121-95c9-d0e0764014d0 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:47.828332 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1263/2530] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:47.829789 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c12ea2-456b-40af-9ed2-72d30f0137c6 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:47.835861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c12ea2-456b-40af-9ed2-72d30f0137c6 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:47.835861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c12ea2-456b-40af-9ed2-72d30f0137c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:47.857697 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a2c12ea2-456b-40af-9ed2-72d30f0137c6 None None] MFA Rules not processed for user `20b8289fc2bb4ff29a76beb85def2822`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:47.864709 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a2c12ea2-456b-40af-9ed2-72d30f0137c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:47.923920 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1264/2531] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:47.928921 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c12ea2-456b-40af-9ed2-72d30f0137c6 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:47.935765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1268/2532] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:47 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:47.937392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff4cd0-2a4d-4225-b218-7135a8b8629f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:47.940442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c12ea2-456b-40af-9ed2-72d30f0137c6 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:48.000916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4e032-3a11-47e2-8ddc-530e5ba62372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:48.001720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e032-3a11-47e2-8ddc-530e5ba62372 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:48.002006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e032-3a11-47e2-8ddc-530e5ba62372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:48.002286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e032-3a11-47e2-8ddc-530e5ba62372 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:48.002972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4e032-3a11-47e2-8ddc-530e5ba62372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:48.004927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4e032-3a11-47e2-8ddc-530e5ba62372 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:48.012712 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff4cd0-2a4d-4225-b218-7135a8b8629f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:48.017389 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09535e5e-da9c-4f0e-954f-808080823642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:48.018091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09535e5e-da9c-4f0e-954f-808080823642 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:48.018380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09535e5e-da9c-4f0e-954f-808080823642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:48.018660 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09535e5e-da9c-4f0e-954f-808080823642 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:48.019373 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09535e5e-da9c-4f0e-954f-808080823642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:48.021302 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09535e5e-da9c-4f0e-954f-808080823642 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:48.084744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1265/2533] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:47 2022] POST /identity/v3/projects => generated 369 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:48.087250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1269/2534] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:47 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:48.087996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4e032-3a11-47e2-8ddc-530e5ba62372 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:48.089489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09535e5e-da9c-4f0e-954f-808080823642 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:48.099977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09535e5e-da9c-4f0e-954f-808080823642 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:48.159869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4e032-3a11-47e2-8ddc-530e5ba62372 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:48.164643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ce60d-154c-4786-bf26-8705d8e8e969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:48.164858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda50d4-f4b4-466a-8cd8-e4a133e2749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:48.165470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda50d4-f4b4-466a-8cd8-e4a133e2749a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:48.165621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ce60d-154c-4786-bf26-8705d8e8e969 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:48.165890 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda50d4-f4b4-466a-8cd8-e4a133e2749a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:48.166012 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ce60d-154c-4786-bf26-8705d8e8e969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:48.166187 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda50d4-f4b4-466a-8cd8-e4a133e2749a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:48.166368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ce60d-154c-4786-bf26-8705d8e8e969 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:48.166968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda50d4-f4b4-466a-8cd8-e4a133e2749a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:48.167176 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ce60d-154c-4786-bf26-8705d8e8e969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:48.168951 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda50d4-f4b4-466a-8cd8-e4a133e2749a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:48.169217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ce60d-154c-4786-bf26-8705d8e8e969 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:48.179530 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1266/2535] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:48.183376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda50d4-f4b4-466a-8cd8-e4a133e2749a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:48.193047 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda50d4-f4b4-466a-8cd8-e4a133e2749a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:48.198470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6cf6f-7886-4039-a510-cf65381d6a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:48.199130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6cf6f-7886-4039-a510-cf65381d6a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:48.199416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6cf6f-7886-4039-a510-cf65381d6a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:48.199813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6cf6f-7886-4039-a510-cf65381d6a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:48.200569 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6cf6f-7886-4039-a510-cf65381d6a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:48.202203 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6cf6f-7886-4039-a510-cf65381d6a1d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:48.213008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1267/2536] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:11:48.217078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6cf6f-7886-4039-a510-cf65381d6a1d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:48.226605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6cf6f-7886-4039-a510-cf65381d6a1d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:48.231356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227df432-82e0-45c3-af75-22aee7e8ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:48.232270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df432-82e0-45c3-af75-22aee7e8ce61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:48.232663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df432-82e0-45c3-af75-22aee7e8ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:48.232879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df432-82e0-45c3-af75-22aee7e8ce61 admin admin] PATH_INFO: `/v3/projects/b37271fa94bf4dd7b16f144dbb9c049c/users/98cd883e05da4e5798ad64e7a43bfed1/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:48.238738 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1270/2537] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:48 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:48.239758 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ce60d-154c-4786-bf26-8705d8e8e969 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:48.248677 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227df432-82e0-45c3-af75-22aee7e8ce61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b37271fa94bf4dd7b16f144dbb9c049c, user_id=98cd883e05da4e5798ad64e7a43bfed1, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:48.251411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227df432-82e0-45c3-af75-22aee7e8ce61 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:48.251707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ce60d-154c-4786-bf26-8705d8e8e969 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:48.257387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4f280-c2b2-4df7-87a2-2eb6decb2930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:48.258089 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f280-c2b2-4df7-87a2-2eb6decb2930 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:48.258376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f280-c2b2-4df7-87a2-2eb6decb2930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:48.258655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f280-c2b2-4df7-87a2-2eb6decb2930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:48.259389 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4f280-c2b2-4df7-87a2-2eb6decb2930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:48.260988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4f280-c2b2-4df7-87a2-2eb6decb2930 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:48.271432 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1271/2538] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:48.276835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4f280-c2b2-4df7-87a2-2eb6decb2930 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:48.286600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4f280-c2b2-4df7-87a2-2eb6decb2930 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:48.291426 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f459460-16b9-4eb5-a751-98e7e7cd2732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:48.292405 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f459460-16b9-4eb5-a751-98e7e7cd2732 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:48.292690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f459460-16b9-4eb5-a751-98e7e7cd2732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:48.292974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f459460-16b9-4eb5-a751-98e7e7cd2732 admin admin] PATH_INFO: `/v3/projects/999b979bff2c442c8ff51f713a9a026b/users/5e9b5baead284056aa7f3b0939d2b993/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:48.307988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f459460-16b9-4eb5-a751-98e7e7cd2732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=999b979bff2c442c8ff51f713a9a026b, user_id=5e9b5baead284056aa7f3b0939d2b993, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:48.310796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f459460-16b9-4eb5-a751-98e7e7cd2732 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:48.346379 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1268/2539] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:48 2022] PUT /identity/v3/projects/b37271fa94bf4dd7b16f144dbb9c049c/users/98cd883e05da4e5798ad64e7a43bfed1/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:11:48.359439 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeab142-fc62-4876-ad8f-5497b6fd9470 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:48.359731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeab142-fc62-4876-ad8f-5497b6fd9470 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:48.360560 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeab142-fc62-4876-ad8f-5497b6fd9470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:48.378703 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5aeab142-fc62-4876-ad8f-5497b6fd9470 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:48.379908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5aeab142-fc62-4876-ad8f-5497b6fd9470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:48.426223 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1272/2540] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:48 2022] PUT /identity/v3/projects/999b979bff2c442c8ff51f713a9a026b/users/5e9b5baead284056aa7f3b0939d2b993/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:11:48.431217 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f459460-16b9-4eb5-a751-98e7e7cd2732 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:48.438731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1269/2541] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:48.449310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeab142-fc62-4876-ad8f-5497b6fd9470 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:48.506252 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeab142-fc62-4876-ad8f-5497b6fd9470 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:48.524230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f459460-16b9-4eb5-a751-98e7e7cd2732 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:48.531499 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769be78b-a801-4ee3-8e04-2ab9db2bfcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:48.532313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be78b-a801-4ee3-8e04-2ab9db2bfcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:48.532701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be78b-a801-4ee3-8e04-2ab9db2bfcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:48.533079 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be78b-a801-4ee3-8e04-2ab9db2bfcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:48.533960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769be78b-a801-4ee3-8e04-2ab9db2bfcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:48.537979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769be78b-a801-4ee3-8e04-2ab9db2bfcb6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:48.557668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e993989-502b-4a41-bd9c-a3a12f3c76df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:48.558331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e993989-502b-4a41-bd9c-a3a12f3c76df service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:48.558611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e993989-502b-4a41-bd9c-a3a12f3c76df service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:48.558888 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e993989-502b-4a41-bd9c-a3a12f3c76df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:48.571618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e993989-502b-4a41-bd9c-a3a12f3c76df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:48.574511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e993989-502b-4a41-bd9c-a3a12f3c76df service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:48.577784 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1273/2542] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:11:48.578848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769be78b-a801-4ee3-8e04-2ab9db2bfcb6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:48.584706 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1270/2543] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:11:48.592039 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769be78b-a801-4ee3-8e04-2ab9db2bfcb6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:48.597391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436dddc-5481-4c9e-95cd-38204cf7770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:48.598424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436dddc-5481-4c9e-95cd-38204cf7770c admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:48.598713 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436dddc-5481-4c9e-95cd-38204cf7770c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:48.598988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436dddc-5481-4c9e-95cd-38204cf7770c admin admin] PATH_INFO: `/v3/projects/999b979bff2c442c8ff51f713a9a026b/users/5e9b5baead284056aa7f3b0939d2b993/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:48.603618 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436dddc-5481-4c9e-95cd-38204cf7770c admin admin] RBAC: Authorizing `identity:create_grant(project_id=999b979bff2c442c8ff51f713a9a026b, user_id=5e9b5baead284056aa7f3b0939d2b993, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:48.605118 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436dddc-5481-4c9e-95cd-38204cf7770c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:48.618697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1274/2544] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:48 2022] PUT /identity/v3/projects/999b979bff2c442c8ff51f713a9a026b/users/5e9b5baead284056aa7f3b0939d2b993/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:48.628716 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846322b7-b90d-40b6-8a4f-a6edae9815a0 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:48.629006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846322b7-b90d-40b6-8a4f-a6edae9815a0 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:48.629287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846322b7-b90d-40b6-8a4f-a6edae9815a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:48.671309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-846322b7-b90d-40b6-8a4f-a6edae9815a0 None None] MFA Rules not processed for user `5e9b5baead284056aa7f3b0939d2b993`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:48.671309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-846322b7-b90d-40b6-8a4f-a6edae9815a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:48.727619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1271/2545] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:48.738490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436dddc-5481-4c9e-95cd-38204cf7770c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:48.740312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c436dddc-5481-4c9e-95cd-38204cf7770c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:48.798760 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436dddc-5481-4c9e-95cd-38204cf7770c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:48.801870 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ec176-692d-4987-bf1b-31feffded3b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:48.802512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ec176-692d-4987-bf1b-31feffded3b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:48.802793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ec176-692d-4987-bf1b-31feffded3b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:48.803068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ec176-692d-4987-bf1b-31feffded3b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:48.813343 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ec176-692d-4987-bf1b-31feffded3b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:48.814895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ec176-692d-4987-bf1b-31feffded3b6 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:48.825806 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1275/2546] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:49.240408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312442a-aab3-4361-909f-75c6635afb81 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:49.242063 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312442a-aab3-4361-909f-75c6635afb81 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:49.242559 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312442a-aab3-4361-909f-75c6635afb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:49.278600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-5312442a-aab3-4361-909f-75c6635afb81 None None] MFA Rules not processed for user `4899c8aa713e45a39205a30d10c589a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:49.279984 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5312442a-aab3-4361-909f-75c6635afb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:49.353023 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1272/2547] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:49.357838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ec176-692d-4987-bf1b-31feffded3b6 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:49.420843 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ec176-692d-4987-bf1b-31feffded3b6 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:49.425646 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76266f-0c37-4d3b-84f7-0988d47659c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:49.426266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76266f-0c37-4d3b-84f7-0988d47659c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:49.426551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76266f-0c37-4d3b-84f7-0988d47659c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:49.426824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76266f-0c37-4d3b-84f7-0988d47659c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:49.427668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76266f-0c37-4d3b-84f7-0988d47659c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:49.429669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76266f-0c37-4d3b-84f7-0988d47659c4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:49.641845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1276/2548] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:49 2022] POST /identity/v3/projects => generated 371 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:49.642121 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312442a-aab3-4361-909f-75c6635afb81 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:49.653722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312442a-aab3-4361-909f-75c6635afb81 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:49.715675 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e2426-e4f0-4b9b-9770-38579e43cd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:49.717096 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e2426-e4f0-4b9b-9770-38579e43cd8c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:49.717621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e2426-e4f0-4b9b-9770-38579e43cd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:49.727375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e2426-e4f0-4b9b-9770-38579e43cd8c admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:49.727375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e2426-e4f0-4b9b-9770-38579e43cd8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:49.727375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e2426-e4f0-4b9b-9770-38579e43cd8c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:49.844853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1273/2549] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:49 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:49.851717 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76266f-0c37-4d3b-84f7-0988d47659c4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:49.861028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76266f-0c37-4d3b-84f7-0988d47659c4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:49.865753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d724f8-e9e3-442e-a534-0c9d082e0a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:49.866746 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d724f8-e9e3-442e-a534-0c9d082e0a57 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:49.866746 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d724f8-e9e3-442e-a534-0c9d082e0a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:49.866993 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d724f8-e9e3-442e-a534-0c9d082e0a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:49.867717 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d724f8-e9e3-442e-a534-0c9d082e0a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:49.869304 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d724f8-e9e3-442e-a534-0c9d082e0a57 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:49.879960 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1277/2550] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:49.884886 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e2426-e4f0-4b9b-9770-38579e43cd8c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:49.894833 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e2426-e4f0-4b9b-9770-38579e43cd8c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:49.900096 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b3291-15ea-4d26-8ee3-9322e5d50d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:49.900977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b3291-15ea-4d26-8ee3-9322e5d50d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:49.901511 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b3291-15ea-4d26-8ee3-9322e5d50d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:49.901817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b3291-15ea-4d26-8ee3-9322e5d50d2f admin admin] PATH_INFO: `/v3/projects/2dddb9690f5b400d82f198697fc187e0/users/afe96c9fb8534fff8afb79afea5251ed/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:49.917806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b3291-15ea-4d26-8ee3-9322e5d50d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dddb9690f5b400d82f198697fc187e0, user_id=afe96c9fb8534fff8afb79afea5251ed, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:49.920581 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b3291-15ea-4d26-8ee3-9322e5d50d2f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:50.036655 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1274/2551] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:49 2022] PUT /identity/v3/projects/2dddb9690f5b400d82f198697fc187e0/users/afe96c9fb8534fff8afb79afea5251ed/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:50.037868 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d724f8-e9e3-442e-a534-0c9d082e0a57 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:50.048995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d724f8-e9e3-442e-a534-0c9d082e0a57 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:50.114437 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c555b7-35a0-42c7-b94e-d7bf8238d7aa None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:50.118799 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c555b7-35a0-42c7-b94e-d7bf8238d7aa None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:50.118799 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c555b7-35a0-42c7-b94e-d7bf8238d7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:50.122469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44872872-cc34-403d-b850-9f79de69051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:50.123150 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44872872-cc34-403d-b850-9f79de69051c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:50.123437 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44872872-cc34-403d-b850-9f79de69051c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:50.123716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44872872-cc34-403d-b850-9f79de69051c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:50.124739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44872872-cc34-403d-b850-9f79de69051c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:50.126803 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44872872-cc34-403d-b850-9f79de69051c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:50.141663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1278/2552] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:50.146392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44872872-cc34-403d-b850-9f79de69051c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:50.149951 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-76c555b7-35a0-42c7-b94e-d7bf8238d7aa None None] MFA Rules not processed for user `98cd883e05da4e5798ad64e7a43bfed1`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:50.151498 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-76c555b7-35a0-42c7-b94e-d7bf8238d7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:50.160523 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44872872-cc34-403d-b850-9f79de69051c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:50.166033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f30af-4a18-4eb3-9038-5b6cb911b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:50.167034 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f30af-4a18-4eb3-9038-5b6cb911b303 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:50.167270 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f30af-4a18-4eb3-9038-5b6cb911b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:50.167552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f30af-4a18-4eb3-9038-5b6cb911b303 admin admin] PATH_INFO: `/v3/projects/2dddb9690f5b400d82f198697fc187e0/users/afe96c9fb8534fff8afb79afea5251ed/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:50.169732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f30af-4a18-4eb3-9038-5b6cb911b303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dddb9690f5b400d82f198697fc187e0, user_id=afe96c9fb8534fff8afb79afea5251ed, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:50.173599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f30af-4a18-4eb3-9038-5b6cb911b303 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:50.185787 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1279/2553] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:50 2022] PUT /identity/v3/projects/2dddb9690f5b400d82f198697fc187e0/users/afe96c9fb8534fff8afb79afea5251ed/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:50.223256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1275/2554] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:50.234240 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f30af-4a18-4eb3-9038-5b6cb911b303 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:50.295974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f30af-4a18-4eb3-9038-5b6cb911b303 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:50.295974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4c8a5-a759-4c68-917a-6746829d9f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:50.295974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4c8a5-a759-4c68-917a-6746829d9f1c service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:50.295974 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4c8a5-a759-4c68-917a-6746829d9f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:50.296349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4c8a5-a759-4c68-917a-6746829d9f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:50.354574 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4c8a5-a759-4c68-917a-6746829d9f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:50.356115 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4c8a5-a759-4c68-917a-6746829d9f1c service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:50.365848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1280/2555] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:11:51.199819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c555b7-35a0-42c7-b94e-d7bf8238d7aa None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:51.211862 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c555b7-35a0-42c7-b94e-d7bf8238d7aa None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:51.288786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749897a2-bd1c-4b16-8715-45bd3eab2225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:51.289718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749897a2-bd1c-4b16-8715-45bd3eab2225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:51.290007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749897a2-bd1c-4b16-8715-45bd3eab2225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:51.290286 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749897a2-bd1c-4b16-8715-45bd3eab2225 admin admin] PATH_INFO: `/v3/users/fe15b01a48f84e59b5d7ff8824b11c2e` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:51.291472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749897a2-bd1c-4b16-8715-45bd3eab2225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe15b01a48f84e59b5d7ff8824b11c2e)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:51.293477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749897a2-bd1c-4b16-8715-45bd3eab2225 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:51.559467 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-749897a2-bd1c-4b16-8715-45bd3eab2225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe15b01a48f84e59b5d7ff8824b11c2e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:51.692755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-749897a2-bd1c-4b16-8715-45bd3eab2225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe15b01a48f84e59b5d7ff8824b11c2e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:51.702001 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-749897a2-bd1c-4b16-8715-45bd3eab2225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe15b01a48f84e59b5d7ff8824b11c2e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:51.702946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-749897a2-bd1c-4b16-8715-45bd3eab2225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe15b01a48f84e59b5d7ff8824b11c2e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:51.703847 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-749897a2-bd1c-4b16-8715-45bd3eab2225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe15b01a48f84e59b5d7ff8824b11c2e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:51.729214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcfc78-c287-459f-8152-58b2b0790d4b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:51.729763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcfc78-c287-459f-8152-58b2b0790d4b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:51.729763 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcfc78-c287-459f-8152-58b2b0790d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:51.741303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1276/2556] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:51 2022] DELETE /identity/v3/users/fe15b01a48f84e59b5d7ff8824b11c2e => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:51.741303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c975f1-b5b3-4268-9fb2-4f56d6d5c535 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:51.741303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c975f1-b5b3-4268-9fb2-4f56d6d5c535 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:51.741785 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c975f1-b5b3-4268-9fb2-4f56d6d5c535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:51.766726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-96c975f1-b5b3-4268-9fb2-4f56d6d5c535 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:51.768242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-96c975f1-b5b3-4268-9fb2-4f56d6d5c535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:51.771662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-66dcfc78-c287-459f-8152-58b2b0790d4b None None] MFA Rules not processed for user `afe96c9fb8534fff8afb79afea5251ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:51.773886 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-66dcfc78-c287-459f-8152-58b2b0790d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:51.850446 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1277/2557] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:51.863335 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c975f1-b5b3-4268-9fb2-4f56d6d5c535 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:51.864976 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-96c975f1-b5b3-4268-9fb2-4f56d6d5c535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:51.866021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1281/2558] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:11:51.877102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcfc78-c287-459f-8152-58b2b0790d4b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:51.878728 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-66dcfc78-c287-459f-8152-58b2b0790d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:51.925681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c975f1-b5b3-4268-9fb2-4f56d6d5c535 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:51.930043 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42332f6-5506-4687-8889-1b5c2e9dd3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:51.930689 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42332f6-5506-4687-8889-1b5c2e9dd3bc service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:51.930970 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42332f6-5506-4687-8889-1b5c2e9dd3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:51.931242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42332f6-5506-4687-8889-1b5c2e9dd3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:51.937701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcfc78-c287-459f-8152-58b2b0790d4b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:51.938597 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48175d-2163-4f50-833f-5b90f1aaa7fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:51.939250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48175d-2163-4f50-833f-5b90f1aaa7fb service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:51.939543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48175d-2163-4f50-833f-5b90f1aaa7fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:51.939803 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48175d-2163-4f50-833f-5b90f1aaa7fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:51.941567 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2b48175d-2163-4f50-833f-5b90f1aaa7fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:51.941698 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42332f6-5506-4687-8889-1b5c2e9dd3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:51.943243 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42332f6-5506-4687-8889-1b5c2e9dd3bc service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:51.954696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1278/2559] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:11:52.008006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48175d-2163-4f50-833f-5b90f1aaa7fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:52.009935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48175d-2163-4f50-833f-5b90f1aaa7fb service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:52.019044 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1282/2560] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:11:52.381727 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42332f6-5506-4687-8889-1b5c2e9dd3bc service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:52.383170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a42332f6-5506-4687-8889-1b5c2e9dd3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:52.396436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42332f6-5506-4687-8889-1b5c2e9dd3bc service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:52.402339 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:52.403197 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:52.403523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:52.403785 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0 admin admin] PATH_INFO: `/v3/projects/239c6c8c35ab43c49a07d035b15002a9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:52.404968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=239c6c8c35ab43c49a07d035b15002a9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:52.407966 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:52.469251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cc645-7f8b-4335-8907-1e83aa374464 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:52.469570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cc645-7f8b-4335-8907-1e83aa374464 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:52.469860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cc645-7f8b-4335-8907-1e83aa374464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:52.486948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d75cc645-7f8b-4335-8907-1e83aa374464 None None] MFA Rules not processed for user `98cd883e05da4e5798ad64e7a43bfed1`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:52.488210 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d75cc645-7f8b-4335-8907-1e83aa374464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:52.542490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1283/2561] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:11:52.546469 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cc645-7f8b-4335-8907-1e83aa374464 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:52.551063 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d75cc645-7f8b-4335-8907-1e83aa374464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:52.552006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239c6c8c35ab43c49a07d035b15002a9', 'request_id': 'req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:52.558498 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239c6c8c35ab43c49a07d035b15002a9', 'request_id': 'req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:52.564306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239c6c8c35ab43c49a07d035b15002a9', 'request_id': 'req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:52.565956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cc645-7f8b-4335-8907-1e83aa374464 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:52.624183 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86030aa7-b279-4cd4-81c7-d5284f45fbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:52.625114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030aa7-b279-4cd4-81c7-d5284f45fbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:52.625334 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030aa7-b279-4cd4-81c7-d5284f45fbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:52.625715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030aa7-b279-4cd4-81c7-d5284f45fbe8 admin admin] PATH_INFO: `/v3/users/20b8289fc2bb4ff29a76beb85def2822` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:52.626940 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86030aa7-b279-4cd4-81c7-d5284f45fbe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b8289fc2bb4ff29a76beb85def2822)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:52.628992 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86030aa7-b279-4cd4-81c7-d5284f45fbe8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:52.647795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0 admin admin] The token cache is being invalidate because project 239c6c8c35ab43c49a07d035b15002a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:52.648225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:52.649995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-2ef9ba84-a93c-4ef4-a2a0-fce4fac086b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:52.654668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1279/2562] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:52 2022] DELETE /identity/v3/projects/239c6c8c35ab43c49a07d035b15002a9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:52.656258 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b409d-4cbe-485c-8208-353852669278 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:52.656545 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b409d-4cbe-485c-8208-353852669278 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:52.656820 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b409d-4cbe-485c-8208-353852669278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:52.674965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-845b409d-4cbe-485c-8208-353852669278 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:52.676247 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-845b409d-4cbe-485c-8208-353852669278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:52.694956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1280/2563] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:11:52.703914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff2fb-9554-423d-af1e-6c891cb13511 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:52.704206 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff2fb-9554-423d-af1e-6c891cb13511 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:52.704489 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff2fb-9554-423d-af1e-6c891cb13511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:52.723707 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7e2ff2fb-9554-423d-af1e-6c891cb13511 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:52.725353 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7e2ff2fb-9554-423d-af1e-6c891cb13511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:52.738618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1281/2564] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:11:52.742662 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ff2fb-9554-423d-af1e-6c891cb13511 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:52.751853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ff2fb-9554-423d-af1e-6c891cb13511 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:52.756842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794031f-240a-42ae-bd4b-a0623cbc6293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:52.757508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794031f-240a-42ae-bd4b-a0623cbc6293 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:52.758464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794031f-240a-42ae-bd4b-a0623cbc6293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:52.758735 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794031f-240a-42ae-bd4b-a0623cbc6293 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:52.759460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794031f-240a-42ae-bd4b-a0623cbc6293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:11:52.759762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794031f-240a-42ae-bd4b-a0623cbc6293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:52.761370 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794031f-240a-42ae-bd4b-a0623cbc6293 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:52.774030 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1282/2565] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:11:52.778946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794031f-240a-42ae-bd4b-a0623cbc6293 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:52.788601 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794031f-240a-42ae-bd4b-a0623cbc6293 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:52.793832 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb3748-1864-4c53-a327-fc7c6db30389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:52.794490 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb3748-1864-4c53-a327-fc7c6db30389 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:52.794791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb3748-1864-4c53-a327-fc7c6db30389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:52.795056 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb3748-1864-4c53-a327-fc7c6db30389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:52.795845 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb3748-1864-4c53-a327-fc7c6db30389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:52.797792 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb3748-1864-4c53-a327-fc7c6db30389 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:52.834282 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86030aa7-b279-4cd4-81c7-d5284f45fbe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b8289fc2bb4ff29a76beb85def2822'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:52.842447 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86030aa7-b279-4cd4-81c7-d5284f45fbe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b8289fc2bb4ff29a76beb85def2822'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:52.911894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1283/2566] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:52 2022] POST /identity/v3/projects => generated 355 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:11:52.911894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb3748-1864-4c53-a327-fc7c6db30389 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:52.911894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dbdb3748-1864-4c53-a327-fc7c6db30389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:52.933824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86030aa7-b279-4cd4-81c7-d5284f45fbe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b8289fc2bb4ff29a76beb85def2822'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:52.934459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86030aa7-b279-4cd4-81c7-d5284f45fbe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b8289fc2bb4ff29a76beb85def2822'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:52.935082 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-86030aa7-b279-4cd4-81c7-d5284f45fbe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b8289fc2bb4ff29a76beb85def2822'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:52.953694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1284/2567] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:52 2022] DELETE /identity/v3/users/20b8289fc2bb4ff29a76beb85def2822 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:52.954505 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86030aa7-b279-4cd4-81c7-d5284f45fbe8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:52.955817 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-86030aa7-b279-4cd4-81c7-d5284f45fbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:52.970170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb3748-1864-4c53-a327-fc7c6db30389 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:53.018219 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f5bf6-c9bf-413e-a15d-280e2eabf0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:53.018873 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f5bf6-c9bf-413e-a15d-280e2eabf0cd service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:53.019161 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f5bf6-c9bf-413e-a15d-280e2eabf0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:53.019432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f5bf6-c9bf-413e-a15d-280e2eabf0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:53.021519 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c84f5bf6-c9bf-413e-a15d-280e2eabf0cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:53.021958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86030aa7-b279-4cd4-81c7-d5284f45fbe8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:53.028123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d9c8b-5d95-431e-bfdb-770b0d82ec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:53.031112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d9c8b-5d95-431e-bfdb-770b0d82ec55 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:53.031112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d9c8b-5d95-431e-bfdb-770b0d82ec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:53.031112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d9c8b-5d95-431e-bfdb-770b0d82ec55 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:53.031112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d9c8b-5d95-431e-bfdb-770b0d82ec55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:53.032054 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d9c8b-5d95-431e-bfdb-770b0d82ec55 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:53.032961 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f5bf6-c9bf-413e-a15d-280e2eabf0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:53.034439 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f5bf6-c9bf-413e-a15d-280e2eabf0cd service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:53.042457 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1284/2568] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:53.043693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e6e13-c27f-4059-bf02-24cb11c71e09 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:53.043986 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e6e13-c27f-4059-bf02-24cb11c71e09 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:53.044282 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e6e13-c27f-4059-bf02-24cb11c71e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:53.062552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-da6e6e13-c27f-4059-bf02-24cb11c71e09 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:53.063784 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-da6e6e13-c27f-4059-bf02-24cb11c71e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:53.073597 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1285/2569] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:53.083263 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e6e13-c27f-4059-bf02-24cb11c71e09 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:53.084589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-da6e6e13-c27f-4059-bf02-24cb11c71e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:53.096459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e6e13-c27f-4059-bf02-24cb11c71e09 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:53.101064 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246df51-dc97-4be0-92da-9737a0678037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:53.101767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246df51-dc97-4be0-92da-9737a0678037 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:53.102050 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246df51-dc97-4be0-92da-9737a0678037 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:53.102324 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246df51-dc97-4be0-92da-9737a0678037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:53.112315 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246df51-dc97-4be0-92da-9737a0678037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:53.117618 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246df51-dc97-4be0-92da-9737a0678037 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:53.123972 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1286/2570] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:11:53.152314 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1285/2571] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:52 2022] POST /identity/v3/users => generated 278 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:53.156405 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246df51-dc97-4be0-92da-9737a0678037 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:53.167037 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246df51-dc97-4be0-92da-9737a0678037 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:53.172773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973a8b9-ff6c-40c4-a108-0ccdc461b0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:53.173442 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973a8b9-ff6c-40c4-a108-0ccdc461b0ef admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:53.173765 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973a8b9-ff6c-40c4-a108-0ccdc461b0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:53.174044 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973a8b9-ff6c-40c4-a108-0ccdc461b0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:53.174795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973a8b9-ff6c-40c4-a108-0ccdc461b0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:53.176407 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973a8b9-ff6c-40c4-a108-0ccdc461b0ef admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:53.190127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1287/2572] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:53.192027 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d9c8b-5d95-431e-bfdb-770b0d82ec55 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:53.204596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d9c8b-5d95-431e-bfdb-770b0d82ec55 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:53.211108 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2119f3-b20a-4038-b79f-f27074ddab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:53.211853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2119f3-b20a-4038-b79f-f27074ddab6a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:53.212375 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2119f3-b20a-4038-b79f-f27074ddab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:53.212726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2119f3-b20a-4038-b79f-f27074ddab6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:53.213516 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2119f3-b20a-4038-b79f-f27074ddab6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:53.215376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2119f3-b20a-4038-b79f-f27074ddab6a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:53.226792 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1286/2573] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:53.230913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973a8b9-ff6c-40c4-a108-0ccdc461b0ef admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:53.244047 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973a8b9-ff6c-40c4-a108-0ccdc461b0ef admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:53.246367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c222-fb13-40e8-a3bc-c832d32cba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:53.247251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c222-fb13-40e8-a3bc-c832d32cba43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:53.247541 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c222-fb13-40e8-a3bc-c832d32cba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:53.247817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c222-fb13-40e8-a3bc-c832d32cba43 admin admin] PATH_INFO: `/v3/projects/a4459b0caabf464aa36ab3c0b81933ac/users/6866b57180324a5295b6bda5f4952b45/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:53.263033 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6c222-fb13-40e8-a3bc-c832d32cba43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4459b0caabf464aa36ab3c0b81933ac, user_id=6866b57180324a5295b6bda5f4952b45, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:53.265969 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6c222-fb13-40e8-a3bc-c832d32cba43 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:53.363471 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1288/2574] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:53 2022] PUT /identity/v3/projects/a4459b0caabf464aa36ab3c0b81933ac/users/6866b57180324a5295b6bda5f4952b45/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:53.375553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbb9f5-f2e0-4464-b9ae-75f1f9abb6fe None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:53.376095 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbb9f5-f2e0-4464-b9ae-75f1f9abb6fe None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:53.376725 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbb9f5-f2e0-4464-b9ae-75f1f9abb6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:53.406146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-83dbb9f5-f2e0-4464-b9ae-75f1f9abb6fe None None] MFA Rules not processed for user `6866b57180324a5295b6bda5f4952b45`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:53.407441 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-83dbb9f5-f2e0-4464-b9ae-75f1f9abb6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:53.482753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1287/2575] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:53.487533 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c222-fb13-40e8-a3bc-c832d32cba43 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:53.554125 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c222-fb13-40e8-a3bc-c832d32cba43 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:53.559365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8d430-fd47-4ecf-b511-f915a5d824c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:53.560031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d430-fd47-4ecf-b511-f915a5d824c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:53.561381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d430-fd47-4ecf-b511-f915a5d824c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:53.561381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d430-fd47-4ecf-b511-f915a5d824c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:53.561381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8d430-fd47-4ecf-b511-f915a5d824c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:53.563337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8d430-fd47-4ecf-b511-f915a5d824c0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:53.598452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbb9f5-f2e0-4464-b9ae-75f1f9abb6fe None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:53.599841 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-83dbb9f5-f2e0-4464-b9ae-75f1f9abb6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:53.614467 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbb9f5-f2e0-4464-b9ae-75f1f9abb6fe None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:53.619773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:53.620698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:53.620973 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:53.621250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] PATH_INFO: `/v3/projects/51bb9f314eae4efa92247d105429ab43` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:53.622468 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51bb9f314eae4efa92247d105429ab43)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:53.624379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:53.682860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1289/2576] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:53 2022] POST /identity/v3/projects => generated 355 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:11:53.686682 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8d430-fd47-4ecf-b511-f915a5d824c0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:53.746167 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8d430-fd47-4ecf-b511-f915a5d824c0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:53.752428 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683d462-4156-4df6-91c6-3816ce2264d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:53.753108 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683d462-4156-4df6-91c6-3816ce2264d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:53.753447 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683d462-4156-4df6-91c6-3816ce2264d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:53.753743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683d462-4156-4df6-91c6-3816ce2264d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:53.754410 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683d462-4156-4df6-91c6-3816ce2264d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:53.756356 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683d462-4156-4df6-91c6-3816ce2264d9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:53.763596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51bb9f314eae4efa92247d105429ab43', 'request_id': 'req-fe66d278-6b55-42ec-9e65-20205c494e27'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:53.769798 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51bb9f314eae4efa92247d105429ab43', 'request_id': 'req-fe66d278-6b55-42ec-9e65-20205c494e27'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:53.775773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51bb9f314eae4efa92247d105429ab43', 'request_id': 'req-fe66d278-6b55-42ec-9e65-20205c494e27'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:53.910787 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] The token cache is being invalidate because project 51bb9f314eae4efa92247d105429ab43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:53.911463 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:53.911663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1290/2577] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:53 2022] POST /identity/v3/users => generated 284 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:11:53.911771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:53.913424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1288/2578] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:53 2022] DELETE /identity/v3/projects/51bb9f314eae4efa92247d105429ab43 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:11:53.916015 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683d462-4156-4df6-91c6-3816ce2264d9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:53.917690 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1683d462-4156-4df6-91c6-3816ce2264d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:53.917813 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:53.919072 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:53.973411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683d462-4156-4df6-91c6-3816ce2264d9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:53.985191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66d278-6b55-42ec-9e65-20205c494e27 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:53.991302 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3e7dc-e5fe-4fbf-b1ec-a68d2f286c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:53.991976 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3e7dc-e5fe-4fbf-b1ec-a68d2f286c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:53.992299 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3e7dc-e5fe-4fbf-b1ec-a68d2f286c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:53.992665 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3e7dc-e5fe-4fbf-b1ec-a68d2f286c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:53.993398 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3e7dc-e5fe-4fbf-b1ec-a68d2f286c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:53.995263 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3e7dc-e5fe-4fbf-b1ec-a68d2f286c06 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:54.005313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1289/2579] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:54.006674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3e7dc-e5fe-4fbf-b1ec-a68d2f286c06 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:54.008158 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-82d3e7dc-e5fe-4fbf-b1ec-a68d2f286c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:54.020621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3e7dc-e5fe-4fbf-b1ec-a68d2f286c06 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:54.024736 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df903fb-5cf7-456f-a642-993b58ef1e9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:54.025443 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df903fb-5cf7-456f-a642-993b58ef1e9f service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:54.025737 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14caa043-31c7-4a3e-85f7-c7f72c8f219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:54.025855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df903fb-5cf7-456f-a642-993b58ef1e9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:54.026014 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df903fb-5cf7-456f-a642-993b58ef1e9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:54.026849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14caa043-31c7-4a3e-85f7-c7f72c8f219e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:54.027130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14caa043-31c7-4a3e-85f7-c7f72c8f219e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:54.027407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14caa043-31c7-4a3e-85f7-c7f72c8f219e admin admin] PATH_INFO: `/v3/users/5e9b5baead284056aa7f3b0939d2b993` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:54.028297 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2df903fb-5cf7-456f-a642-993b58ef1e9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:54.028569 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14caa043-31c7-4a3e-85f7-c7f72c8f219e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9b5baead284056aa7f3b0939d2b993)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:54.030512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14caa043-31c7-4a3e-85f7-c7f72c8f219e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:54.090781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df903fb-5cf7-456f-a642-993b58ef1e9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:54.092546 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df903fb-5cf7-456f-a642-993b58ef1e9f service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:54.102766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1291/2580] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:53 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:54.103536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df903fb-5cf7-456f-a642-993b58ef1e9f service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:54.112926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df903fb-5cf7-456f-a642-993b58ef1e9f service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:54.117606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a4a68-bb59-422e-938e-6770ee92597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:54.118473 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4a68-bb59-422e-938e-6770ee92597a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:54.118758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4a68-bb59-422e-938e-6770ee92597a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:54.119048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4a68-bb59-422e-938e-6770ee92597a admin admin] PATH_INFO: `/v3/projects/961952b7f79849bab9bb3c9f989f4d84/users/ccf6b327618e4318bb8e366131aec4cb/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:54.134156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a4a68-bb59-422e-938e-6770ee92597a admin admin] RBAC: Authorizing `identity:create_grant(project_id=961952b7f79849bab9bb3c9f989f4d84, user_id=ccf6b327618e4318bb8e366131aec4cb, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:54.136955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a4a68-bb59-422e-938e-6770ee92597a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:54.285363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1292/2581] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:54 2022] PUT /identity/v3/projects/961952b7f79849bab9bb3c9f989f4d84/users/ccf6b327618e4318bb8e366131aec4cb/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:54.288283 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a4a68-bb59-422e-938e-6770ee92597a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:54.291642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14caa043-31c7-4a3e-85f7-c7f72c8f219e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9b5baead284056aa7f3b0939d2b993'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:54.299372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14caa043-31c7-4a3e-85f7-c7f72c8f219e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9b5baead284056aa7f3b0939d2b993'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:54.351131 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a4a68-bb59-422e-938e-6770ee92597a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:54.356002 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96d7df-b54f-4cbd-b52f-76253470e0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:54.356670 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d7df-b54f-4cbd-b52f-76253470e0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:54.356960 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d7df-b54f-4cbd-b52f-76253470e0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:54.357243 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d7df-b54f-4cbd-b52f-76253470e0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:54.358049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96d7df-b54f-4cbd-b52f-76253470e0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:54.359673 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96d7df-b54f-4cbd-b52f-76253470e0c1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:54.374212 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1293/2582] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:11:54.378267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96d7df-b54f-4cbd-b52f-76253470e0c1 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:54.388418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96d7df-b54f-4cbd-b52f-76253470e0c1 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:54.390895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14caa043-31c7-4a3e-85f7-c7f72c8f219e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9b5baead284056aa7f3b0939d2b993'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:54.391511 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14caa043-31c7-4a3e-85f7-c7f72c8f219e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9b5baead284056aa7f3b0939d2b993'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:54.392120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14caa043-31c7-4a3e-85f7-c7f72c8f219e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9b5baead284056aa7f3b0939d2b993'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:54.393446 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b253771-2c3a-4243-a74a-62e8c9948ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:54.394427 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b253771-2c3a-4243-a74a-62e8c9948ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:54.394716 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b253771-2c3a-4243-a74a-62e8c9948ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:54.394998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b253771-2c3a-4243-a74a-62e8c9948ed7 admin admin] PATH_INFO: `/v3/projects/961952b7f79849bab9bb3c9f989f4d84/users/ccf6b327618e4318bb8e366131aec4cb/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:54.397045 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b253771-2c3a-4243-a74a-62e8c9948ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=961952b7f79849bab9bb3c9f989f4d84, user_id=ccf6b327618e4318bb8e366131aec4cb, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:54.400409 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b253771-2c3a-4243-a74a-62e8c9948ed7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:54.410576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1290/2583] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:11:54 2022] DELETE /identity/v3/users/5e9b5baead284056aa7f3b0939d2b993 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:54.411081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1294/2584] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:54 2022] PUT /identity/v3/projects/961952b7f79849bab9bb3c9f989f4d84/users/ccf6b327618e4318bb8e366131aec4cb/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:11:54.423086 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b0b0d-b918-485f-b020-2e40129f5594 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:54.423449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b0b0d-b918-485f-b020-2e40129f5594 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:54.423735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b0b0d-b918-485f-b020-2e40129f5594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:54.451121 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ca3b0b0d-b918-485f-b020-2e40129f5594 None None] MFA Rules not processed for user `ccf6b327618e4318bb8e366131aec4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:54.452602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ca3b0b0d-b918-485f-b020-2e40129f5594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:54.523019 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1291/2585] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:11:54.534793 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b253771-2c3a-4243-a74a-62e8c9948ed7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:54.536751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1b253771-2c3a-4243-a74a-62e8c9948ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:54.594644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b253771-2c3a-4243-a74a-62e8c9948ed7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:54.661564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0b482-267b-4e95-b462-20afa09c9b38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:54.661564 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0b482-267b-4e95-b462-20afa09c9b38 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:54.663067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0b482-267b-4e95-b462-20afa09c9b38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:54.663067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0b482-267b-4e95-b462-20afa09c9b38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:54.675176 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0b482-267b-4e95-b462-20afa09c9b38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:54.676633 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0b482-267b-4e95-b462-20afa09c9b38 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:54.689990 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1295/2586] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:54 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:11:54.889796 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b0b0d-b918-485f-b020-2e40129f5594 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:54.892242 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ca3b0b0d-b918-485f-b020-2e40129f5594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:54.898019 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0b482-267b-4e95-b462-20afa09c9b38 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:54.907175 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0b482-267b-4e95-b462-20afa09c9b38 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:54.910953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4810e2-f7d1-43c9-a785-7eaa81cb0618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:54.911599 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4810e2-f7d1-43c9-a785-7eaa81cb0618 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:54.911885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4810e2-f7d1-43c9-a785-7eaa81cb0618 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:54.912163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4810e2-f7d1-43c9-a785-7eaa81cb0618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:54.914076 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1d4810e2-f7d1-43c9-a785-7eaa81cb0618 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:54.964163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b0b0d-b918-485f-b020-2e40129f5594 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:54.969233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca05c77-aa11-471b-bb23-5f3085cb2b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:54.970129 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca05c77-aa11-471b-bb23-5f3085cb2b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:54.970411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca05c77-aa11-471b-bb23-5f3085cb2b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:54.970687 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca05c77-aa11-471b-bb23-5f3085cb2b54 admin admin] PATH_INFO: `/v3/projects/999b979bff2c442c8ff51f713a9a026b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:54.971879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca05c77-aa11-471b-bb23-5f3085cb2b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=999b979bff2c442c8ff51f713a9a026b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:54.973836 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca05c77-aa11-471b-bb23-5f3085cb2b54 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:54.977599 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4810e2-f7d1-43c9-a785-7eaa81cb0618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:54.979133 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4810e2-f7d1-43c9-a785-7eaa81cb0618 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:54.988922 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1296/2587] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:54 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:11:55.145453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0ca05c77-aa11-471b-bb23-5f3085cb2b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '999b979bff2c442c8ff51f713a9a026b', 'request_id': 'req-0ca05c77-aa11-471b-bb23-5f3085cb2b54'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:55.152480 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0ca05c77-aa11-471b-bb23-5f3085cb2b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '999b979bff2c442c8ff51f713a9a026b', 'request_id': 'req-0ca05c77-aa11-471b-bb23-5f3085cb2b54'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:55.159333 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0ca05c77-aa11-471b-bb23-5f3085cb2b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '999b979bff2c442c8ff51f713a9a026b', 'request_id': 'req-0ca05c77-aa11-471b-bb23-5f3085cb2b54'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:55.292682 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0ca05c77-aa11-471b-bb23-5f3085cb2b54 admin admin] The token cache is being invalidate because project 999b979bff2c442c8ff51f713a9a026b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:11:55.292967 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0ca05c77-aa11-471b-bb23-5f3085cb2b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:55.293608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0ca05c77-aa11-471b-bb23-5f3085cb2b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:11:55.295140 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1292/2588] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:11:54 2022] DELETE /identity/v3/projects/999b979bff2c442c8ff51f713a9a026b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:55.300103 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e263b1-d189-441b-81b0-6a24056607bb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:55.300392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e263b1-d189-441b-81b0-6a24056607bb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:55.300671 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e263b1-d189-441b-81b0-6a24056607bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:55.317694 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-96e263b1-d189-441b-81b0-6a24056607bb None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:55.318881 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-96e263b1-d189-441b-81b0-6a24056607bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:55.377313 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1297/2589] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:55.385597 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6646-1afd-41af-a922-d542aba43cf7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:55.385890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6646-1afd-41af-a922-d542aba43cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:55.386196 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6646-1afd-41af-a922-d542aba43cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:55.404859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a47b6646-1afd-41af-a922-d542aba43cf7 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:55.406098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a47b6646-1afd-41af-a922-d542aba43cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:55.414115 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1293/2590] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:55.418829 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e263b1-d189-441b-81b0-6a24056607bb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:55.428552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e263b1-d189-441b-81b0-6a24056607bb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:55.433224 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d37ee-1fbf-4d95-82fd-962947b291df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:55.433931 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d37ee-1fbf-4d95-82fd-962947b291df admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:55.434214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d37ee-1fbf-4d95-82fd-962947b291df admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:55.434485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d37ee-1fbf-4d95-82fd-962947b291df admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:55.435209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d37ee-1fbf-4d95-82fd-962947b291df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:11:55.435516 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d37ee-1fbf-4d95-82fd-962947b291df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:55.437123 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d37ee-1fbf-4d95-82fd-962947b291df admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:55.448807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1298/2591] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:11:55.453269 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b6646-1afd-41af-a922-d542aba43cf7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:55.463695 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b6646-1afd-41af-a922-d542aba43cf7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:55.469103 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f2d8e-5d22-4c7d-a5ed-cd2c25e732bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:55.469943 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f2d8e-5d22-4c7d-a5ed-cd2c25e732bc admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:55.470264 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f2d8e-5d22-4c7d-a5ed-cd2c25e732bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:55.470477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f2d8e-5d22-4c7d-a5ed-cd2c25e732bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:55.471570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f2d8e-5d22-4c7d-a5ed-cd2c25e732bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:55.473427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f2d8e-5d22-4c7d-a5ed-cd2c25e732bc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:55.576102 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1294/2592] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:55 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:11:55.580278 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d37ee-1fbf-4d95-82fd-962947b291df admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:55.590831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d37ee-1fbf-4d95-82fd-962947b291df admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:55.647565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c421d-16b2-4141-bf82-ca3521d2490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:55.648294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c421d-16b2-4141-bf82-ca3521d2490d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:55.648577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c421d-16b2-4141-bf82-ca3521d2490d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:55.648852 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c421d-16b2-4141-bf82-ca3521d2490d admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:55.650139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c421d-16b2-4141-bf82-ca3521d2490d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:55.652320 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c421d-16b2-4141-bf82-ca3521d2490d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:55.778427 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1299/2593] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:55 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:55.779521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f2d8e-5d22-4c7d-a5ed-cd2c25e732bc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:55.790950 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f2d8e-5d22-4c7d-a5ed-cd2c25e732bc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:55.796203 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b1da-b875-43d2-af99-f8112dcd89ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:55.796866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b1da-b875-43d2-af99-f8112dcd89ac admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:55.797146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b1da-b875-43d2-af99-f8112dcd89ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:55.797420 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b1da-b875-43d2-af99-f8112dcd89ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:55.798168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3b1da-b875-43d2-af99-f8112dcd89ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:55.799802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3b1da-b875-43d2-af99-f8112dcd89ac admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:55.810214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1295/2594] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:11:55.814197 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c421d-16b2-4141-bf82-ca3521d2490d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:55.825111 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c421d-16b2-4141-bf82-ca3521d2490d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:55.829950 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3518e3-f11f-4dde-91cd-28b8665e0583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:55.830617 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3518e3-f11f-4dde-91cd-28b8665e0583 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:55.830905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3518e3-f11f-4dde-91cd-28b8665e0583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:55.831186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3518e3-f11f-4dde-91cd-28b8665e0583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:55.831916 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3518e3-f11f-4dde-91cd-28b8665e0583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:55.834494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3518e3-f11f-4dde-91cd-28b8665e0583 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:55.845565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1300/2595] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:55.849706 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b1da-b875-43d2-af99-f8112dcd89ac admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:55.859676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b1da-b875-43d2-af99-f8112dcd89ac admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:55.864171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09073b13-5896-4538-a07d-240a740ef1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:55.865000 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09073b13-5896-4538-a07d-240a740ef1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:55.865276 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09073b13-5896-4538-a07d-240a740ef1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:55.865566 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09073b13-5896-4538-a07d-240a740ef1f7 admin admin] PATH_INFO: `/v3/projects/c5413dc386464c9bb2fa7c8beb0df572/users/fb23f142c441469cb8173959e0f3f4d5/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:55.879496 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09073b13-5896-4538-a07d-240a740ef1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5413dc386464c9bb2fa7c8beb0df572, user_id=fb23f142c441469cb8173959e0f3f4d5, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:55.882234 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09073b13-5896-4538-a07d-240a740ef1f7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:55.979972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1296/2596] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:55 2022] PUT /identity/v3/projects/c5413dc386464c9bb2fa7c8beb0df572/users/fb23f142c441469cb8173959e0f3f4d5/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:55.991072 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db5a97-14ae-40c6-9b83-5a57685b08ae None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:55.991513 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db5a97-14ae-40c6-9b83-5a57685b08ae None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:55.991894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db5a97-14ae-40c6-9b83-5a57685b08ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:56.031814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-99db5a97-14ae-40c6-9b83-5a57685b08ae None None] MFA Rules not processed for user `fb23f142c441469cb8173959e0f3f4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:56.034533 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-99db5a97-14ae-40c6-9b83-5a57685b08ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:56.099453 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1301/2597] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:56.103998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09073b13-5896-4538-a07d-240a740ef1f7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:56.166040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09073b13-5896-4538-a07d-240a740ef1f7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:56.172982 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53715567-e6ce-46bd-a6ce-2b08e6228e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:56.173693 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53715567-e6ce-46bd-a6ce-2b08e6228e2a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:56.174893 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53715567-e6ce-46bd-a6ce-2b08e6228e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:56.174893 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53715567-e6ce-46bd-a6ce-2b08e6228e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:56.175073 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53715567-e6ce-46bd-a6ce-2b08e6228e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:56.176825 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53715567-e6ce-46bd-a6ce-2b08e6228e2a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:56.268356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1297/2598] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:11:56 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:11:56.272381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db5a97-14ae-40c6-9b83-5a57685b08ae None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:56.283189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db5a97-14ae-40c6-9b83-5a57685b08ae None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:56.356163 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045af6c2-56b0-4ada-8ba0-bcf5aba93cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:56.356919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045af6c2-56b0-4ada-8ba0-bcf5aba93cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:56.357202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045af6c2-56b0-4ada-8ba0-bcf5aba93cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:56.357506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045af6c2-56b0-4ada-8ba0-bcf5aba93cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:56.358287 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045af6c2-56b0-4ada-8ba0-bcf5aba93cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:56.360371 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045af6c2-56b0-4ada-8ba0-bcf5aba93cb7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:56.466415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1302/2599] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:11:56 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:11:56.470180 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53715567-e6ce-46bd-a6ce-2b08e6228e2a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:56.480676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53715567-e6ce-46bd-a6ce-2b08e6228e2a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:56.485282 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35105ed-f7e9-4f35-95c3-242307359c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:56.485973 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35105ed-f7e9-4f35-95c3-242307359c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:56.486261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35105ed-f7e9-4f35-95c3-242307359c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:56.486538 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35105ed-f7e9-4f35-95c3-242307359c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:56.487292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35105ed-f7e9-4f35-95c3-242307359c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:56.488891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35105ed-f7e9-4f35-95c3-242307359c59 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:56.503023 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1298/2600] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:56.507041 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045af6c2-56b0-4ada-8ba0-bcf5aba93cb7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:56.517281 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045af6c2-56b0-4ada-8ba0-bcf5aba93cb7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:56.522904 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1431e2d-e97c-43bb-829f-3528dc7c317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:56.523800 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1431e2d-e97c-43bb-829f-3528dc7c317a admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:56.524084 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1431e2d-e97c-43bb-829f-3528dc7c317a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:56.524390 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1431e2d-e97c-43bb-829f-3528dc7c317a admin admin] PATH_INFO: `/v3/projects/38254b7c014549b8baa6ca91a1f8aa9a/users/2368601407b244b4986faf330e1bda34/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:56.542527 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1431e2d-e97c-43bb-829f-3528dc7c317a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38254b7c014549b8baa6ca91a1f8aa9a, user_id=2368601407b244b4986faf330e1bda34, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:56.545391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1431e2d-e97c-43bb-829f-3528dc7c317a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:56.667093 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1303/2601] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:56 2022] PUT /identity/v3/projects/38254b7c014549b8baa6ca91a1f8aa9a/users/2368601407b244b4986faf330e1bda34/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:56.671141 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35105ed-f7e9-4f35-95c3-242307359c59 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:56.681494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35105ed-f7e9-4f35-95c3-242307359c59 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:56.745278 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8936763-394a-48e2-b80b-bc072cd84bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:56.746065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8936763-394a-48e2-b80b-bc072cd84bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:56.746726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8936763-394a-48e2-b80b-bc072cd84bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:56.746726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8936763-394a-48e2-b80b-bc072cd84bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:56.747644 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8936763-394a-48e2-b80b-bc072cd84bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:56.749235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8936763-394a-48e2-b80b-bc072cd84bfa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:56.762600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1299/2602] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:11:56.763780 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1431e2d-e97c-43bb-829f-3528dc7c317a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:56.774204 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1431e2d-e97c-43bb-829f-3528dc7c317a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:56.779736 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21c0e2-cdf1-4717-869d-8d4e36491090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:56.780622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c0e2-cdf1-4717-869d-8d4e36491090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:56.780908 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c0e2-cdf1-4717-869d-8d4e36491090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:56.781182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c0e2-cdf1-4717-869d-8d4e36491090 admin admin] PATH_INFO: `/v3/projects/38254b7c014549b8baa6ca91a1f8aa9a/users/2368601407b244b4986faf330e1bda34/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:56.783210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21c0e2-cdf1-4717-869d-8d4e36491090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38254b7c014549b8baa6ca91a1f8aa9a, user_id=2368601407b244b4986faf330e1bda34, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:56.785903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21c0e2-cdf1-4717-869d-8d4e36491090 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:56.797408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1304/2603] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:11:56 2022] PUT /identity/v3/projects/38254b7c014549b8baa6ca91a1f8aa9a/users/2368601407b244b4986faf330e1bda34/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:11:56.808011 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b99806-afab-497e-a8d1-048a3cab7d5c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:56.808361 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b99806-afab-497e-a8d1-048a3cab7d5c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:56.808650 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b99806-afab-497e-a8d1-048a3cab7d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:56.835769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c8b99806-afab-497e-a8d1-048a3cab7d5c None None] MFA Rules not processed for user `2368601407b244b4986faf330e1bda34`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:11:56.837513 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c8b99806-afab-497e-a8d1-048a3cab7d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:56.937187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1300/2604] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:11:56.948631 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21c0e2-cdf1-4717-869d-8d4e36491090 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:11:56.950552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fa21c0e2-cdf1-4717-869d-8d4e36491090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:11:57.007896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21c0e2-cdf1-4717-869d-8d4e36491090 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:11:57.011575 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196daf20-1019-4b9d-96eb-6f2bbf34055b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:11:57.012231 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196daf20-1019-4b9d-96eb-6f2bbf34055b service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:11:57.012520 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196daf20-1019-4b9d-96eb-6f2bbf34055b service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:11:57.012819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196daf20-1019-4b9d-96eb-6f2bbf34055b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:11:57.070111 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196daf20-1019-4b9d-96eb-6f2bbf34055b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:11:57.072127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196daf20-1019-4b9d-96eb-6f2bbf34055b service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:11:57.081415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1305/2605] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:11:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:12:03.734322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b99806-afab-497e-a8d1-048a3cab7d5c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:03.744599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b99806-afab-497e-a8d1-048a3cab7d5c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:03.753430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e3cb3-249b-4c53-8607-7936a4981cf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:03.753430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3cb3-249b-4c53-8607-7936a4981cf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:03.753430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3cb3-249b-4c53-8607-7936a4981cf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:03.753430 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e3cb3-249b-4c53-8607-7936a4981cf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:03.758281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e3cb3-249b-4c53-8607-7936a4981cf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:03.760455 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e3cb3-249b-4c53-8607-7936a4981cf6 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:03.770027 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1301/2606] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:12:19.187058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196daf20-1019-4b9d-96eb-6f2bbf34055b service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:19.188630 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-196daf20-1019-4b9d-96eb-6f2bbf34055b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:19.254781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196daf20-1019-4b9d-96eb-6f2bbf34055b service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:19.259589 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f79316-8fee-4a83-ba79-6bd883b453b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:19.260469 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f79316-8fee-4a83-ba79-6bd883b453b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:19.260750 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f79316-8fee-4a83-ba79-6bd883b453b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:19.261022 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f79316-8fee-4a83-ba79-6bd883b453b8 admin admin] PATH_INFO: `/v3/users/4899c8aa713e45a39205a30d10c589a9` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:19.262303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f79316-8fee-4a83-ba79-6bd883b453b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4899c8aa713e45a39205a30d10c589a9)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:19.264849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f79316-8fee-4a83-ba79-6bd883b453b8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:19.448462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-36f79316-8fee-4a83-ba79-6bd883b453b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4899c8aa713e45a39205a30d10c589a9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:19.526499 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-36f79316-8fee-4a83-ba79-6bd883b453b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4899c8aa713e45a39205a30d10c589a9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:19.533955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-36f79316-8fee-4a83-ba79-6bd883b453b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4899c8aa713e45a39205a30d10c589a9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:19.535675 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-36f79316-8fee-4a83-ba79-6bd883b453b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4899c8aa713e45a39205a30d10c589a9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:19.535675 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-36f79316-8fee-4a83-ba79-6bd883b453b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4899c8aa713e45a39205a30d10c589a9'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:19.555493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1306/2607] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:19 2022] DELETE /identity/v3/users/4899c8aa713e45a39205a30d10c589a9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:19.803187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e3cb3-249b-4c53-8607-7936a4981cf6 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:19.815029 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e3cb3-249b-4c53-8607-7936a4981cf6 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:19.871202 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:19.872096 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:19.872380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:19.872661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] PATH_INFO: `/v3/projects/ec3e98a71a8740f1a93a1e12b8ab7b12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:19.873853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec3e98a71a8740f1a93a1e12b8ab7b12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:19.875783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:19.974193 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3e98a71a8740f1a93a1e12b8ab7b12', 'request_id': 'req-bb98078d-2dc6-45aa-a661-c68bbb928f59'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:19.980276 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3e98a71a8740f1a93a1e12b8ab7b12', 'request_id': 'req-bb98078d-2dc6-45aa-a661-c68bbb928f59'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:19.986067 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3e98a71a8740f1a93a1e12b8ab7b12', 'request_id': 'req-bb98078d-2dc6-45aa-a661-c68bbb928f59'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:20.041534 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] The token cache is being invalidate because project ec3e98a71a8740f1a93a1e12b8ab7b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:20.041854 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:20.042461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:20.044669 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1302/2608] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:19 2022] DELETE /identity/v3/projects/ec3e98a71a8740f1a93a1e12b8ab7b12 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:20.051538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f79316-8fee-4a83-ba79-6bd883b453b8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:20.053005 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-36f79316-8fee-4a83-ba79-6bd883b453b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:20.066008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f79316-8fee-4a83-ba79-6bd883b453b8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:20.120271 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa307bd-9bbc-4e29-abcd-8190eda80c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:20.121134 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa307bd-9bbc-4e29-abcd-8190eda80c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:20.121414 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa307bd-9bbc-4e29-abcd-8190eda80c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:20.121728 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa307bd-9bbc-4e29-abcd-8190eda80c58 admin admin] PATH_INFO: `/v3/users/afe96c9fb8534fff8afb79afea5251ed` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:20.122932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa307bd-9bbc-4e29-abcd-8190eda80c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe96c9fb8534fff8afb79afea5251ed)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:20.124860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa307bd-9bbc-4e29-abcd-8190eda80c58 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:20.279543 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9aa307bd-9bbc-4e29-abcd-8190eda80c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe96c9fb8534fff8afb79afea5251ed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:20.357709 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9aa307bd-9bbc-4e29-abcd-8190eda80c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe96c9fb8534fff8afb79afea5251ed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:20.366656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9aa307bd-9bbc-4e29-abcd-8190eda80c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe96c9fb8534fff8afb79afea5251ed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:20.367495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9aa307bd-9bbc-4e29-abcd-8190eda80c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe96c9fb8534fff8afb79afea5251ed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:20.371058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9aa307bd-9bbc-4e29-abcd-8190eda80c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe96c9fb8534fff8afb79afea5251ed'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:20.388909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1307/2609] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:20 2022] DELETE /identity/v3/users/afe96c9fb8534fff8afb79afea5251ed => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:20.637916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:20.639398 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:20.652998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98078d-2dc6-45aa-a661-c68bbb928f59 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:20.707837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:20.708726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:20.709007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:20.709284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e admin admin] PATH_INFO: `/v3/projects/2dddb9690f5b400d82f198697fc187e0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:20.710514 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dddb9690f5b400d82f198697fc187e0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:20.712427 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:20.840167 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dddb9690f5b400d82f198697fc187e0', 'request_id': 'req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:20.846821 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dddb9690f5b400d82f198697fc187e0', 'request_id': 'req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:20.852269 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dddb9690f5b400d82f198697fc187e0', 'request_id': 'req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:20.937797 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e admin admin] The token cache is being invalidate because project 2dddb9690f5b400d82f198697fc187e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:20.938029 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:20.938617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c03ce8db-eb5d-46f5-b1e5-0335b1f2178e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:20.940140 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1303/2610] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:20 2022] DELETE /identity/v3/projects/2dddb9690f5b400d82f198697fc187e0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:20.945066 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5d35-e47f-463d-8f50-0bdaf2c7f5d2 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:20.947087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5d35-e47f-463d-8f50-0bdaf2c7f5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:20.947087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5d35-e47f-463d-8f50-0bdaf2c7f5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:20.963997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8b7d5d35-e47f-463d-8f50-0bdaf2c7f5d2 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:20.965216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8b7d5d35-e47f-463d-8f50-0bdaf2c7f5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:21.021245 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1308/2611] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:21.083312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd688889-cb5e-486c-bdc2-b21d104723c4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:21.083600 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd688889-cb5e-486c-bdc2-b21d104723c4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:21.083879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd688889-cb5e-486c-bdc2-b21d104723c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:21.103580 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fd688889-cb5e-486c-bdc2-b21d104723c4 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:21.104800 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fd688889-cb5e-486c-bdc2-b21d104723c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:21.113266 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1304/2612] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:21.117536 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d5d35-e47f-463d-8f50-0bdaf2c7f5d2 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:21.127242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d5d35-e47f-463d-8f50-0bdaf2c7f5d2 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:21.131857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d30374-2114-4193-b5dc-6969e6f1a3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:21.132507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d30374-2114-4193-b5dc-6969e6f1a3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:21.132796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d30374-2114-4193-b5dc-6969e6f1a3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:21.133079 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d30374-2114-4193-b5dc-6969e6f1a3d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:21.133843 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d30374-2114-4193-b5dc-6969e6f1a3d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:12:21.134158 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d30374-2114-4193-b5dc-6969e6f1a3d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:21.135766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d30374-2114-4193-b5dc-6969e6f1a3d5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:21.147622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1309/2613] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:12:21.151973 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd688889-cb5e-486c-bdc2-b21d104723c4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:21.161601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd688889-cb5e-486c-bdc2-b21d104723c4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:21.166326 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c311c65-cdac-48d9-b0cc-1ea862abbdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:21.167008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311c65-cdac-48d9-b0cc-1ea862abbdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:21.167294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311c65-cdac-48d9-b0cc-1ea862abbdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:21.167573 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c311c65-cdac-48d9-b0cc-1ea862abbdb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:21.168259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c311c65-cdac-48d9-b0cc-1ea862abbdb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:21.170310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c311c65-cdac-48d9-b0cc-1ea862abbdb2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:21.280716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1305/2614] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:12:21 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:21.286217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d30374-2114-4193-b5dc-6969e6f1a3d5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:21.296189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d30374-2114-4193-b5dc-6969e6f1a3d5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:21.359280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f46ee9-bc0a-415a-b127-7cbb436fe07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:21.360135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f46ee9-bc0a-415a-b127-7cbb436fe07d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:21.360242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f46ee9-bc0a-415a-b127-7cbb436fe07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:21.360495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f46ee9-bc0a-415a-b127-7cbb436fe07d admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:21.361187 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f46ee9-bc0a-415a-b127-7cbb436fe07d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:21.363120 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f46ee9-bc0a-415a-b127-7cbb436fe07d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:21.437753 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1310/2615] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:12:21 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:21.441841 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c311c65-cdac-48d9-b0cc-1ea862abbdb2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:21.452560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c311c65-cdac-48d9-b0cc-1ea862abbdb2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:21.457239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dadd5-da5e-4682-9988-78920bc962aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:21.457950 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dadd5-da5e-4682-9988-78920bc962aa admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:21.458216 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dadd5-da5e-4682-9988-78920bc962aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:21.458514 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dadd5-da5e-4682-9988-78920bc962aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:21.459259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dadd5-da5e-4682-9988-78920bc962aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:21.460853 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dadd5-da5e-4682-9988-78920bc962aa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:21.477235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1306/2616] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:21.478508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f46ee9-bc0a-415a-b127-7cbb436fe07d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:21.489350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f46ee9-bc0a-415a-b127-7cbb436fe07d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:21.495942 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ab12b-53cd-48b9-bc05-716c643208a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:21.495942 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ab12b-53cd-48b9-bc05-716c643208a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:21.495942 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ab12b-53cd-48b9-bc05-716c643208a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:21.495942 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ab12b-53cd-48b9-bc05-716c643208a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:21.496341 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ab12b-53cd-48b9-bc05-716c643208a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:21.498483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ab12b-53cd-48b9-bc05-716c643208a5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:21.513340 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1311/2617] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:21.514639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dadd5-da5e-4682-9988-78920bc962aa admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:21.524553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dadd5-da5e-4682-9988-78920bc962aa admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:21.529649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849808b-6ea4-4000-90ff-0e99a07cfe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:21.530524 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849808b-6ea4-4000-90ff-0e99a07cfe75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:21.530805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849808b-6ea4-4000-90ff-0e99a07cfe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:21.531111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849808b-6ea4-4000-90ff-0e99a07cfe75 admin admin] PATH_INFO: `/v3/projects/211a01573ad94f9c87a27d906f37d066/users/7f03e7d46d6d4e6dae2e04fdca0c5e42/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:21.545843 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849808b-6ea4-4000-90ff-0e99a07cfe75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=211a01573ad94f9c87a27d906f37d066, user_id=7f03e7d46d6d4e6dae2e04fdca0c5e42, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:21.548490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849808b-6ea4-4000-90ff-0e99a07cfe75 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:21.642070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1307/2618] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:21 2022] PUT /identity/v3/projects/211a01573ad94f9c87a27d906f37d066/users/7f03e7d46d6d4e6dae2e04fdca0c5e42/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:21.654811 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906a9c1-2e43-4a70-b6cd-ba8b72812d24 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:21.655103 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906a9c1-2e43-4a70-b6cd-ba8b72812d24 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:21.655386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906a9c1-2e43-4a70-b6cd-ba8b72812d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:21.682557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9906a9c1-2e43-4a70-b6cd-ba8b72812d24 None None] MFA Rules not processed for user `7f03e7d46d6d4e6dae2e04fdca0c5e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:21.683788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9906a9c1-2e43-4a70-b6cd-ba8b72812d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:21.746840 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1312/2619] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:21.752771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849808b-6ea4-4000-90ff-0e99a07cfe75 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:21.811967 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849808b-6ea4-4000-90ff-0e99a07cfe75 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:21.816541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1f00b-bf48-4376-abd4-367d3f1aab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:21.817186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1f00b-bf48-4376-abd4-367d3f1aab3a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:21.817468 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1f00b-bf48-4376-abd4-367d3f1aab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:21.817775 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1f00b-bf48-4376-abd4-367d3f1aab3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:21.818461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1f00b-bf48-4376-abd4-367d3f1aab3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:21.820373 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1f00b-bf48-4376-abd4-367d3f1aab3a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:21.889263 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1308/2620] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:12:21 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:21.893557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906a9c1-2e43-4a70-b6cd-ba8b72812d24 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:21.904235 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906a9c1-2e43-4a70-b6cd-ba8b72812d24 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:21.962557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b74cc-a5bc-4ea1-8a66-952c8237f2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:21.963248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b74cc-a5bc-4ea1-8a66-952c8237f2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:21.963526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b74cc-a5bc-4ea1-8a66-952c8237f2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:21.963804 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b74cc-a5bc-4ea1-8a66-952c8237f2b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:21.964503 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b74cc-a5bc-4ea1-8a66-952c8237f2b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:21.966527 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b74cc-a5bc-4ea1-8a66-952c8237f2b8 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:22.040697 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1313/2621] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:12:21 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:22.045135 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1f00b-bf48-4376-abd4-367d3f1aab3a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:22.055112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1f00b-bf48-4376-abd4-367d3f1aab3a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:22.060357 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62524dc8-e6ed-4a01-968b-97802dd99052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:22.061085 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62524dc8-e6ed-4a01-968b-97802dd99052 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:22.061349 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62524dc8-e6ed-4a01-968b-97802dd99052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:22.061657 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62524dc8-e6ed-4a01-968b-97802dd99052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:22.062385 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62524dc8-e6ed-4a01-968b-97802dd99052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:22.064018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62524dc8-e6ed-4a01-968b-97802dd99052 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:22.075507 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1309/2622] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:22.079711 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b74cc-a5bc-4ea1-8a66-952c8237f2b8 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:22.089308 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b74cc-a5bc-4ea1-8a66-952c8237f2b8 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:22.094454 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09e357-435c-4d77-9311-22bc69103ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:22.095097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09e357-435c-4d77-9311-22bc69103ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:22.095378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09e357-435c-4d77-9311-22bc69103ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:22.095653 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09e357-435c-4d77-9311-22bc69103ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:22.096505 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09e357-435c-4d77-9311-22bc69103ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:22.098212 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09e357-435c-4d77-9311-22bc69103ea1 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:22.108547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1314/2623] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:22.112424 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62524dc8-e6ed-4a01-968b-97802dd99052 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:22.122245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62524dc8-e6ed-4a01-968b-97802dd99052 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:22.127431 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711907d-1231-4533-a963-1cfd7e855106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:22.128496 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711907d-1231-4533-a963-1cfd7e855106 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:22.128878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711907d-1231-4533-a963-1cfd7e855106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:22.129317 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711907d-1231-4533-a963-1cfd7e855106 admin admin] PATH_INFO: `/v3/projects/fd2f53c2d31a4f57a17fa763868c1c1a/users/624787dc0bec4c029b7300885747c4df/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:22.144928 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711907d-1231-4533-a963-1cfd7e855106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2f53c2d31a4f57a17fa763868c1c1a, user_id=624787dc0bec4c029b7300885747c4df, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:22.147637 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711907d-1231-4533-a963-1cfd7e855106 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:22.238865 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1310/2624] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:22 2022] PUT /identity/v3/projects/fd2f53c2d31a4f57a17fa763868c1c1a/users/624787dc0bec4c029b7300885747c4df/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:22.249211 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba17cb-72cf-4ee7-b1ad-8b59541cc9df None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:22.249508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba17cb-72cf-4ee7-b1ad-8b59541cc9df None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:22.249812 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba17cb-72cf-4ee7-b1ad-8b59541cc9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:22.275269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-54ba17cb-72cf-4ee7-b1ad-8b59541cc9df None None] MFA Rules not processed for user `624787dc0bec4c029b7300885747c4df`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:22.276443 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-54ba17cb-72cf-4ee7-b1ad-8b59541cc9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:22.341139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1315/2625] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:22.355880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711907d-1231-4533-a963-1cfd7e855106 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:22.422061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711907d-1231-4533-a963-1cfd7e855106 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:22.426661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea0dd2-1c86-4809-9859-a76f9c0b3fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:22.427316 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0dd2-1c86-4809-9859-a76f9c0b3fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:22.427604 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0dd2-1c86-4809-9859-a76f9c0b3fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:22.427939 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0dd2-1c86-4809-9859-a76f9c0b3fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:22.428633 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea0dd2-1c86-4809-9859-a76f9c0b3fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:22.430570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea0dd2-1c86-4809-9859-a76f9c0b3fd2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:22.529329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1311/2626] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:12:22 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:22.533562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba17cb-72cf-4ee7-b1ad-8b59541cc9df None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:22.544424 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba17cb-72cf-4ee7-b1ad-8b59541cc9df None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:22.601968 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd4556-4f0d-44fa-ba2e-e8e4d58ae015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:22.602888 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd4556-4f0d-44fa-ba2e-e8e4d58ae015 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:22.603174 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd4556-4f0d-44fa-ba2e-e8e4d58ae015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:22.603456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd4556-4f0d-44fa-ba2e-e8e4d58ae015 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:22.604398 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd4556-4f0d-44fa-ba2e-e8e4d58ae015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:22.606397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd4556-4f0d-44fa-ba2e-e8e4d58ae015 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:22.687567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1316/2627] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:12:22 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:22.691466 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea0dd2-1c86-4809-9859-a76f9c0b3fd2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:22.702058 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea0dd2-1c86-4809-9859-a76f9c0b3fd2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:22.706922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a2f8c-b081-4118-9f96-0448fc83e11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:22.707588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a2f8c-b081-4118-9f96-0448fc83e11c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:22.707907 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a2f8c-b081-4118-9f96-0448fc83e11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:22.708190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a2f8c-b081-4118-9f96-0448fc83e11c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:22.708952 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a2f8c-b081-4118-9f96-0448fc83e11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:22.710613 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a2f8c-b081-4118-9f96-0448fc83e11c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:22.721794 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1312/2628] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:22.725937 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd4556-4f0d-44fa-ba2e-e8e4d58ae015 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:22.736423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd4556-4f0d-44fa-ba2e-e8e4d58ae015 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:22.741310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819d6a3-1a22-4d19-813e-6576807623d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:22.742337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819d6a3-1a22-4d19-813e-6576807623d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:22.742623 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819d6a3-1a22-4d19-813e-6576807623d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:22.742927 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819d6a3-1a22-4d19-813e-6576807623d4 admin admin] PATH_INFO: `/v3/projects/027aaf5f78e04ee285d5b037a8e5e711/users/6af1ba1fb7e341ea86178edcaaa3b908/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:22.758057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819d6a3-1a22-4d19-813e-6576807623d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=027aaf5f78e04ee285d5b037a8e5e711, user_id=6af1ba1fb7e341ea86178edcaaa3b908, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:22.760759 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819d6a3-1a22-4d19-813e-6576807623d4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:22.827298 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1317/2629] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:22 2022] PUT /identity/v3/projects/027aaf5f78e04ee285d5b037a8e5e711/users/6af1ba1fb7e341ea86178edcaaa3b908/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:22.836320 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a2f8c-b081-4118-9f96-0448fc83e11c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:22.847061 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a2f8c-b081-4118-9f96-0448fc83e11c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:22.903193 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12def742-c265-43cf-985a-e1960c57e4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:22.903922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12def742-c265-43cf-985a-e1960c57e4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:22.904120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12def742-c265-43cf-985a-e1960c57e4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:22.904401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12def742-c265-43cf-985a-e1960c57e4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:22.905117 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12def742-c265-43cf-985a-e1960c57e4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:22.906743 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12def742-c265-43cf-985a-e1960c57e4e1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:22.916457 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1313/2630] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:22.921654 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819d6a3-1a22-4d19-813e-6576807623d4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:22.934987 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819d6a3-1a22-4d19-813e-6576807623d4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:22.939948 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54022a-b597-425a-ba08-0b96c79efdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:22.940995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54022a-b597-425a-ba08-0b96c79efdff admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:22.941295 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54022a-b597-425a-ba08-0b96c79efdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:22.941610 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54022a-b597-425a-ba08-0b96c79efdff admin admin] PATH_INFO: `/v3/projects/027aaf5f78e04ee285d5b037a8e5e711/users/6af1ba1fb7e341ea86178edcaaa3b908/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:22.943593 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54022a-b597-425a-ba08-0b96c79efdff admin admin] RBAC: Authorizing `identity:create_grant(project_id=027aaf5f78e04ee285d5b037a8e5e711, user_id=6af1ba1fb7e341ea86178edcaaa3b908, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:22.946382 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54022a-b597-425a-ba08-0b96c79efdff admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:22.957474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1318/2631] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:22 2022] PUT /identity/v3/projects/027aaf5f78e04ee285d5b037a8e5e711/users/6af1ba1fb7e341ea86178edcaaa3b908/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:22.969088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3fbf0-2586-4ba2-bab3-9de56654ee7c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:22.969376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3fbf0-2586-4ba2-bab3-9de56654ee7c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:22.969693 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3fbf0-2586-4ba2-bab3-9de56654ee7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:22.995541 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-caa3fbf0-2586-4ba2-bab3-9de56654ee7c None None] MFA Rules not processed for user `6af1ba1fb7e341ea86178edcaaa3b908`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:22.997252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-caa3fbf0-2586-4ba2-bab3-9de56654ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:23.063827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1314/2632] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:23.075633 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54022a-b597-425a-ba08-0b96c79efdff admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:23.077280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7d54022a-b597-425a-ba08-0b96c79efdff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:23.138835 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54022a-b597-425a-ba08-0b96c79efdff admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:23.143177 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22410a-00ad-4bb8-bab8-429da16bb30a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:23.143877 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22410a-00ad-4bb8-bab8-429da16bb30a service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:23.144249 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22410a-00ad-4bb8-bab8-429da16bb30a service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:23.144422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22410a-00ad-4bb8-bab8-429da16bb30a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:23.201384 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22410a-00ad-4bb8-bab8-429da16bb30a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:23.202780 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22410a-00ad-4bb8-bab8-429da16bb30a service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:23.211788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1319/2633] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:12:23.706887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3fbf0-2586-4ba2-bab3-9de56654ee7c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:23.708297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-caa3fbf0-2586-4ba2-bab3-9de56654ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:23.774550 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3fbf0-2586-4ba2-bab3-9de56654ee7c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:23.779784 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01971a5f-3d61-45b4-97cf-2596777867c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:23.780673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01971a5f-3d61-45b4-97cf-2596777867c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:23.780951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01971a5f-3d61-45b4-97cf-2596777867c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:23.781224 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01971a5f-3d61-45b4-97cf-2596777867c9 admin admin] PATH_INFO: `/v3/users/6866b57180324a5295b6bda5f4952b45` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:23.782422 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01971a5f-3d61-45b4-97cf-2596777867c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6866b57180324a5295b6bda5f4952b45)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:23.784346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01971a5f-3d61-45b4-97cf-2596777867c9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:23.991461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-01971a5f-3d61-45b4-97cf-2596777867c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6866b57180324a5295b6bda5f4952b45'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:23.998083 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-01971a5f-3d61-45b4-97cf-2596777867c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6866b57180324a5295b6bda5f4952b45'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:24.065332 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-01971a5f-3d61-45b4-97cf-2596777867c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6866b57180324a5295b6bda5f4952b45'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:24.065993 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-01971a5f-3d61-45b4-97cf-2596777867c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6866b57180324a5295b6bda5f4952b45'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:24.066596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-01971a5f-3d61-45b4-97cf-2596777867c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6866b57180324a5295b6bda5f4952b45'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:24.084183 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1315/2634] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:23 2022] DELETE /identity/v3/users/6866b57180324a5295b6bda5f4952b45 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:24.088722 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac19b0-f3d8-41d9-bb8b-346820df4ee4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:24.089248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac19b0-f3d8-41d9-bb8b-346820df4ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:24.089350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac19b0-f3d8-41d9-bb8b-346820df4ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:24.106588 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-d0ac19b0-f3d8-41d9-bb8b-346820df4ee4 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:24.107767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d0ac19b0-f3d8-41d9-bb8b-346820df4ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:24.170856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1320/2635] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:24.180846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01971a5f-3d61-45b4-97cf-2596777867c9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:24.182323 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-01971a5f-3d61-45b4-97cf-2596777867c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:24.240062 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01971a5f-3d61-45b4-97cf-2596777867c9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:24.243760 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e63cf-ffd1-4986-89ad-ffd40b4a8749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:24.244406 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e63cf-ffd1-4986-89ad-ffd40b4a8749 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:24.244802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e63cf-ffd1-4986-89ad-ffd40b4a8749 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:24.245117 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e63cf-ffd1-4986-89ad-ffd40b4a8749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:24.254226 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e63cf-ffd1-4986-89ad-ffd40b4a8749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:24.255664 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e63cf-ffd1-4986-89ad-ffd40b4a8749 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:24.265676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1316/2636] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:12:24.637776 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac19b0-f3d8-41d9-bb8b-346820df4ee4 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:24.639762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-d0ac19b0-f3d8-41d9-bb8b-346820df4ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:24.653164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac19b0-f3d8-41d9-bb8b-346820df4ee4 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:24.657917 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:24.658811 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:24.659121 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:24.659404 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] PATH_INFO: `/v3/projects/a4459b0caabf464aa36ab3c0b81933ac` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:24.660594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4459b0caabf464aa36ab3c0b81933ac)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:24.662757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:24.772625 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4459b0caabf464aa36ab3c0b81933ac', 'request_id': 'req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:24.778877 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4459b0caabf464aa36ab3c0b81933ac', 'request_id': 'req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:24.784361 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4459b0caabf464aa36ab3c0b81933ac', 'request_id': 'req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:24.853144 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] The token cache is being invalidate because project a4459b0caabf464aa36ab3c0b81933ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:24.853434 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:24.854119 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:24.855648 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1321/2637] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:24 2022] DELETE /identity/v3/projects/a4459b0caabf464aa36ab3c0b81933ac => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:24.860097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e63cf-ffd1-4986-89ad-ffd40b4a8749 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:24.869472 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e63cf-ffd1-4986-89ad-ffd40b4a8749 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:24.923815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf97db-d060-43d4-bd5b-94166886ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:24.924682 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf97db-d060-43d4-bd5b-94166886ce5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:24.924972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf97db-d060-43d4-bd5b-94166886ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:24.925247 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf97db-d060-43d4-bd5b-94166886ce5a admin admin] PATH_INFO: `/v3/users/ccf6b327618e4318bb8e366131aec4cb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:24.926453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf97db-d060-43d4-bd5b-94166886ce5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf6b327618e4318bb8e366131aec4cb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:24.928410 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf97db-d060-43d4-bd5b-94166886ce5a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:25.129151 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f0bf97db-d060-43d4-bd5b-94166886ce5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf6b327618e4318bb8e366131aec4cb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:25.135940 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f0bf97db-d060-43d4-bd5b-94166886ce5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf6b327618e4318bb8e366131aec4cb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:25.207860 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f0bf97db-d060-43d4-bd5b-94166886ce5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf6b327618e4318bb8e366131aec4cb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:25.208487 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f0bf97db-d060-43d4-bd5b-94166886ce5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf6b327618e4318bb8e366131aec4cb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:25.209094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f0bf97db-d060-43d4-bd5b-94166886ce5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf6b327618e4318bb8e366131aec4cb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:25.227271 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1317/2638] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:24 2022] DELETE /identity/v3/users/ccf6b327618e4318bb8e366131aec4cb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:25.688532 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:25.689998 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:25.705974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030fa0c-2a5f-43f8-bd41-becdb9e9178b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:25.760984 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a628a-7dd2-4c90-b744-9a9c2d751392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:25.761875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a628a-7dd2-4c90-b744-9a9c2d751392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:25.762159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a628a-7dd2-4c90-b744-9a9c2d751392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:25.762433 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a628a-7dd2-4c90-b744-9a9c2d751392 admin admin] PATH_INFO: `/v3/projects/961952b7f79849bab9bb3c9f989f4d84` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:25.763600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a628a-7dd2-4c90-b744-9a9c2d751392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=961952b7f79849bab9bb3c9f989f4d84)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:25.765514 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a628a-7dd2-4c90-b744-9a9c2d751392 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:25.897854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9b1a628a-7dd2-4c90-b744-9a9c2d751392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '961952b7f79849bab9bb3c9f989f4d84', 'request_id': 'req-9b1a628a-7dd2-4c90-b744-9a9c2d751392'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:25.904103 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9b1a628a-7dd2-4c90-b744-9a9c2d751392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '961952b7f79849bab9bb3c9f989f4d84', 'request_id': 'req-9b1a628a-7dd2-4c90-b744-9a9c2d751392'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:25.909276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9b1a628a-7dd2-4c90-b744-9a9c2d751392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '961952b7f79849bab9bb3c9f989f4d84', 'request_id': 'req-9b1a628a-7dd2-4c90-b744-9a9c2d751392'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:25.988822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9b1a628a-7dd2-4c90-b744-9a9c2d751392 admin admin] The token cache is being invalidate because project 961952b7f79849bab9bb3c9f989f4d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:25.989115 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9b1a628a-7dd2-4c90-b744-9a9c2d751392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:25.989773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9b1a628a-7dd2-4c90-b744-9a9c2d751392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:25.991312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1322/2639] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:25 2022] DELETE /identity/v3/projects/961952b7f79849bab9bb3c9f989f4d84 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:25.996151 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7657ef-60ad-43ad-ae77-bc9c2359e48a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:25.996448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7657ef-60ad-43ad-ae77-bc9c2359e48a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:25.996735 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7657ef-60ad-43ad-ae77-bc9c2359e48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:26.017030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6e7657ef-60ad-43ad-ae77-bc9c2359e48a None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:26.018343 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6e7657ef-60ad-43ad-ae77-bc9c2359e48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:26.075097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1318/2640] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:26.083565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258b9f3-8d31-4cf7-8c55-12e4302ced53 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:26.083860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258b9f3-8d31-4cf7-8c55-12e4302ced53 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:26.084168 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258b9f3-8d31-4cf7-8c55-12e4302ced53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:26.101904 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3258b9f3-8d31-4cf7-8c55-12e4302ced53 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:26.103091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3258b9f3-8d31-4cf7-8c55-12e4302ced53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:26.110801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1323/2641] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:26.114660 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7657ef-60ad-43ad-ae77-bc9c2359e48a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:26.124439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7657ef-60ad-43ad-ae77-bc9c2359e48a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:26.128971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a051ebf-3341-437c-b417-6d48cd848160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:26.129652 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a051ebf-3341-437c-b417-6d48cd848160 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:26.130197 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a051ebf-3341-437c-b417-6d48cd848160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:26.130197 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a051ebf-3341-437c-b417-6d48cd848160 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:26.130905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a051ebf-3341-437c-b417-6d48cd848160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:12:26.131216 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a051ebf-3341-437c-b417-6d48cd848160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:26.132807 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a051ebf-3341-437c-b417-6d48cd848160 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:26.144532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1319/2642] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:12:26.148782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258b9f3-8d31-4cf7-8c55-12e4302ced53 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:26.158215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258b9f3-8d31-4cf7-8c55-12e4302ced53 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:26.162859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa61b7-606c-45d6-af0f-5e590d1355f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:26.163505 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa61b7-606c-45d6-af0f-5e590d1355f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:26.163788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa61b7-606c-45d6-af0f-5e590d1355f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:26.164094 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa61b7-606c-45d6-af0f-5e590d1355f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:26.164783 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa61b7-606c-45d6-af0f-5e590d1355f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:26.166748 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa61b7-606c-45d6-af0f-5e590d1355f4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:26.254289 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1324/2643] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:12:26 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:26.258186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a051ebf-3341-437c-b417-6d48cd848160 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:26.267871 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a051ebf-3341-437c-b417-6d48cd848160 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:26.322820 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19bd8c-87f0-4ab7-ab2b-196859fd412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:26.323481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19bd8c-87f0-4ab7-ab2b-196859fd412b admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:26.323769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19bd8c-87f0-4ab7-ab2b-196859fd412b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:26.324047 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19bd8c-87f0-4ab7-ab2b-196859fd412b admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:26.324723 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19bd8c-87f0-4ab7-ab2b-196859fd412b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:26.326761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19bd8c-87f0-4ab7-ab2b-196859fd412b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:26.425477 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1320/2644] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:12:26 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:26.429458 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa61b7-606c-45d6-af0f-5e590d1355f4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:26.440096 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa61b7-606c-45d6-af0f-5e590d1355f4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:26.444609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eb67b-5454-428c-9415-271fdd5fe5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:26.447390 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eb67b-5454-428c-9415-271fdd5fe5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:26.447390 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eb67b-5454-428c-9415-271fdd5fe5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:26.447390 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eb67b-5454-428c-9415-271fdd5fe5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:26.447390 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610eb67b-5454-428c-9415-271fdd5fe5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:26.448097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610eb67b-5454-428c-9415-271fdd5fe5d5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:26.458092 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1325/2645] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:26.462056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19bd8c-87f0-4ab7-ab2b-196859fd412b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:26.471572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19bd8c-87f0-4ab7-ab2b-196859fd412b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:26.476111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fc144-7a59-435e-84c9-96f0f2ff6ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:26.476749 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fc144-7a59-435e-84c9-96f0f2ff6ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:26.477030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fc144-7a59-435e-84c9-96f0f2ff6ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:26.477309 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fc144-7a59-435e-84c9-96f0f2ff6ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:26.478207 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fc144-7a59-435e-84c9-96f0f2ff6ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:26.479788 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fc144-7a59-435e-84c9-96f0f2ff6ec4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:26.490132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1321/2646] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:26.494059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eb67b-5454-428c-9415-271fdd5fe5d5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:26.504348 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eb67b-5454-428c-9415-271fdd5fe5d5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:26.511605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dc37a-badf-4168-94fc-b29adc5cb2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:26.512485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dc37a-badf-4168-94fc-b29adc5cb2f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:26.512767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dc37a-badf-4168-94fc-b29adc5cb2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:26.513042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dc37a-badf-4168-94fc-b29adc5cb2f5 admin admin] PATH_INFO: `/v3/projects/e43c668ce222466994ecc94ff33a8d0d/users/e7b86a56cc754e008bf4987c4a01e6fb/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:26.531817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dc37a-badf-4168-94fc-b29adc5cb2f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43c668ce222466994ecc94ff33a8d0d, user_id=e7b86a56cc754e008bf4987c4a01e6fb, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:26.531817 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dc37a-badf-4168-94fc-b29adc5cb2f5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:26.630914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1326/2647] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:26 2022] PUT /identity/v3/projects/e43c668ce222466994ecc94ff33a8d0d/users/e7b86a56cc754e008bf4987c4a01e6fb/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:26.642045 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51cdb-ec7f-4cba-a8a4-9cd7869788a4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:26.642317 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51cdb-ec7f-4cba-a8a4-9cd7869788a4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:26.642599 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e51cdb-ec7f-4cba-a8a4-9cd7869788a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:26.668668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-11e51cdb-ec7f-4cba-a8a4-9cd7869788a4 None None] MFA Rules not processed for user `e7b86a56cc754e008bf4987c4a01e6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:26.670552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-11e51cdb-ec7f-4cba-a8a4-9cd7869788a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:26.731287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1322/2648] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:26.736407 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dc37a-badf-4168-94fc-b29adc5cb2f5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:26.796644 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dc37a-badf-4168-94fc-b29adc5cb2f5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:26.801479 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5818b49-1430-4a43-87ad-e4cd07f3fc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:26.802162 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5818b49-1430-4a43-87ad-e4cd07f3fc28 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:26.802457 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5818b49-1430-4a43-87ad-e4cd07f3fc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:26.802759 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5818b49-1430-4a43-87ad-e4cd07f3fc28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:26.803555 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5818b49-1430-4a43-87ad-e4cd07f3fc28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:26.805569 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5818b49-1430-4a43-87ad-e4cd07f3fc28 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:26.934019 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1327/2649] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:12:26 2022] POST /identity/v3/projects => generated 367 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:26.937987 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e51cdb-ec7f-4cba-a8a4-9cd7869788a4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:26.948277 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e51cdb-ec7f-4cba-a8a4-9cd7869788a4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:27.003198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3249d5-2d9e-4193-9fc1-7b4c78acea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:27.003778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3249d5-2d9e-4193-9fc1-7b4c78acea16 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:27.004070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3249d5-2d9e-4193-9fc1-7b4c78acea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:27.004354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3249d5-2d9e-4193-9fc1-7b4c78acea16 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:27.005036 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3249d5-2d9e-4193-9fc1-7b4c78acea16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:27.006998 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3249d5-2d9e-4193-9fc1-7b4c78acea16 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:27.108593 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1323/2650] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:12:26 2022] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:12:27.109786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5818b49-1430-4a43-87ad-e4cd07f3fc28 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:27.119978 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5818b49-1430-4a43-87ad-e4cd07f3fc28 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:27.124634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dc201-99c5-41d7-a25d-912070cde48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:27.125392 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dc201-99c5-41d7-a25d-912070cde48e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:27.125718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dc201-99c5-41d7-a25d-912070cde48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:27.125997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dc201-99c5-41d7-a25d-912070cde48e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:27.126714 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dc201-99c5-41d7-a25d-912070cde48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:27.128299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421dc201-99c5-41d7-a25d-912070cde48e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:27.139428 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1328/2651] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:27.148543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3249d5-2d9e-4193-9fc1-7b4c78acea16 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:27.159214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3249d5-2d9e-4193-9fc1-7b4c78acea16 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:27.163700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2086a-278f-4a88-aaca-b24642bfb267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:27.164565 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2086a-278f-4a88-aaca-b24642bfb267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:27.164849 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2086a-278f-4a88-aaca-b24642bfb267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:27.165125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2086a-278f-4a88-aaca-b24642bfb267 admin admin] PATH_INFO: `/v3/projects/9f375f89e4a2434da410a2c356fa2bc1/users/ef2e1798ade047a4b7eda554e69e7fda/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:27.179232 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2086a-278f-4a88-aaca-b24642bfb267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f375f89e4a2434da410a2c356fa2bc1, user_id=ef2e1798ade047a4b7eda554e69e7fda, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:27.181908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2086a-278f-4a88-aaca-b24642bfb267 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:27.300109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1324/2652] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:27 2022] PUT /identity/v3/projects/9f375f89e4a2434da410a2c356fa2bc1/users/ef2e1798ade047a4b7eda554e69e7fda/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:27.304775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dc201-99c5-41d7-a25d-912070cde48e admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:27.315132 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dc201-99c5-41d7-a25d-912070cde48e admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:27.371453 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c2988-c4f5-450f-8e91-057e7a1edd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:27.372233 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c2988-c4f5-450f-8e91-057e7a1edd70 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:27.372574 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c2988-c4f5-450f-8e91-057e7a1edd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:27.372894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c2988-c4f5-450f-8e91-057e7a1edd70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:27.374164 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c2988-c4f5-450f-8e91-057e7a1edd70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:27.375933 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c2988-c4f5-450f-8e91-057e7a1edd70 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:27.390195 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1329/2653] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:27.395255 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2086a-278f-4a88-aaca-b24642bfb267 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:27.403957 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2086a-278f-4a88-aaca-b24642bfb267 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:27.414069 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733e9d8-4181-4ba8-8082-9136a5838bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:27.415065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733e9d8-4181-4ba8-8082-9136a5838bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:27.415505 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733e9d8-4181-4ba8-8082-9136a5838bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:27.415902 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733e9d8-4181-4ba8-8082-9136a5838bdf admin admin] PATH_INFO: `/v3/projects/9f375f89e4a2434da410a2c356fa2bc1/users/ef2e1798ade047a4b7eda554e69e7fda/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:27.418019 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733e9d8-4181-4ba8-8082-9136a5838bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f375f89e4a2434da410a2c356fa2bc1, user_id=ef2e1798ade047a4b7eda554e69e7fda, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:27.421075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733e9d8-4181-4ba8-8082-9136a5838bdf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:27.432150 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1325/2654] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:27 2022] PUT /identity/v3/projects/9f375f89e4a2434da410a2c356fa2bc1/users/ef2e1798ade047a4b7eda554e69e7fda/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:27.442504 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d694f0-6f53-4ebf-a8e4-ad97509bd015 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:27.442795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d694f0-6f53-4ebf-a8e4-ad97509bd015 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:27.443075 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d694f0-6f53-4ebf-a8e4-ad97509bd015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:27.444562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733e9d8-4181-4ba8-8082-9136a5838bdf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:27.446238 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c733e9d8-4181-4ba8-8082-9136a5838bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:27.471058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-58d694f0-6f53-4ebf-a8e4-ad97509bd015 None None] MFA Rules not processed for user `ef2e1798ade047a4b7eda554e69e7fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:27.472258 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-58d694f0-6f53-4ebf-a8e4-ad97509bd015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:27.502576 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733e9d8-4181-4ba8-8082-9136a5838bdf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:27.506475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5d7bf-ceab-4fdb-b1e9-612375394800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:27.507162 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5d7bf-ceab-4fdb-b1e9-612375394800 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:27.507391 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5d7bf-ceab-4fdb-b1e9-612375394800 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:27.507666 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5d7bf-ceab-4fdb-b1e9-612375394800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:27.509486 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0bc5d7bf-ceab-4fdb-b1e9-612375394800 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:27.541920 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1330/2655] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:27.573582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5d7bf-ceab-4fdb-b1e9-612375394800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:27.575015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5d7bf-ceab-4fdb-b1e9-612375394800 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:27.584452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1326/2656] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:12:27.601571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d694f0-6f53-4ebf-a8e4-ad97509bd015 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:27.601571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-58d694f0-6f53-4ebf-a8e4-ad97509bd015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:27.613069 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d694f0-6f53-4ebf-a8e4-ad97509bd015 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:27.616712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae077349-c064-4592-b365-f4d55c327f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:27.617359 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae077349-c064-4592-b365-f4d55c327f09 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:27.617679 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae077349-c064-4592-b365-f4d55c327f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:27.617995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae077349-c064-4592-b365-f4d55c327f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:27.628296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae077349-c064-4592-b365-f4d55c327f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:27.631245 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae077349-c064-4592-b365-f4d55c327f09 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:27.642515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1331/2657] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:12:27.770190 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5d7bf-ceab-4fdb-b1e9-612375394800 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:27.779065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5d7bf-ceab-4fdb-b1e9-612375394800 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:27.783171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2906b8-f411-48a1-918c-2edc3639c24b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:27.783797 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2906b8-f411-48a1-918c-2edc3639c24b service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:27.784075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2906b8-f411-48a1-918c-2edc3639c24b service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:27.784354 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2906b8-f411-48a1-918c-2edc3639c24b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:27.844198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2906b8-f411-48a1-918c-2edc3639c24b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:27.845730 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2906b8-f411-48a1-918c-2edc3639c24b service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:27.854880 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1327/2658] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:12:29.210432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae077349-c064-4592-b365-f4d55c327f09 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:29.218724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae077349-c064-4592-b365-f4d55c327f09 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:29.222557 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc1c53-5184-4e8a-88c8-b8222b4ccef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:29.223199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc1c53-5184-4e8a-88c8-b8222b4ccef7 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:29.223479 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc1c53-5184-4e8a-88c8-b8222b4ccef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:29.223753 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc1c53-5184-4e8a-88c8-b8222b4ccef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:29.225508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-23dc1c53-5184-4e8a-88c8-b8222b4ccef7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:29.296607 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc1c53-5184-4e8a-88c8-b8222b4ccef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:29.298019 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc1c53-5184-4e8a-88c8-b8222b4ccef7 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:29.308248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1332/2659] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:12:31.875280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2906b8-f411-48a1-918c-2edc3639c24b service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:31.876674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7f2906b8-f411-48a1-918c-2edc3639c24b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:31.939429 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2906b8-f411-48a1-918c-2edc3639c24b service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:31.944038 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b978a6-f96f-4063-819a-33b45769dbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:31.944939 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b978a6-f96f-4063-819a-33b45769dbd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:31.945220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b978a6-f96f-4063-819a-33b45769dbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:31.945504 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b978a6-f96f-4063-819a-33b45769dbd5 admin admin] PATH_INFO: `/v3/users/fb23f142c441469cb8173959e0f3f4d5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:31.949914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b978a6-f96f-4063-819a-33b45769dbd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb23f142c441469cb8173959e0f3f4d5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:31.949914 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b978a6-f96f-4063-819a-33b45769dbd5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:32.172148 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a0b978a6-f96f-4063-819a-33b45769dbd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb23f142c441469cb8173959e0f3f4d5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:32.180453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a0b978a6-f96f-4063-819a-33b45769dbd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb23f142c441469cb8173959e0f3f4d5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:32.270583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a0b978a6-f96f-4063-819a-33b45769dbd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb23f142c441469cb8173959e0f3f4d5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:32.271187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a0b978a6-f96f-4063-819a-33b45769dbd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb23f142c441469cb8173959e0f3f4d5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:32.271784 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a0b978a6-f96f-4063-819a-33b45769dbd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb23f142c441469cb8173959e0f3f4d5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:32.292938 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1328/2660] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:31 2022] DELETE /identity/v3/users/fb23f142c441469cb8173959e0f3f4d5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:32.296835 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38962cd-8455-4218-b245-f72fd488eaac None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:32.297312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38962cd-8455-4218-b245-f72fd488eaac None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:32.297312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38962cd-8455-4218-b245-f72fd488eaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:32.316101 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-b38962cd-8455-4218-b245-f72fd488eaac None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:32.317095 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b38962cd-8455-4218-b245-f72fd488eaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:32.376296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1333/2661] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:32.386678 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b978a6-f96f-4063-819a-33b45769dbd5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:32.388272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a0b978a6-f96f-4063-819a-33b45769dbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:32.449164 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b978a6-f96f-4063-819a-33b45769dbd5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:32.452873 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db180e7c-400a-4af7-9cc5-010cb4ee797b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:32.453519 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db180e7c-400a-4af7-9cc5-010cb4ee797b service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:32.453832 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db180e7c-400a-4af7-9cc5-010cb4ee797b service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:32.454114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db180e7c-400a-4af7-9cc5-010cb4ee797b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:32.463551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db180e7c-400a-4af7-9cc5-010cb4ee797b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:32.465411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db180e7c-400a-4af7-9cc5-010cb4ee797b service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:32.475378 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1329/2662] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:12:32.779423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38962cd-8455-4218-b245-f72fd488eaac None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:32.781130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-b38962cd-8455-4218-b245-f72fd488eaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:32.793797 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38962cd-8455-4218-b245-f72fd488eaac None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:32.799592 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fbdd6-0b57-4f37-b477-8477d869445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:32.800624 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fbdd6-0b57-4f37-b477-8477d869445d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:32.800950 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fbdd6-0b57-4f37-b477-8477d869445d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:32.803250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fbdd6-0b57-4f37-b477-8477d869445d admin admin] PATH_INFO: `/v3/users/e7b86a56cc754e008bf4987c4a01e6fb` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:32.803250 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fbdd6-0b57-4f37-b477-8477d869445d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7b86a56cc754e008bf4987c4a01e6fb)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:32.805103 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fbdd6-0b57-4f37-b477-8477d869445d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:32.958841 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db180e7c-400a-4af7-9cc5-010cb4ee797b service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:32.960697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-db180e7c-400a-4af7-9cc5-010cb4ee797b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:32.979458 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db180e7c-400a-4af7-9cc5-010cb4ee797b service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:32.986479 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:32.987457 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:32.988252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:32.992755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] PATH_INFO: `/v3/projects/c5413dc386464c9bb2fa7c8beb0df572` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:32.992755 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5413dc386464c9bb2fa7c8beb0df572)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:33.000267 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:33.031568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-663fbdd6-0b57-4f37-b477-8477d869445d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7b86a56cc754e008bf4987c4a01e6fb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.098321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-663fbdd6-0b57-4f37-b477-8477d869445d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7b86a56cc754e008bf4987c4a01e6fb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.105729 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-663fbdd6-0b57-4f37-b477-8477d869445d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7b86a56cc754e008bf4987c4a01e6fb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.106365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-663fbdd6-0b57-4f37-b477-8477d869445d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7b86a56cc754e008bf4987c4a01e6fb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.107124 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-663fbdd6-0b57-4f37-b477-8477d869445d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7b86a56cc754e008bf4987c4a01e6fb'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.114940 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5413dc386464c9bb2fa7c8beb0df572', 'request_id': 'req-93aa6014-9462-4b1c-993a-48200cf27c89'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.121008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5413dc386464c9bb2fa7c8beb0df572', 'request_id': 'req-93aa6014-9462-4b1c-993a-48200cf27c89'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.124306 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1334/2663] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:32 2022] DELETE /identity/v3/users/e7b86a56cc754e008bf4987c4a01e6fb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:33.126410 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5413dc386464c9bb2fa7c8beb0df572', 'request_id': 'req-93aa6014-9462-4b1c-993a-48200cf27c89'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.128874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5621-0c10-4baf-b046-5212504d2e39 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:33.129230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5621-0c10-4baf-b046-5212504d2e39 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:33.129518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5621-0c10-4baf-b046-5212504d2e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:33.148393 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ee4c5621-0c10-4baf-b046-5212504d2e39 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:33.149624 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ee4c5621-0c10-4baf-b046-5212504d2e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:33.207535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] The token cache is being invalidate because project c5413dc386464c9bb2fa7c8beb0df572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:33.207821 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.208149 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1335/2664] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:12:33.208627 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.210492 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1330/2665] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:32 2022] DELETE /identity/v3/projects/c5413dc386464c9bb2fa7c8beb0df572 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:33.214002 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c5621-0c10-4baf-b046-5212504d2e39 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:33.215388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ee4c5621-0c10-4baf-b046-5212504d2e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:33.217994 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:33.219397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:33.227905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c5621-0c10-4baf-b046-5212504d2e39 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:33.238418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ee889-35df-49c5-9761-91b960bce510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:33.238418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ee889-35df-49c5-9761-91b960bce510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:33.238418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ee889-35df-49c5-9761-91b960bce510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:33.238418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ee889-35df-49c5-9761-91b960bce510 admin admin] PATH_INFO: `/v3/users/2368601407b244b4986faf330e1bda34` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:33.238799 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ee889-35df-49c5-9761-91b960bce510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2368601407b244b4986faf330e1bda34)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:33.238799 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ee889-35df-49c5-9761-91b960bce510 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:33.286099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6014-9462-4b1c-993a-48200cf27c89 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:33.333268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb9e21-e875-4e7b-a7be-5a5b8bda0101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:33.333948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb9e21-e875-4e7b-a7be-5a5b8bda0101 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:33.334233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb9e21-e875-4e7b-a7be-5a5b8bda0101 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:33.334525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb9e21-e875-4e7b-a7be-5a5b8bda0101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:33.336287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b2bb9e21-e875-4e7b-a7be-5a5b8bda0101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:33.347688 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb9e21-e875-4e7b-a7be-5a5b8bda0101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:33.349137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb9e21-e875-4e7b-a7be-5a5b8bda0101 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:33.358411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1331/2666] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:12:33.476293 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8f0ee889-35df-49c5-9761-91b960bce510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2368601407b244b4986faf330e1bda34'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.572303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8f0ee889-35df-49c5-9761-91b960bce510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2368601407b244b4986faf330e1bda34'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.580751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8f0ee889-35df-49c5-9761-91b960bce510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2368601407b244b4986faf330e1bda34'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.581560 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8f0ee889-35df-49c5-9761-91b960bce510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2368601407b244b4986faf330e1bda34'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.582188 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-8f0ee889-35df-49c5-9761-91b960bce510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2368601407b244b4986faf330e1bda34'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:33.599785 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1336/2667] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:33 2022] DELETE /identity/v3/users/2368601407b244b4986faf330e1bda34 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:12:33.823875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb9e21-e875-4e7b-a7be-5a5b8bda0101 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:33.825407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b2bb9e21-e875-4e7b-a7be-5a5b8bda0101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:33.837092 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb9e21-e875-4e7b-a7be-5a5b8bda0101 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:33.902340 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:33.903213 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:33.903518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:33.903808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] PATH_INFO: `/v3/projects/e43c668ce222466994ecc94ff33a8d0d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:33.904995 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43c668ce222466994ecc94ff33a8d0d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:33.906954 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:34.014079 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43c668ce222466994ecc94ff33a8d0d', 'request_id': 'req-8a6ba4ea-7977-4004-9672-c002f26a81a4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.014658 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ee889-35df-49c5-9761-91b960bce510 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:34.015852 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8f0ee889-35df-49c5-9761-91b960bce510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:34.020602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43c668ce222466994ecc94ff33a8d0d', 'request_id': 'req-8a6ba4ea-7977-4004-9672-c002f26a81a4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.029124 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43c668ce222466994ecc94ff33a8d0d', 'request_id': 'req-8a6ba4ea-7977-4004-9672-c002f26a81a4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.034860 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ee889-35df-49c5-9761-91b960bce510 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:34.094374 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:34.095723 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:34.096003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:34.096565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] PATH_INFO: `/v3/projects/38254b7c014549b8baa6ca91a1f8aa9a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:34.097818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38254b7c014549b8baa6ca91a1f8aa9a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:34.099865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:34.116912 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] The token cache is being invalidate because project e43c668ce222466994ecc94ff33a8d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:34.117300 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.118014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.119685 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1332/2668] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:33 2022] DELETE /identity/v3/projects/e43c668ce222466994ecc94ff33a8d0d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:34.120639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:34.122133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:34.134925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ba4ea-7977-4004-9672-c002f26a81a4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:34.139619 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe115e8-b702-4e84-9781-6c996fdb6af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:34.140466 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe115e8-b702-4e84-9781-6c996fdb6af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:34.140749 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe115e8-b702-4e84-9781-6c996fdb6af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:34.141028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe115e8-b702-4e84-9781-6c996fdb6af7 admin admin] PATH_INFO: `/v3/users/7f03e7d46d6d4e6dae2e04fdca0c5e42` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:34.142875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe115e8-b702-4e84-9781-6c996fdb6af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f03e7d46d6d4e6dae2e04fdca0c5e42)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:34.144828 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe115e8-b702-4e84-9781-6c996fdb6af7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:34.207294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38254b7c014549b8baa6ca91a1f8aa9a', 'request_id': 'req-640349a7-3b51-4cb8-b58e-22aeb2305f59'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.213343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38254b7c014549b8baa6ca91a1f8aa9a', 'request_id': 'req-640349a7-3b51-4cb8-b58e-22aeb2305f59'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.218676 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38254b7c014549b8baa6ca91a1f8aa9a', 'request_id': 'req-640349a7-3b51-4cb8-b58e-22aeb2305f59'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.390087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] The token cache is being invalidate because project 38254b7c014549b8baa6ca91a1f8aa9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:34.390313 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.391077 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.394406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1337/2669] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:34 2022] DELETE /identity/v3/projects/38254b7c014549b8baa6ca91a1f8aa9a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:12:34.395050 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:34.398537 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:34.403008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6fe115e8-b702-4e84-9781-6c996fdb6af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f03e7d46d6d4e6dae2e04fdca0c5e42'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.410570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6fe115e8-b702-4e84-9781-6c996fdb6af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f03e7d46d6d4e6dae2e04fdca0c5e42'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.459983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640349a7-3b51-4cb8-b58e-22aeb2305f59 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:34.464635 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdc602-0c0e-4275-aa27-0db79ad83b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:34.465493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdc602-0c0e-4275-aa27-0db79ad83b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:34.465808 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdc602-0c0e-4275-aa27-0db79ad83b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:34.466088 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdc602-0c0e-4275-aa27-0db79ad83b00 admin admin] PATH_INFO: `/v3/users/ef2e1798ade047a4b7eda554e69e7fda` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:34.467263 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdc602-0c0e-4275-aa27-0db79ad83b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef2e1798ade047a4b7eda554e69e7fda)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:34.469226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdc602-0c0e-4275-aa27-0db79ad83b00 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:34.510871 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6fe115e8-b702-4e84-9781-6c996fdb6af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f03e7d46d6d4e6dae2e04fdca0c5e42'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.511347 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6fe115e8-b702-4e84-9781-6c996fdb6af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f03e7d46d6d4e6dae2e04fdca0c5e42'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.511968 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6fe115e8-b702-4e84-9781-6c996fdb6af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f03e7d46d6d4e6dae2e04fdca0c5e42'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.530085 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1333/2670] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:34 2022] DELETE /identity/v3/users/7f03e7d46d6d4e6dae2e04fdca0c5e42 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:34.531351 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096a9ef-c97a-4b72-9c03-335b36145a4b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:34.531664 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096a9ef-c97a-4b72-9c03-335b36145a4b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:34.532040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096a9ef-c97a-4b72-9c03-335b36145a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:34.550094 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2096a9ef-c97a-4b72-9c03-335b36145a4b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:34.551295 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2096a9ef-c97a-4b72-9c03-335b36145a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:34.608546 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1334/2671] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:34.609835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b703b-c921-40ab-8cd4-5935b34dd63b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:34.610123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b703b-c921-40ab-8cd4-5935b34dd63b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:34.610397 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b703b-c921-40ab-8cd4-5935b34dd63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:34.628445 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4e6b703b-c921-40ab-8cd4-5935b34dd63b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:34.629737 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4e6b703b-c921-40ab-8cd4-5935b34dd63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:34.637649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1335/2672] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:34.638848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf6f13-ada9-423a-82ac-19cd3ce2ffbf None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:34.639137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf6f13-ada9-423a-82ac-19cd3ce2ffbf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:34.639419 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf6f13-ada9-423a-82ac-19cd3ce2ffbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:34.659035 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9eaf6f13-ada9-423a-82ac-19cd3ce2ffbf None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:34.660401 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9eaf6f13-ada9-423a-82ac-19cd3ce2ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:34.668546 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1336/2673] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:34.671754 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf6f13-ada9-423a-82ac-19cd3ce2ffbf None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:34.671754 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9eaf6f13-ada9-423a-82ac-19cd3ce2ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:34.679087 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-94cdc602-0c0e-4275-aa27-0db79ad83b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef2e1798ade047a4b7eda554e69e7fda'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.727756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf6f13-ada9-423a-82ac-19cd3ce2ffbf None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:34.731410 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53513a-a1a2-4ffe-b6f3-3c900ef5b648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:34.732106 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53513a-a1a2-4ffe-b6f3-3c900ef5b648 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:34.732395 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53513a-a1a2-4ffe-b6f3-3c900ef5b648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:34.732673 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53513a-a1a2-4ffe-b6f3-3c900ef5b648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:34.738891 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-94cdc602-0c0e-4275-aa27-0db79ad83b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef2e1798ade047a4b7eda554e69e7fda'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.741736 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53513a-a1a2-4ffe-b6f3-3c900ef5b648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:34.743193 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53513a-a1a2-4ffe-b6f3-3c900ef5b648 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:34.746091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-94cdc602-0c0e-4275-aa27-0db79ad83b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef2e1798ade047a4b7eda554e69e7fda'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.746760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-94cdc602-0c0e-4275-aa27-0db79ad83b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef2e1798ade047a4b7eda554e69e7fda'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.747539 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-94cdc602-0c0e-4275-aa27-0db79ad83b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef2e1798ade047a4b7eda554e69e7fda'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:34.755560 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1337/2674] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:12:34.756380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53513a-a1a2-4ffe-b6f3-3c900ef5b648 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:34.765628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53513a-a1a2-4ffe-b6f3-3c900ef5b648 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:34.771002 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e9341-42cb-4ea0-96f9-8e0dd6cde4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:34.771796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1338/2675] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:34 2022] DELETE /identity/v3/users/ef2e1798ade047a4b7eda554e69e7fda => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:34.771931 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e9341-42cb-4ea0-96f9-8e0dd6cde4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:34.772240 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e9341-42cb-4ea0-96f9-8e0dd6cde4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:34.772521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e9341-42cb-4ea0-96f9-8e0dd6cde4fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:34.773244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e9341-42cb-4ea0-96f9-8e0dd6cde4fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:12:34.773569 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e9341-42cb-4ea0-96f9-8e0dd6cde4fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:34.775379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e9341-42cb-4ea0-96f9-8e0dd6cde4fe admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:34.791093 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1338/2676] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:12:34.792807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdc602-0c0e-4275-aa27-0db79ad83b00 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:34.794378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-94cdc602-0c0e-4275-aa27-0db79ad83b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:34.866703 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdc602-0c0e-4275-aa27-0db79ad83b00 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:34.871460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64b937-955b-441b-8403-7a6c7202c18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:34.872127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64b937-955b-441b-8403-7a6c7202c18d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:34.872414 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64b937-955b-441b-8403-7a6c7202c18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:34.872696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64b937-955b-441b-8403-7a6c7202c18d admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:34.873388 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64b937-955b-441b-8403-7a6c7202c18d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:34.875337 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64b937-955b-441b-8403-7a6c7202c18d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:34.998888 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1339/2677] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:12:34 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:12:35.003683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e9341-42cb-4ea0-96f9-8e0dd6cde4fe admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:35.016758 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e9341-42cb-4ea0-96f9-8e0dd6cde4fe admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:35.074752 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138d979-0e5e-434d-a2fc-1e0524113fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:35.075429 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138d979-0e5e-434d-a2fc-1e0524113fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:35.075716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138d979-0e5e-434d-a2fc-1e0524113fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:35.075996 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138d979-0e5e-434d-a2fc-1e0524113fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:35.076685 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138d979-0e5e-434d-a2fc-1e0524113fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:35.078663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138d979-0e5e-434d-a2fc-1e0524113fe1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:35.156459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1339/2678] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:12:35 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:12:35.160584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64b937-955b-441b-8403-7a6c7202c18d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:35.171596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64b937-955b-441b-8403-7a6c7202c18d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:35.177279 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ceb2b-b7d0-49c9-9d6f-519fc79aa503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:35.177648 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ceb2b-b7d0-49c9-9d6f-519fc79aa503 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:35.177956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ceb2b-b7d0-49c9-9d6f-519fc79aa503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:35.178215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ceb2b-b7d0-49c9-9d6f-519fc79aa503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:35.178949 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ceb2b-b7d0-49c9-9d6f-519fc79aa503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:35.181013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ceb2b-b7d0-49c9-9d6f-519fc79aa503 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:35.192596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1340/2679] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:35.196493 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138d979-0e5e-434d-a2fc-1e0524113fe1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:35.206533 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138d979-0e5e-434d-a2fc-1e0524113fe1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:35.211338 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6da336-93b6-40e8-bad8-d64ac6126db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:35.212029 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6da336-93b6-40e8-bad8-d64ac6126db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:35.212306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6da336-93b6-40e8-bad8-d64ac6126db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:35.212582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6da336-93b6-40e8-bad8-d64ac6126db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:35.213294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6da336-93b6-40e8-bad8-d64ac6126db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:35.214923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6da336-93b6-40e8-bad8-d64ac6126db6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:35.224884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1340/2680] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:35.228826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ceb2b-b7d0-49c9-9d6f-519fc79aa503 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:35.239214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ceb2b-b7d0-49c9-9d6f-519fc79aa503 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:35.243855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1a54d-2cb9-41a1-ac0b-61c3ef0bf7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:35.244720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a54d-2cb9-41a1-ac0b-61c3ef0bf7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:35.245002 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a54d-2cb9-41a1-ac0b-61c3ef0bf7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:35.245275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a54d-2cb9-41a1-ac0b-61c3ef0bf7d6 admin admin] PATH_INFO: `/v3/projects/d861a5454d2c4e958c3d2dc0ff9de841/users/38fa3a995af749288bb630a30cb13771/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:35.260926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6da336-93b6-40e8-bad8-d64ac6126db6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:35.261423 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1a54d-2cb9-41a1-ac0b-61c3ef0bf7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d861a5454d2c4e958c3d2dc0ff9de841, user_id=38fa3a995af749288bb630a30cb13771, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:35.262956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9d6da336-93b6-40e8-bad8-d64ac6126db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:35.264331 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1a54d-2cb9-41a1-ac0b-61c3ef0bf7d6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:35.276237 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6da336-93b6-40e8-bad8-d64ac6126db6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:35.281171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f440513-0968-49e0-be0b-98c91322a839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:35.282130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440513-0968-49e0-be0b-98c91322a839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:35.282411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440513-0968-49e0-be0b-98c91322a839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:35.282680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f440513-0968-49e0-be0b-98c91322a839 admin admin] PATH_INFO: `/v3/projects/9f375f89e4a2434da410a2c356fa2bc1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:35.283857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f440513-0968-49e0-be0b-98c91322a839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f375f89e4a2434da410a2c356fa2bc1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:35.285923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f440513-0968-49e0-be0b-98c91322a839 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:35.334270 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1341/2681] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:35 2022] PUT /identity/v3/projects/d861a5454d2c4e958c3d2dc0ff9de841/users/38fa3a995af749288bb630a30cb13771/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:35.335274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1a54d-2cb9-41a1-ac0b-61c3ef0bf7d6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:35.337253 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-cbe1a54d-2cb9-41a1-ac0b-61c3ef0bf7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:35.399978 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1a54d-2cb9-41a1-ac0b-61c3ef0bf7d6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:35.407350 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9f440513-0968-49e0-be0b-98c91322a839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f375f89e4a2434da410a2c356fa2bc1', 'request_id': 'req-9f440513-0968-49e0-be0b-98c91322a839'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:35.413915 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9f440513-0968-49e0-be0b-98c91322a839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f375f89e4a2434da410a2c356fa2bc1', 'request_id': 'req-9f440513-0968-49e0-be0b-98c91322a839'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:35.419184 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9f440513-0968-49e0-be0b-98c91322a839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f375f89e4a2434da410a2c356fa2bc1', 'request_id': 'req-9f440513-0968-49e0-be0b-98c91322a839'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:35.454885 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:35.455663 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:35.455945 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:35.456218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] PATH_INFO: `/v3/projects/211a01573ad94f9c87a27d906f37d066` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:35.457382 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=211a01573ad94f9c87a27d906f37d066)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:35.459378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:35.521186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9f440513-0968-49e0-be0b-98c91322a839 admin admin] The token cache is being invalidate because project 9f375f89e4a2434da410a2c356fa2bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:35.521468 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9f440513-0968-49e0-be0b-98c91322a839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:35.522206 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9f440513-0968-49e0-be0b-98c91322a839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:35.524115 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1341/2682] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:35 2022] DELETE /identity/v3/projects/9f375f89e4a2434da410a2c356fa2bc1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:12:35.525221 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ca555-c442-4277-a141-315cdeb19ba4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:35.525502 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ca555-c442-4277-a141-315cdeb19ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:35.525803 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ca555-c442-4277-a141-315cdeb19ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:35.555146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ba2ca555-c442-4277-a141-315cdeb19ba4 None None] MFA Rules not processed for user `38fa3a995af749288bb630a30cb13771`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:35.556854 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ba2ca555-c442-4277-a141-315cdeb19ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:35.557378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211a01573ad94f9c87a27d906f37d066', 'request_id': 'req-5deb2d7c-3086-4f7e-92b6-5297475239f4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:35.563697 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211a01573ad94f9c87a27d906f37d066', 'request_id': 'req-5deb2d7c-3086-4f7e-92b6-5297475239f4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:35.568990 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211a01573ad94f9c87a27d906f37d066', 'request_id': 'req-5deb2d7c-3086-4f7e-92b6-5297475239f4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:35.619805 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1342/2683] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:35.621121 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1c330-a767-498c-8f9d-5cd737edafd9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:35.621415 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1c330-a767-498c-8f9d-5cd737edafd9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:35.621726 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1c330-a767-498c-8f9d-5cd737edafd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:35.638867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-afd1c330-a767-498c-8f9d-5cd737edafd9 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:35.640056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-afd1c330-a767-498c-8f9d-5cd737edafd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:35.691636 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] The token cache is being invalidate because project 211a01573ad94f9c87a27d906f37d066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:35.692218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:35.692560 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:35.694395 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1342/2684] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:35 2022] DELETE /identity/v3/projects/211a01573ad94f9c87a27d906f37d066 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:35.695099 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:35.696478 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:35.703503 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1343/2685] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:35.704468 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1c330-a767-498c-8f9d-5cd737edafd9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:35.706364 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-afd1c330-a767-498c-8f9d-5cd737edafd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:35.708676 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb2d7c-3086-4f7e-92b6-5297475239f4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:35.713733 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5f7d9-3581-453b-9358-2d5cb49ed97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:35.714391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5f7d9-3581-453b-9358-2d5cb49ed97d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:35.714672 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5f7d9-3581-453b-9358-2d5cb49ed97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:35.714947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5f7d9-3581-453b-9358-2d5cb49ed97d admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:35.715628 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5f7d9-3581-453b-9358-2d5cb49ed97d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:35.717548 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5f7d9-3581-453b-9358-2d5cb49ed97d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:35.718175 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1c330-a767-498c-8f9d-5cd737edafd9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:35.723412 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cc229-fa9d-429a-8ea6-7ecbaf164d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:35.724269 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cc229-fa9d-429a-8ea6-7ecbaf164d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:35.724557 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cc229-fa9d-429a-8ea6-7ecbaf164d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:35.724829 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cc229-fa9d-429a-8ea6-7ecbaf164d35 admin admin] PATH_INFO: `/v3/users/624787dc0bec4c029b7300885747c4df` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:35.726063 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cc229-fa9d-429a-8ea6-7ecbaf164d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=624787dc0bec4c029b7300885747c4df)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:35.727958 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cc229-fa9d-429a-8ea6-7ecbaf164d35 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:35.831174 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1343/2686] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:12:35 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:35.832451 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e071d-cd39-445f-9d3a-2287d8dcc4fe None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:35.832771 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e071d-cd39-445f-9d3a-2287d8dcc4fe None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:35.833045 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e071d-cd39-445f-9d3a-2287d8dcc4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:35.851041 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-f20e071d-cd39-445f-9d3a-2287d8dcc4fe None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:35.852240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f20e071d-cd39-445f-9d3a-2287d8dcc4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:35.909895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1344/2687] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:35.910829 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e071d-cd39-445f-9d3a-2287d8dcc4fe None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:35.919526 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e071d-cd39-445f-9d3a-2287d8dcc4fe None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:35.924161 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c2294-259a-4532-a906-fc9126542ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:35.924782 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c2294-259a-4532-a906-fc9126542ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:35.925067 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c2294-259a-4532-a906-fc9126542ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:35.925345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c2294-259a-4532-a906-fc9126542ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:35.926064 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c2294-259a-4532-a906-fc9126542ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:35.927970 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c2294-259a-4532-a906-fc9126542ed6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:35.950490 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-103cc229-fa9d-429a-8ea6-7ecbaf164d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '624787dc0bec4c029b7300885747c4df'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:35.957663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-103cc229-fa9d-429a-8ea6-7ecbaf164d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '624787dc0bec4c029b7300885747c4df'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:36.034784 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1345/2688] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:12:35 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:36.034784 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c2294-259a-4532-a906-fc9126542ed6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:36.042201 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c2294-259a-4532-a906-fc9126542ed6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:36.047043 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1c014-a96e-41ed-a2af-b920d27e9a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:36.047693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1c014-a96e-41ed-a2af-b920d27e9a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.048002 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1c014-a96e-41ed-a2af-b920d27e9a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.048282 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1c014-a96e-41ed-a2af-b920d27e9a7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.049006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1c014-a96e-41ed-a2af-b920d27e9a7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:12:36.049318 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1c014-a96e-41ed-a2af-b920d27e9a7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:36.051053 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1c014-a96e-41ed-a2af-b920d27e9a7d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:36.052127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-103cc229-fa9d-429a-8ea6-7ecbaf164d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '624787dc0bec4c029b7300885747c4df'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:36.053021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-103cc229-fa9d-429a-8ea6-7ecbaf164d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '624787dc0bec4c029b7300885747c4df'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:36.053652 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-103cc229-fa9d-429a-8ea6-7ecbaf164d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '624787dc0bec4c029b7300885747c4df'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:36.063062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1346/2689] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:12:36.063854 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1c014-a96e-41ed-a2af-b920d27e9a7d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:36.065912 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-def1c014-a96e-41ed-a2af-b920d27e9a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:36.072443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1344/2690] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:35 2022] DELETE /identity/v3/users/624787dc0bec4c029b7300885747c4df => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:36.073268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cc229-fa9d-429a-8ea6-7ecbaf164d35 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:36.074629 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-103cc229-fa9d-429a-8ea6-7ecbaf164d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:36.079862 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1c014-a96e-41ed-a2af-b920d27e9a7d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:36.139343 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab887b-c6aa-4773-bd3f-a3105a723779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:36.139906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab887b-c6aa-4773-bd3f-a3105a723779 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.140266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab887b-c6aa-4773-bd3f-a3105a723779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.140556 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab887b-c6aa-4773-bd3f-a3105a723779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.141346 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab887b-c6aa-4773-bd3f-a3105a723779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:36.142656 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cc229-fa9d-429a-8ea6-7ecbaf164d35 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:36.144237 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab887b-c6aa-4773-bd3f-a3105a723779 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:36.147507 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446d813-ba8a-4cae-91af-1efa1fde8928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:36.148191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446d813-ba8a-4cae-91af-1efa1fde8928 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.148451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446d813-ba8a-4cae-91af-1efa1fde8928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.148730 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446d813-ba8a-4cae-91af-1efa1fde8928 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.149421 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446d813-ba8a-4cae-91af-1efa1fde8928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:36.151356 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446d813-ba8a-4cae-91af-1efa1fde8928 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:36.156871 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1347/2691] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:36.161382 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab887b-c6aa-4773-bd3f-a3105a723779 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:36.171866 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab887b-c6aa-4773-bd3f-a3105a723779 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:36.177126 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327df53-7019-4bb5-a40c-cbbd6e026a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:36.186422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327df53-7019-4bb5-a40c-cbbd6e026a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.186422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327df53-7019-4bb5-a40c-cbbd6e026a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.186422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327df53-7019-4bb5-a40c-cbbd6e026a5c admin admin] PATH_INFO: `/v3/projects/87537beee46a4fbabf80c26acf77e229/users/759fecc4d98649e4a7dc5ecc5ef16825/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.193542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327df53-7019-4bb5-a40c-cbbd6e026a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87537beee46a4fbabf80c26acf77e229, user_id=759fecc4d98649e4a7dc5ecc5ef16825, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:36.196217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327df53-7019-4bb5-a40c-cbbd6e026a5c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:36.236993 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1345/2692] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:12:36 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:36.241101 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446d813-ba8a-4cae-91af-1efa1fde8928 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:36.299929 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446d813-ba8a-4cae-91af-1efa1fde8928 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:36.304942 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dec72-ec77-4cdc-80d5-6f7bb3d2c56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:36.306256 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dec72-ec77-4cdc-80d5-6f7bb3d2c56c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.306547 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dec72-ec77-4cdc-80d5-6f7bb3d2c56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.306828 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dec72-ec77-4cdc-80d5-6f7bb3d2c56c admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.307542 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8dec72-ec77-4cdc-80d5-6f7bb3d2c56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:36.309603 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8dec72-ec77-4cdc-80d5-6f7bb3d2c56c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:36.322932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1348/2693] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:36 2022] PUT /identity/v3/projects/87537beee46a4fbabf80c26acf77e229/users/759fecc4d98649e4a7dc5ecc5ef16825/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:12:36.327216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327df53-7019-4bb5-a40c-cbbd6e026a5c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:36.390922 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327df53-7019-4bb5-a40c-cbbd6e026a5c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:36.395953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6f7a-adf0-4f36-9c0b-08c81aa7bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:36.396627 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6f7a-adf0-4f36-9c0b-08c81aa7bbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.396915 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6f7a-adf0-4f36-9c0b-08c81aa7bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.397196 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6f7a-adf0-4f36-9c0b-08c81aa7bbf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.397967 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f6f7a-adf0-4f36-9c0b-08c81aa7bbf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:36.399743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f6f7a-adf0-4f36-9c0b-08c81aa7bbf6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:36.410795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1349/2694] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:12:36.415458 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6f7a-adf0-4f36-9c0b-08c81aa7bbf6 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:36.425578 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1346/2695] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:12:36 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:12:36.426580 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6f7a-adf0-4f36-9c0b-08c81aa7bbf6 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:36.427114 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dec72-ec77-4cdc-80d5-6f7bb3d2c56c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:36.432659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880d643-d3c3-41f2-bddc-a365b8ddd677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:36.433565 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880d643-d3c3-41f2-bddc-a365b8ddd677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.434073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880d643-d3c3-41f2-bddc-a365b8ddd677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.434212 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880d643-d3c3-41f2-bddc-a365b8ddd677 admin admin] PATH_INFO: `/v3/projects/87537beee46a4fbabf80c26acf77e229/users/759fecc4d98649e4a7dc5ecc5ef16825/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.438365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880d643-d3c3-41f2-bddc-a365b8ddd677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87537beee46a4fbabf80c26acf77e229, user_id=759fecc4d98649e4a7dc5ecc5ef16825, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:36.438520 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dec72-ec77-4cdc-80d5-6f7bb3d2c56c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:36.439325 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880d643-d3c3-41f2-bddc-a365b8ddd677 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:36.443163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffb220-bd8a-4de5-8ec7-c3bf5b343a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:36.443898 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffb220-bd8a-4de5-8ec7-c3bf5b343a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.444362 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffb220-bd8a-4de5-8ec7-c3bf5b343a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.444711 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffb220-bd8a-4de5-8ec7-c3bf5b343a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.445506 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffb220-bd8a-4de5-8ec7-c3bf5b343a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:36.447213 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffb220-bd8a-4de5-8ec7-c3bf5b343a02 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:36.450701 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1350/2696] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:36 2022] PUT /identity/v3/projects/87537beee46a4fbabf80c26acf77e229/users/759fecc4d98649e4a7dc5ecc5ef16825/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:36.461503 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1347/2697] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:12:36.462973 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880d643-d3c3-41f2-bddc-a365b8ddd677 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:36.465627 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44fc37-153c-4c45-8f63-e2f73bd3f6db None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.465926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44fc37-153c-4c45-8f63-e2f73bd3f6db None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.466212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44fc37-153c-4c45-8f63-e2f73bd3f6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.494025 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-af44fc37-153c-4c45-8f63-e2f73bd3f6db None None] MFA Rules not processed for user `759fecc4d98649e4a7dc5ecc5ef16825`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:36.495300 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-af44fc37-153c-4c45-8f63-e2f73bd3f6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:36.526247 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880d643-d3c3-41f2-bddc-a365b8ddd677 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:36.533997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33300262-540f-409a-bb82-2c53e16a970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:36.534760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33300262-540f-409a-bb82-2c53e16a970c admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.535050 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33300262-540f-409a-bb82-2c53e16a970c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.535333 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33300262-540f-409a-bb82-2c53e16a970c admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.536089 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33300262-540f-409a-bb82-2c53e16a970c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:36.537773 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33300262-540f-409a-bb82-2c53e16a970c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:36.552650 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1351/2698] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:12:36.553991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33300262-540f-409a-bb82-2c53e16a970c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:36.556014 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-33300262-540f-409a-bb82-2c53e16a970c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:36.569218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33300262-540f-409a-bb82-2c53e16a970c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:36.572272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1348/2699] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:12:36.572918 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44fc37-153c-4c45-8f63-e2f73bd3f6db None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:36.577872 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688ab8c-6341-4097-a9e9-e192fff1d8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:36.578638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688ab8c-6341-4097-a9e9-e192fff1d8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.578917 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688ab8c-6341-4097-a9e9-e192fff1d8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.579207 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688ab8c-6341-4097-a9e9-e192fff1d8b6 admin admin] PATH_INFO: `/v3/projects/fd2f53c2d31a4f57a17fa763868c1c1a` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.580996 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688ab8c-6341-4097-a9e9-e192fff1d8b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2f53c2d31a4f57a17fa763868c1c1a)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:36.582962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688ab8c-6341-4097-a9e9-e192fff1d8b6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:36.583894 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44fc37-153c-4c45-8f63-e2f73bd3f6db None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:36.588683 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb47f8-38ea-4a28-bacc-6cec6ba5bdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:36.590030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb47f8-38ea-4a28-bacc-6cec6ba5bdd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.590030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb47f8-38ea-4a28-bacc-6cec6ba5bdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.590237 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb47f8-38ea-4a28-bacc-6cec6ba5bdd6 admin admin] PATH_INFO: `/v3/projects/470fa3cca4fa4c5084f6050cc5a1d845/users/678e61905f794ecba4d4cf803c13130e/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.606691 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb47f8-38ea-4a28-bacc-6cec6ba5bdd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=470fa3cca4fa4c5084f6050cc5a1d845, user_id=678e61905f794ecba4d4cf803c13130e, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:36.609443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb47f8-38ea-4a28-bacc-6cec6ba5bdd6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:36.703810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1349/2700] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:36 2022] PUT /identity/v3/projects/470fa3cca4fa4c5084f6050cc5a1d845/users/678e61905f794ecba4d4cf803c13130e/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:36.713920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb47f8-38ea-4a28-bacc-6cec6ba5bdd6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:36.713920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a0cb47f8-38ea-4a28-bacc-6cec6ba5bdd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:36.714140 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f688ab8c-6341-4097-a9e9-e192fff1d8b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2f53c2d31a4f57a17fa763868c1c1a', 'request_id': 'req-f688ab8c-6341-4097-a9e9-e192fff1d8b6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:36.718874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f688ab8c-6341-4097-a9e9-e192fff1d8b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2f53c2d31a4f57a17fa763868c1c1a', 'request_id': 'req-f688ab8c-6341-4097-a9e9-e192fff1d8b6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:36.725100 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f688ab8c-6341-4097-a9e9-e192fff1d8b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2f53c2d31a4f57a17fa763868c1c1a', 'request_id': 'req-f688ab8c-6341-4097-a9e9-e192fff1d8b6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:36.761730 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb47f8-38ea-4a28-bacc-6cec6ba5bdd6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:36.795637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f688ab8c-6341-4097-a9e9-e192fff1d8b6 admin admin] The token cache is being invalidate because project fd2f53c2d31a4f57a17fa763868c1c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:36.795929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f688ab8c-6341-4097-a9e9-e192fff1d8b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:36.796560 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f688ab8c-6341-4097-a9e9-e192fff1d8b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:36.798162 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1352/2701] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:36 2022] DELETE /identity/v3/projects/fd2f53c2d31a4f57a17fa763868c1c1a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:36.802173 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba15e8-737d-48cb-9ea4-d8cb179b267f None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.802471 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba15e8-737d-48cb-9ea4-d8cb179b267f None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.802760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba15e8-737d-48cb-9ea4-d8cb179b267f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.809556 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d60a2f-cf94-43bc-a735-a81de90af168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:36.810224 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d60a2f-cf94-43bc-a735-a81de90af168 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.810626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d60a2f-cf94-43bc-a735-a81de90af168 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.810909 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d60a2f-cf94-43bc-a735-a81de90af168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.812786 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b2d60a2f-cf94-43bc-a735-a81de90af168 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:36.834065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-43ba15e8-737d-48cb-9ea4-d8cb179b267f None None] MFA Rules not processed for user `678e61905f794ecba4d4cf803c13130e`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:36.835267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-43ba15e8-737d-48cb-9ea4-d8cb179b267f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:36.870894 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d60a2f-cf94-43bc-a735-a81de90af168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:36.872342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d60a2f-cf94-43bc-a735-a81de90af168 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:36.881133 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1350/2702] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:12:36.881965 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d60a2f-cf94-43bc-a735-a81de90af168 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:36.883292 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b2d60a2f-cf94-43bc-a735-a81de90af168 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:36.899006 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1353/2703] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:36.903567 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba15e8-737d-48cb-9ea4-d8cb179b267f None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:36.905021 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-43ba15e8-737d-48cb-9ea4-d8cb179b267f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:36.950494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d60a2f-cf94-43bc-a735-a81de90af168 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:36.955963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddcdc9-df18-4dc7-8ca8-8182ef5b42d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:36.956774 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddcdc9-df18-4dc7-8ca8-8182ef5b42d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.957059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddcdc9-df18-4dc7-8ca8-8182ef5b42d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.957336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddcdc9-df18-4dc7-8ca8-8182ef5b42d1 admin admin] PATH_INFO: `/v3/users/6af1ba1fb7e341ea86178edcaaa3b908` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.958565 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddcdc9-df18-4dc7-8ca8-8182ef5b42d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af1ba1fb7e341ea86178edcaaa3b908)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:36.960485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddcdc9-df18-4dc7-8ca8-8182ef5b42d1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:36.972273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba15e8-737d-48cb-9ea4-d8cb179b267f None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:36.977429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c02a76-01a4-4332-8c2d-5f424c6a3f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:36.978129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c02a76-01a4-4332-8c2d-5f424c6a3f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:36.978596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c02a76-01a4-4332-8c2d-5f424c6a3f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:36.978879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c02a76-01a4-4332-8c2d-5f424c6a3f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:36.979575 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c02a76-01a4-4332-8c2d-5f424c6a3f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:36.981614 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c02a76-01a4-4332-8c2d-5f424c6a3f19 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:37.067941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1354/2704] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:12:36 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:12:37.071810 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c02a76-01a4-4332-8c2d-5f424c6a3f19 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:37.123934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3bddcdc9-df18-4dc7-8ca8-8182ef5b42d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af1ba1fb7e341ea86178edcaaa3b908'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:37.131239 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3bddcdc9-df18-4dc7-8ca8-8182ef5b42d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af1ba1fb7e341ea86178edcaaa3b908'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:37.132198 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c02a76-01a4-4332-8c2d-5f424c6a3f19 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:37.136962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6175bf-c563-405f-8b6c-0e91bf0831ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:37.137671 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6175bf-c563-405f-8b6c-0e91bf0831ce admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:37.137964 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6175bf-c563-405f-8b6c-0e91bf0831ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:37.138245 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6175bf-c563-405f-8b6c-0e91bf0831ce admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:37.138939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6175bf-c563-405f-8b6c-0e91bf0831ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:37.140869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6175bf-c563-405f-8b6c-0e91bf0831ce admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:37.184617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3bddcdc9-df18-4dc7-8ca8-8182ef5b42d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af1ba1fb7e341ea86178edcaaa3b908'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:37.185280 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3bddcdc9-df18-4dc7-8ca8-8182ef5b42d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af1ba1fb7e341ea86178edcaaa3b908'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:37.185923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3bddcdc9-df18-4dc7-8ca8-8182ef5b42d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af1ba1fb7e341ea86178edcaaa3b908'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:37.203870 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1351/2705] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:36 2022] DELETE /identity/v3/users/6af1ba1fb7e341ea86178edcaaa3b908 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:37.216381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1355/2706] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:12:37 2022] POST /identity/v3/users => generated 299 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:37.217414 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddcdc9-df18-4dc7-8ca8-8182ef5b42d1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:37.218846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3bddcdc9-df18-4dc7-8ca8-8182ef5b42d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:37.283339 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddcdc9-df18-4dc7-8ca8-8182ef5b42d1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:37.288445 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b1d18-6ebe-4417-8ca5-1f6eda6401b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:37.289122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b1d18-6ebe-4417-8ca5-1f6eda6401b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:37.289416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b1d18-6ebe-4417-8ca5-1f6eda6401b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:37.289749 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b1d18-6ebe-4417-8ca5-1f6eda6401b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:37.290488 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b1d18-6ebe-4417-8ca5-1f6eda6401b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:37.292105 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b1d18-6ebe-4417-8ca5-1f6eda6401b7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:37.303383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1352/2707] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:12:37.307449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6175bf-c563-405f-8b6c-0e91bf0831ce admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:37.318026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6175bf-c563-405f-8b6c-0e91bf0831ce admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:37.322693 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c4e9a-88b6-4ab2-a059-325a254b8eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:37.323561 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c4e9a-88b6-4ab2-a059-325a254b8eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:37.323849 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c4e9a-88b6-4ab2-a059-325a254b8eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:37.324129 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c4e9a-88b6-4ab2-a059-325a254b8eaa admin admin] PATH_INFO: `/v3/projects/5b1d84200fe34a7eb98da0e8c4d4feaa/users/b874d596b2104bef948be98619a51f75/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:37.339159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c4e9a-88b6-4ab2-a059-325a254b8eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1d84200fe34a7eb98da0e8c4d4feaa, user_id=b874d596b2104bef948be98619a51f75, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:37.341869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c4e9a-88b6-4ab2-a059-325a254b8eaa admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:37.426023 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1356/2708] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:37 2022] PUT /identity/v3/projects/5b1d84200fe34a7eb98da0e8c4d4feaa/users/b874d596b2104bef948be98619a51f75/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:37.430294 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b1d18-6ebe-4417-8ca5-1f6eda6401b7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:37.441252 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b1d18-6ebe-4417-8ca5-1f6eda6401b7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:37.500761 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0e42c-5262-4c9b-9c05-c590fb56f573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:37.502076 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0e42c-5262-4c9b-9c05-c590fb56f573 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:37.502411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0e42c-5262-4c9b-9c05-c590fb56f573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:37.502748 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0e42c-5262-4c9b-9c05-c590fb56f573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:37.503502 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0e42c-5262-4c9b-9c05-c590fb56f573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:37.505383 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0e42c-5262-4c9b-9c05-c590fb56f573 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:37.516263 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1353/2709] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:37.520227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c4e9a-88b6-4ab2-a059-325a254b8eaa admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:37.532186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c4e9a-88b6-4ab2-a059-325a254b8eaa admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:37.536350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb1012-fe69-4669-8f72-22ff4696f14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:37.537237 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb1012-fe69-4669-8f72-22ff4696f14c admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:37.537665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb1012-fe69-4669-8f72-22ff4696f14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:37.537901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb1012-fe69-4669-8f72-22ff4696f14c admin admin] PATH_INFO: `/v3/projects/5b1d84200fe34a7eb98da0e8c4d4feaa/users/b874d596b2104bef948be98619a51f75/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:37.539965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb1012-fe69-4669-8f72-22ff4696f14c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1d84200fe34a7eb98da0e8c4d4feaa, user_id=b874d596b2104bef948be98619a51f75, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:37.542745 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb1012-fe69-4669-8f72-22ff4696f14c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:37.553925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1357/2710] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:37 2022] PUT /identity/v3/projects/5b1d84200fe34a7eb98da0e8c4d4feaa/users/b874d596b2104bef948be98619a51f75/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:12:37.564639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d426324-5a5b-4aaa-b356-700fa19a7dba None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:37.565027 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d426324-5a5b-4aaa-b356-700fa19a7dba None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:37.565310 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d426324-5a5b-4aaa-b356-700fa19a7dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:37.591001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4d426324-5a5b-4aaa-b356-700fa19a7dba None None] MFA Rules not processed for user `b874d596b2104bef948be98619a51f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:37.592191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4d426324-5a5b-4aaa-b356-700fa19a7dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:37.628477 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb1012-fe69-4669-8f72-22ff4696f14c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:37.631176 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-52bb1012-fe69-4669-8f72-22ff4696f14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:37.667380 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1354/2711] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:37.679632 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d426324-5a5b-4aaa-b356-700fa19a7dba None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:37.681019 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4d426324-5a5b-4aaa-b356-700fa19a7dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:37.716775 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb1012-fe69-4669-8f72-22ff4696f14c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:37.722037 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5017f-1c5b-48e9-a465-61ce86a5289e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:37.723007 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5017f-1c5b-48e9-a465-61ce86a5289e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:37.723284 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5017f-1c5b-48e9-a465-61ce86a5289e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:37.723555 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5017f-1c5b-48e9-a465-61ce86a5289e admin admin] PATH_INFO: `/v3/projects/027aaf5f78e04ee285d5b037a8e5e711` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:37.724813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5017f-1c5b-48e9-a465-61ce86a5289e admin admin] RBAC: Authorizing `identity:delete_project(project_id=027aaf5f78e04ee285d5b037a8e5e711)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:37.726919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5017f-1c5b-48e9-a465-61ce86a5289e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:37.740555 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d426324-5a5b-4aaa-b356-700fa19a7dba None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:37.744423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3adccf-f80f-446e-b415-aef017e2bf6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:37.745063 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3adccf-f80f-446e-b415-aef017e2bf6a service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:37.745357 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3adccf-f80f-446e-b415-aef017e2bf6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:37.745646 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3adccf-f80f-446e-b415-aef017e2bf6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:37.755428 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3adccf-f80f-446e-b415-aef017e2bf6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:37.756858 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3adccf-f80f-446e-b415-aef017e2bf6a service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:37.766376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1355/2712] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:12:37.830178 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3adccf-f80f-446e-b415-aef017e2bf6a service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:37.846297 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3adccf-f80f-446e-b415-aef017e2bf6a service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:37.847296 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8b5017f-1c5b-48e9-a465-61ce86a5289e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027aaf5f78e04ee285d5b037a8e5e711', 'request_id': 'req-f8b5017f-1c5b-48e9-a465-61ce86a5289e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:37.853217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8b5017f-1c5b-48e9-a465-61ce86a5289e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027aaf5f78e04ee285d5b037a8e5e711', 'request_id': 'req-f8b5017f-1c5b-48e9-a465-61ce86a5289e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:37.859110 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8b5017f-1c5b-48e9-a465-61ce86a5289e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027aaf5f78e04ee285d5b037a8e5e711', 'request_id': 'req-f8b5017f-1c5b-48e9-a465-61ce86a5289e'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:37.904127 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26135d-7920-445a-8e24-3f9d0b050a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:37.904996 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26135d-7920-445a-8e24-3f9d0b050a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:37.905284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26135d-7920-445a-8e24-3f9d0b050a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:37.905661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26135d-7920-445a-8e24-3f9d0b050a69 admin admin] PATH_INFO: `/v3/users/678e61905f794ecba4d4cf803c13130e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:37.906862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26135d-7920-445a-8e24-3f9d0b050a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=678e61905f794ecba4d4cf803c13130e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:37.909342 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26135d-7920-445a-8e24-3f9d0b050a69 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:37.960456 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8b5017f-1c5b-48e9-a465-61ce86a5289e admin admin] The token cache is being invalidate because project 027aaf5f78e04ee285d5b037a8e5e711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:37.960747 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8b5017f-1c5b-48e9-a465-61ce86a5289e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:37.961403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f8b5017f-1c5b-48e9-a465-61ce86a5289e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:37.963134 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1358/2713] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:37 2022] DELETE /identity/v3/projects/027aaf5f78e04ee285d5b037a8e5e711 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:37.967878 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606b351-0a13-4bca-91c9-07d565a1d63b None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:37.968174 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606b351-0a13-4bca-91c9-07d565a1d63b None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:37.968461 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606b351-0a13-4bca-91c9-07d565a1d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:37.987174 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9606b351-0a13-4bca-91c9-07d565a1d63b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:37.988377 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9606b351-0a13-4bca-91c9-07d565a1d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:37.996327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1359/2714] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:12:38.003635 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4f97d-0725-499c-94e6-11c90212d173 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:38.003929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4f97d-0725-499c-94e6-11c90212d173 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:38.004214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4f97d-0725-499c-94e6-11c90212d173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:38.021146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-dcc4f97d-0725-499c-94e6-11c90212d173 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:38.022347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-dcc4f97d-0725-499c-94e6-11c90212d173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:38.030771 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1360/2715] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:12:38.035383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4f97d-0725-499c-94e6-11c90212d173 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:38.044304 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4f97d-0725-499c-94e6-11c90212d173 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:38.050247 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e8adc-b8e9-4dde-9534-c18f2a2ddfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:38.050451 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e8adc-b8e9-4dde-9534-c18f2a2ddfac admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:38.050611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e8adc-b8e9-4dde-9534-c18f2a2ddfac admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:38.050891 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e8adc-b8e9-4dde-9534-c18f2a2ddfac admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:38.051605 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e8adc-b8e9-4dde-9534-c18f2a2ddfac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:12:38.051909 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e8adc-b8e9-4dde-9534-c18f2a2ddfac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:38.053487 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e8adc-b8e9-4dde-9534-c18f2a2ddfac admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:38.064796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1361/2716] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:12:38.068857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e8adc-b8e9-4dde-9534-c18f2a2ddfac admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:38.077913 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e8adc-b8e9-4dde-9534-c18f2a2ddfac admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:38.082980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dca46c-2256-44af-8f89-461d4c869914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:38.083584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dca46c-2256-44af-8f89-461d4c869914 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:38.083863 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dca46c-2256-44af-8f89-461d4c869914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:38.084138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dca46c-2256-44af-8f89-461d4c869914 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:38.084826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dca46c-2256-44af-8f89-461d4c869914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:38.086777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dca46c-2256-44af-8f89-461d4c869914 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:38.152847 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4e26135d-7920-445a-8e24-3f9d0b050a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '678e61905f794ecba4d4cf803c13130e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:38.160033 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4e26135d-7920-445a-8e24-3f9d0b050a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '678e61905f794ecba4d4cf803c13130e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:38.202185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1362/2717] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:12:38 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:12:38.206240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dca46c-2256-44af-8f89-461d4c869914 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:38.253230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4e26135d-7920-445a-8e24-3f9d0b050a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '678e61905f794ecba4d4cf803c13130e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:38.254091 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4e26135d-7920-445a-8e24-3f9d0b050a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '678e61905f794ecba4d4cf803c13130e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:38.254728 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4e26135d-7920-445a-8e24-3f9d0b050a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '678e61905f794ecba4d4cf803c13130e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:38.264950 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dca46c-2256-44af-8f89-461d4c869914 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:38.269724 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21769d2d-e3a6-44da-a7e6-fc34c07c7ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:38.270401 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21769d2d-e3a6-44da-a7e6-fc34c07c7ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:38.270668 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21769d2d-e3a6-44da-a7e6-fc34c07c7ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:38.270944 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21769d2d-e3a6-44da-a7e6-fc34c07c7ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:38.271620 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21769d2d-e3a6-44da-a7e6-fc34c07c7ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:38.272450 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1356/2718] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:37 2022] DELETE /identity/v3/users/678e61905f794ecba4d4cf803c13130e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:12:38.275319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21769d2d-e3a6-44da-a7e6-fc34c07c7ac2 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:38.276697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb7b60-182f-4015-9690-faf19e9890c0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:38.277278 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb7b60-182f-4015-9690-faf19e9890c0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:38.277565 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb7b60-182f-4015-9690-faf19e9890c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:38.293997 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cacb7b60-182f-4015-9690-faf19e9890c0 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:38.295193 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cacb7b60-182f-4015-9690-faf19e9890c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:38.351151 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1357/2719] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:12:38.361229 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb7b60-182f-4015-9690-faf19e9890c0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:38.362572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cacb7b60-182f-4015-9690-faf19e9890c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:38.377153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1363/2720] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:12:38 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:12:38.378460 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21769d2d-e3a6-44da-a7e6-fc34c07c7ac2 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:38.380070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-21769d2d-e3a6-44da-a7e6-fc34c07c7ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:38.391865 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21769d2d-e3a6-44da-a7e6-fc34c07c7ac2 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:38.396584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bf326-5cad-4c63-bc53-c61cf66ddc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:38.397266 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf326-5cad-4c63-bc53-c61cf66ddc5b admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:38.397575 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf326-5cad-4c63-bc53-c61cf66ddc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:38.397856 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf326-5cad-4c63-bc53-c61cf66ddc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:38.398581 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bf326-5cad-4c63-bc53-c61cf66ddc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:38.400171 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bf326-5cad-4c63-bc53-c61cf66ddc5b admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:38.410364 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1364/2721] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:38.414418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bf326-5cad-4c63-bc53-c61cf66ddc5b admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:38.420845 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb7b60-182f-4015-9690-faf19e9890c0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:38.424278 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bf326-5cad-4c63-bc53-c61cf66ddc5b admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:38.429059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af972c-45a6-4cf4-b9ef-0c8a02892e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:38.429059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af972c-45a6-4cf4-b9ef-0c8a02892e19 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:38.429059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af972c-45a6-4cf4-b9ef-0c8a02892e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:38.429059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af972c-45a6-4cf4-b9ef-0c8a02892e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:38.429455 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc74da-022e-4ddc-a0ee-e7720358b540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:38.429595 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc74da-022e-4ddc-a0ee-e7720358b540 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:38.429807 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc74da-022e-4ddc-a0ee-e7720358b540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:38.430083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc74da-022e-4ddc-a0ee-e7720358b540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:38.430791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc74da-022e-4ddc-a0ee-e7720358b540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:38.432370 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc74da-022e-4ddc-a0ee-e7720358b540 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:38.436540 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af972c-45a6-4cf4-b9ef-0c8a02892e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:38.438010 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af972c-45a6-4cf4-b9ef-0c8a02892e19 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:38.443288 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1365/2722] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:12:38.447365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc74da-022e-4ddc-a0ee-e7720358b540 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:38.448493 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1358/2723] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:12:38.457054 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc74da-022e-4ddc-a0ee-e7720358b540 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:38.461806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98e7a0-ed1c-4891-be43-6e6883c0efca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:38.462680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e7a0-ed1c-4891-be43-6e6883c0efca admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:38.462965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e7a0-ed1c-4891-be43-6e6883c0efca admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:38.463242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98e7a0-ed1c-4891-be43-6e6883c0efca admin admin] PATH_INFO: `/v3/projects/ffc2f645c2fb4fb1baf86bfa44be2d56/users/5f921c3ec5a44c49a6ee9903e56b6d62/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:38.478191 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98e7a0-ed1c-4891-be43-6e6883c0efca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc2f645c2fb4fb1baf86bfa44be2d56, user_id=5f921c3ec5a44c49a6ee9903e56b6d62, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:38.480955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98e7a0-ed1c-4891-be43-6e6883c0efca admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:38.607347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1366/2724] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:38 2022] PUT /identity/v3/projects/ffc2f645c2fb4fb1baf86bfa44be2d56/users/5f921c3ec5a44c49a6ee9903e56b6d62/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:12:38.611623 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39837fe2-3b96-4461-87c3-7627dc1f0953 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:38.612008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39837fe2-3b96-4461-87c3-7627dc1f0953 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:38.612350 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39837fe2-3b96-4461-87c3-7627dc1f0953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:38.629690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-39837fe2-3b96-4461-87c3-7627dc1f0953 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:38.631132 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-39837fe2-3b96-4461-87c3-7627dc1f0953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:38.710235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1359/2725] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:38.719530 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98e7a0-ed1c-4891-be43-6e6883c0efca admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:38.779144 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98e7a0-ed1c-4891-be43-6e6883c0efca admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:38.783422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e674197-01e7-4054-a599-270627614254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:38.784079 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e674197-01e7-4054-a599-270627614254 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:38.784378 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e674197-01e7-4054-a599-270627614254 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:38.784656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e674197-01e7-4054-a599-270627614254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:38.794256 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e674197-01e7-4054-a599-270627614254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:38.795820 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e674197-01e7-4054-a599-270627614254 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:38.805980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1367/2726] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:12:38.906649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39837fe2-3b96-4461-87c3-7627dc1f0953 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:38.908730 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-39837fe2-3b96-4461-87c3-7627dc1f0953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:38.923077 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39837fe2-3b96-4461-87c3-7627dc1f0953 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:38.928856 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:38.929765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:38.929765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:38.930001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] PATH_INFO: `/v3/projects/470fa3cca4fa4c5084f6050cc5a1d845` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:38.931988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=470fa3cca4fa4c5084f6050cc5a1d845)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:38.934540 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:39.047949 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '470fa3cca4fa4c5084f6050cc5a1d845', 'request_id': 'req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:39.053977 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '470fa3cca4fa4c5084f6050cc5a1d845', 'request_id': 'req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:39.059483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '470fa3cca4fa4c5084f6050cc5a1d845', 'request_id': 'req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:39.173831 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] The token cache is being invalidate because project 470fa3cca4fa4c5084f6050cc5a1d845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:39.174491 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:39.177839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:39.177839 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1360/2727] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:38 2022] DELETE /identity/v3/projects/470fa3cca4fa4c5084f6050cc5a1d845 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:39.180238 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e674197-01e7-4054-a599-270627614254 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:39.191915 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e674197-01e7-4054-a599-270627614254 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:39.249889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501bd22-88f0-41b2-8fa7-5715a992abb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:39.250814 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501bd22-88f0-41b2-8fa7-5715a992abb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:39.251157 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501bd22-88f0-41b2-8fa7-5715a992abb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:39.251333 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501bd22-88f0-41b2-8fa7-5715a992abb6 admin admin] PATH_INFO: `/v3/users/b874d596b2104bef948be98619a51f75` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:39.253120 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501bd22-88f0-41b2-8fa7-5715a992abb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b874d596b2104bef948be98619a51f75)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:39.255132 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501bd22-88f0-41b2-8fa7-5715a992abb6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:39.410741 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5501bd22-88f0-41b2-8fa7-5715a992abb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b874d596b2104bef948be98619a51f75'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:39.516615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5501bd22-88f0-41b2-8fa7-5715a992abb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b874d596b2104bef948be98619a51f75'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:39.525035 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5501bd22-88f0-41b2-8fa7-5715a992abb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b874d596b2104bef948be98619a51f75'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:39.525880 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5501bd22-88f0-41b2-8fa7-5715a992abb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b874d596b2104bef948be98619a51f75'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:39.526551 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-5501bd22-88f0-41b2-8fa7-5715a992abb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b874d596b2104bef948be98619a51f75'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:39.545275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1368/2728] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:39 2022] DELETE /identity/v3/users/b874d596b2104bef948be98619a51f75 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:12:39.923835 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:39.925656 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:39.939746 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce82cfa-b4c7-41c8-abe3-31bb6623cb0c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:40.001866 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4256b11-61f2-4c6e-9979-5a0fef5000f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:40.002739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256b11-61f2-4c6e-9979-5a0fef5000f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:40.003029 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256b11-61f2-4c6e-9979-5a0fef5000f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:40.003289 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256b11-61f2-4c6e-9979-5a0fef5000f8 admin admin] PATH_INFO: `/v3/projects/5b1d84200fe34a7eb98da0e8c4d4feaa` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:40.004676 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4256b11-61f2-4c6e-9979-5a0fef5000f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1d84200fe34a7eb98da0e8c4d4feaa)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:40.006690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4256b11-61f2-4c6e-9979-5a0fef5000f8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:40.125808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d4256b11-61f2-4c6e-9979-5a0fef5000f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1d84200fe34a7eb98da0e8c4d4feaa', 'request_id': 'req-d4256b11-61f2-4c6e-9979-5a0fef5000f8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:40.131767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d4256b11-61f2-4c6e-9979-5a0fef5000f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1d84200fe34a7eb98da0e8c4d4feaa', 'request_id': 'req-d4256b11-61f2-4c6e-9979-5a0fef5000f8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:40.136905 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d4256b11-61f2-4c6e-9979-5a0fef5000f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1d84200fe34a7eb98da0e8c4d4feaa', 'request_id': 'req-d4256b11-61f2-4c6e-9979-5a0fef5000f8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:40.224608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d4256b11-61f2-4c6e-9979-5a0fef5000f8 admin admin] The token cache is being invalidate because project 5b1d84200fe34a7eb98da0e8c4d4feaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:40.225120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d4256b11-61f2-4c6e-9979-5a0fef5000f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:40.225721 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d4256b11-61f2-4c6e-9979-5a0fef5000f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:40.227281 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1361/2729] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:39 2022] DELETE /identity/v3/projects/5b1d84200fe34a7eb98da0e8c4d4feaa => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:40.232370 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb87bcb-b743-4c49-a53c-66255da79c06 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:40.232872 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb87bcb-b743-4c49-a53c-66255da79c06 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:40.232962 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb87bcb-b743-4c49-a53c-66255da79c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:40.253700 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ffb87bcb-b743-4c49-a53c-66255da79c06 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:40.255236 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ffb87bcb-b743-4c49-a53c-66255da79c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:40.333664 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1369/2730] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:12:40.335607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a05a78-02c6-4354-a3c3-2c9135c9bc31 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:40.335964 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a05a78-02c6-4354-a3c3-2c9135c9bc31 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:40.336311 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a05a78-02c6-4354-a3c3-2c9135c9bc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:40.366719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d2a05a78-02c6-4354-a3c3-2c9135c9bc31 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:40.368495 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d2a05a78-02c6-4354-a3c3-2c9135c9bc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:40.382090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1362/2731] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:40.383156 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb87bcb-b743-4c49-a53c-66255da79c06 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:40.394138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb87bcb-b743-4c49-a53c-66255da79c06 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:40.399422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5b03d-4939-41f6-8d99-1e5066d24c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:40.400117 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5b03d-4939-41f6-8d99-1e5066d24c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:40.400402 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5b03d-4939-41f6-8d99-1e5066d24c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:40.400688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5b03d-4939-41f6-8d99-1e5066d24c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:40.401417 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5b03d-4939-41f6-8d99-1e5066d24c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:12:40.402069 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5b03d-4939-41f6-8d99-1e5066d24c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:40.403680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5b03d-4939-41f6-8d99-1e5066d24c07 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:40.430184 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1370/2732] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:12:40.435214 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a05a78-02c6-4354-a3c3-2c9135c9bc31 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:40.448041 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a05a78-02c6-4354-a3c3-2c9135c9bc31 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:40.454368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566db347-bfd3-4790-af70-64f54df942c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:40.455795 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db347-bfd3-4790-af70-64f54df942c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:40.456085 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db347-bfd3-4790-af70-64f54df942c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:40.456358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db347-bfd3-4790-af70-64f54df942c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:40.457245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566db347-bfd3-4790-af70-64f54df942c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:40.460134 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566db347-bfd3-4790-af70-64f54df942c1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:40.577387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1363/2733] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:12:40 2022] POST /identity/v3/projects => generated 399 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:12:40.578571 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5b03d-4939-41f6-8d99-1e5066d24c07 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:40.588626 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5b03d-4939-41f6-8d99-1e5066d24c07 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:40.647749 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a712d2c-3b76-4600-be5d-e6c6a073c587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:40.648634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a712d2c-3b76-4600-be5d-e6c6a073c587 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:40.648756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a712d2c-3b76-4600-be5d-e6c6a073c587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:40.648982 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a712d2c-3b76-4600-be5d-e6c6a073c587 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:40.649712 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a712d2c-3b76-4600-be5d-e6c6a073c587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:40.651744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a712d2c-3b76-4600-be5d-e6c6a073c587 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:40.768806 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1371/2734] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:12:40 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:12:40.772701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566db347-bfd3-4790-af70-64f54df942c1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:40.785179 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566db347-bfd3-4790-af70-64f54df942c1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:40.790011 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae7ba5-75f8-4ae8-91d7-c519de169486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:40.790685 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7ba5-75f8-4ae8-91d7-c519de169486 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:40.790971 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7ba5-75f8-4ae8-91d7-c519de169486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:40.791250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7ba5-75f8-4ae8-91d7-c519de169486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:40.792006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae7ba5-75f8-4ae8-91d7-c519de169486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:40.793753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae7ba5-75f8-4ae8-91d7-c519de169486 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:40.805546 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1364/2735] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:40.809819 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a712d2c-3b76-4600-be5d-e6c6a073c587 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:40.819896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a712d2c-3b76-4600-be5d-e6c6a073c587 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:40.828262 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1130ef-5b80-4591-9a97-a3c9e0ee1189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:40.829023 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1130ef-5b80-4591-9a97-a3c9e0ee1189 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:40.829314 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1130ef-5b80-4591-9a97-a3c9e0ee1189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:40.829648 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1130ef-5b80-4591-9a97-a3c9e0ee1189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:40.830385 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1130ef-5b80-4591-9a97-a3c9e0ee1189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:40.832012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1130ef-5b80-4591-9a97-a3c9e0ee1189 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:40.851230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1372/2736] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:40.855263 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae7ba5-75f8-4ae8-91d7-c519de169486 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:40.867803 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae7ba5-75f8-4ae8-91d7-c519de169486 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:40.872807 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb32fd-9fc9-4613-a580-39e00e995229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:40.873804 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb32fd-9fc9-4613-a580-39e00e995229 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:40.874139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb32fd-9fc9-4613-a580-39e00e995229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:40.874736 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb32fd-9fc9-4613-a580-39e00e995229 admin admin] PATH_INFO: `/v3/projects/4f79506c044944e0ad33370f8959c812/users/4ab4117d7ee9450086e07da53ff857de/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:40.892597 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb32fd-9fc9-4613-a580-39e00e995229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f79506c044944e0ad33370f8959c812, user_id=4ab4117d7ee9450086e07da53ff857de, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:40.895390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb32fd-9fc9-4613-a580-39e00e995229 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:41.022275 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1365/2737] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:40 2022] PUT /identity/v3/projects/4f79506c044944e0ad33370f8959c812/users/4ab4117d7ee9450086e07da53ff857de/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:41.033321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a3cf-2e38-433e-9ecb-d9f3106047ac None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:41.033713 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a3cf-2e38-433e-9ecb-d9f3106047ac None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:41.034065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a3cf-2e38-433e-9ecb-d9f3106047ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:41.067997 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2306a3cf-2e38-433e-9ecb-d9f3106047ac None None] MFA Rules not processed for user `4ab4117d7ee9450086e07da53ff857de`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:41.069472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2306a3cf-2e38-433e-9ecb-d9f3106047ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:41.169796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1373/2738] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:41.173267 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb32fd-9fc9-4613-a580-39e00e995229 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:41.258741 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb32fd-9fc9-4613-a580-39e00e995229 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:41.263869 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92a844-a2e2-4ceb-aa82-72f5a5a669dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:41.264582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92a844-a2e2-4ceb-aa82-72f5a5a669dd admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:41.264865 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92a844-a2e2-4ceb-aa82-72f5a5a669dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:41.265137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92a844-a2e2-4ceb-aa82-72f5a5a669dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:41.265994 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92a844-a2e2-4ceb-aa82-72f5a5a669dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:41.268637 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92a844-a2e2-4ceb-aa82-72f5a5a669dd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:41.372475 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1366/2739] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:12:41 2022] POST /identity/v3/projects => generated 399 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:41.376549 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306a3cf-2e38-433e-9ecb-d9f3106047ac None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:41.393846 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306a3cf-2e38-433e-9ecb-d9f3106047ac None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:41.469980 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43069625-169d-431f-8de7-8916d00db8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:41.470696 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069625-169d-431f-8de7-8916d00db8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:41.470983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069625-169d-431f-8de7-8916d00db8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:41.471262 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43069625-169d-431f-8de7-8916d00db8a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:41.472011 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43069625-169d-431f-8de7-8916d00db8a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:41.474117 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43069625-169d-431f-8de7-8916d00db8a5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:41.564593 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1374/2740] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:12:41 2022] POST /identity/v3/users => generated 306 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:12:41.566064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92a844-a2e2-4ceb-aa82-72f5a5a669dd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:41.577015 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92a844-a2e2-4ceb-aa82-72f5a5a669dd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:41.582317 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec5b17-3a04-406e-9a65-3affd98f48c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:41.582979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec5b17-3a04-406e-9a65-3affd98f48c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:41.583263 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec5b17-3a04-406e-9a65-3affd98f48c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:41.583542 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec5b17-3a04-406e-9a65-3affd98f48c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:41.584271 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec5b17-3a04-406e-9a65-3affd98f48c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:41.585919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec5b17-3a04-406e-9a65-3affd98f48c4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:41.598047 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1367/2741] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:41.602342 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43069625-169d-431f-8de7-8916d00db8a5 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:41.614040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43069625-169d-431f-8de7-8916d00db8a5 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:41.619185 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c6e05-ffd7-4614-91b1-a2abe3d56cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:41.620316 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c6e05-ffd7-4614-91b1-a2abe3d56cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:41.620601 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c6e05-ffd7-4614-91b1-a2abe3d56cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:41.620882 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c6e05-ffd7-4614-91b1-a2abe3d56cc7 admin admin] PATH_INFO: `/v3/projects/9a69c2cba0d048d581027c7f7daa8846/users/d0812f417ab845ac81a5991a700bc0c4/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:41.638503 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c6e05-ffd7-4614-91b1-a2abe3d56cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a69c2cba0d048d581027c7f7daa8846, user_id=d0812f417ab845ac81a5991a700bc0c4, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:41.641260 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c6e05-ffd7-4614-91b1-a2abe3d56cc7 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:41.707130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1375/2742] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:41 2022] PUT /identity/v3/projects/9a69c2cba0d048d581027c7f7daa8846/users/d0812f417ab845ac81a5991a700bc0c4/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:41.711517 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec5b17-3a04-406e-9a65-3affd98f48c4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:41.722150 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec5b17-3a04-406e-9a65-3affd98f48c4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:41.778920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a15b1-6a0e-4a9f-bf24-dc6b532fdcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:41.779526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a15b1-6a0e-4a9f-bf24-dc6b532fdcff admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:41.779807 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a15b1-6a0e-4a9f-bf24-dc6b532fdcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:41.780109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a15b1-6a0e-4a9f-bf24-dc6b532fdcff admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:41.780827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a15b1-6a0e-4a9f-bf24-dc6b532fdcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:41.782450 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a15b1-6a0e-4a9f-bf24-dc6b532fdcff admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:41.792018 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1368/2743] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:41.801826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c6e05-ffd7-4614-91b1-a2abe3d56cc7 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:41.809222 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c6e05-ffd7-4614-91b1-a2abe3d56cc7 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:41.816977 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88be88f-5ef0-4313-ad7c-2b044aab7fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:41.818017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88be88f-5ef0-4313-ad7c-2b044aab7fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:41.818383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88be88f-5ef0-4313-ad7c-2b044aab7fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:41.823078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88be88f-5ef0-4313-ad7c-2b044aab7fdd admin admin] PATH_INFO: `/v3/projects/9a69c2cba0d048d581027c7f7daa8846/users/d0812f417ab845ac81a5991a700bc0c4/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:41.830406 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88be88f-5ef0-4313-ad7c-2b044aab7fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a69c2cba0d048d581027c7f7daa8846, user_id=d0812f417ab845ac81a5991a700bc0c4, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:41.833688 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88be88f-5ef0-4313-ad7c-2b044aab7fdd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:41.845496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1376/2744] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:41 2022] PUT /identity/v3/projects/9a69c2cba0d048d581027c7f7daa8846/users/d0812f417ab845ac81a5991a700bc0c4/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:41.857341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ee2e4-6279-4ec4-8bd6-3a5485037300 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:41.857341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ee2e4-6279-4ec4-8bd6-3a5485037300 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:41.857341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ee2e4-6279-4ec4-8bd6-3a5485037300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:41.888756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-796ee2e4-6279-4ec4-8bd6-3a5485037300 None None] MFA Rules not processed for user `d0812f417ab845ac81a5991a700bc0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:41.890175 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-796ee2e4-6279-4ec4-8bd6-3a5485037300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:41.974398 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1369/2745] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:41.983506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88be88f-5ef0-4313-ad7c-2b044aab7fdd admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:41.987257 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e88be88f-5ef0-4313-ad7c-2b044aab7fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:42.059040 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88be88f-5ef0-4313-ad7c-2b044aab7fdd admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:42.062770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a13ea7-4fc6-4b22-9815-dc02cdee0648 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:42.063430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a13ea7-4fc6-4b22-9815-dc02cdee0648 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:42.063714 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a13ea7-4fc6-4b22-9815-dc02cdee0648 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:42.064573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a13ea7-4fc6-4b22-9815-dc02cdee0648 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:42.075372 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a13ea7-4fc6-4b22-9815-dc02cdee0648 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:42.076826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a13ea7-4fc6-4b22-9815-dc02cdee0648 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:42.094474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1377/2746] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:12:42.189884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ee2e4-6279-4ec4-8bd6-3a5485037300 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:42.190635 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-796ee2e4-6279-4ec4-8bd6-3a5485037300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:42.211230 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ee2e4-6279-4ec4-8bd6-3a5485037300 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:42.216946 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed6e7c-1c15-4a57-9fc4-9858f90b99f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:42.217639 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6e7c-1c15-4a57-9fc4-9858f90b99f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:42.219803 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6e7c-1c15-4a57-9fc4-9858f90b99f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:42.219803 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6e7c-1c15-4a57-9fc4-9858f90b99f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:42.220620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6eed6e7c-1c15-4a57-9fc4-9858f90b99f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:42.306047 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed6e7c-1c15-4a57-9fc4-9858f90b99f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:42.307480 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed6e7c-1c15-4a57-9fc4-9858f90b99f7 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:42.317957 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1370/2747] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:12:42.340538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a13ea7-4fc6-4b22-9815-dc02cdee0648 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:42.351141 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a13ea7-4fc6-4b22-9815-dc02cdee0648 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:42.355914 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691c516-700e-4d30-a417-0a5827a3c191 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:42.356732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691c516-700e-4d30-a417-0a5827a3c191 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:42.361777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691c516-700e-4d30-a417-0a5827a3c191 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:42.361777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691c516-700e-4d30-a417-0a5827a3c191 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:42.439635 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691c516-700e-4d30-a417-0a5827a3c191 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:42.445026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691c516-700e-4d30-a417-0a5827a3c191 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:42.455818 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1378/2748] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:12:44.727253 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2dd5c-2dd3-4dc1-a8c8-221a64731857 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:44.727696 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2dd5c-2dd3-4dc1-a8c8-221a64731857 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:44.727780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2dd5c-2dd3-4dc1-a8c8-221a64731857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:44.758446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-79a2dd5c-2dd3-4dc1-a8c8-221a64731857 None None] MFA Rules not processed for user `5f921c3ec5a44c49a6ee9903e56b6d62`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:44.759653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-79a2dd5c-2dd3-4dc1-a8c8-221a64731857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:44.833081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1371/2749] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:44.834258 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691c516-700e-4d30-a417-0a5827a3c191 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:44.835743 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6691c516-700e-4d30-a417-0a5827a3c191 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:44.912274 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691c516-700e-4d30-a417-0a5827a3c191 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:44.916858 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32026348-0bea-41f6-a56a-9bb93a2add6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:44.917553 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32026348-0bea-41f6-a56a-9bb93a2add6c admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:44.917848 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32026348-0bea-41f6-a56a-9bb93a2add6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:44.918127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32026348-0bea-41f6-a56a-9bb93a2add6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:44.918837 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32026348-0bea-41f6-a56a-9bb93a2add6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:44.920763 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32026348-0bea-41f6-a56a-9bb93a2add6c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:45.116091 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1379/2750] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:12:44 2022] POST /identity/v3/projects => generated 383 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:12:45.117319 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2dd5c-2dd3-4dc1-a8c8-221a64731857 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:45.129487 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2dd5c-2dd3-4dc1-a8c8-221a64731857 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:45.190471 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0337f-75be-49ec-b17f-8739c0da238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:45.191159 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0337f-75be-49ec-b17f-8739c0da238b admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:45.191459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0337f-75be-49ec-b17f-8739c0da238b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:45.191706 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0337f-75be-49ec-b17f-8739c0da238b admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:45.192411 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0337f-75be-49ec-b17f-8739c0da238b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:45.194627 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0337f-75be-49ec-b17f-8739c0da238b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:45.259875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1372/2751] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:12:45 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:12:45.266754 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32026348-0bea-41f6-a56a-9bb93a2add6c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:45.274581 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32026348-0bea-41f6-a56a-9bb93a2add6c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:45.284081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f2355-2acf-4b82-a6d9-ee2ce5676e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:45.284764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f2355-2acf-4b82-a6d9-ee2ce5676e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:45.285178 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f2355-2acf-4b82-a6d9-ee2ce5676e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:45.285521 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f2355-2acf-4b82-a6d9-ee2ce5676e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:45.286301 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f2355-2acf-4b82-a6d9-ee2ce5676e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:45.287915 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f2355-2acf-4b82-a6d9-ee2ce5676e35 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:45.299821 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1380/2752] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:12:45.304024 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0337f-75be-49ec-b17f-8739c0da238b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:45.314647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0337f-75be-49ec-b17f-8739c0da238b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:45.319751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851bc11-276d-4e78-84e9-24ea8c751a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:45.320407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851bc11-276d-4e78-84e9-24ea8c751a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:45.320694 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851bc11-276d-4e78-84e9-24ea8c751a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:45.321092 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851bc11-276d-4e78-84e9-24ea8c751a39 admin admin] PATH_INFO: `/v3/projects/2c294bc841144b2ca54af55fa25f1497/users/7abd4a2b6a33476dbd37dfc92f634633/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:45.346867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851bc11-276d-4e78-84e9-24ea8c751a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c294bc841144b2ca54af55fa25f1497, user_id=7abd4a2b6a33476dbd37dfc92f634633, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:45.349907 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851bc11-276d-4e78-84e9-24ea8c751a39 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:45.472668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1373/2753] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:45 2022] PUT /identity/v3/projects/2c294bc841144b2ca54af55fa25f1497/users/7abd4a2b6a33476dbd37dfc92f634633/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:45.476397 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f2355-2acf-4b82-a6d9-ee2ce5676e35 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:45.487465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f2355-2acf-4b82-a6d9-ee2ce5676e35 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:45.545254 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a85e6-cb55-4d77-afd3-bd09be0429ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:45.545976 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a85e6-cb55-4d77-afd3-bd09be0429ef admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:45.546265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a85e6-cb55-4d77-afd3-bd09be0429ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:45.546540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a85e6-cb55-4d77-afd3-bd09be0429ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:45.547275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a85e6-cb55-4d77-afd3-bd09be0429ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:45.549517 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a85e6-cb55-4d77-afd3-bd09be0429ef admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:45.559757 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1381/2754] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:12:45.564112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851bc11-276d-4e78-84e9-24ea8c751a39 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:45.574543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851bc11-276d-4e78-84e9-24ea8c751a39 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:45.579795 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b885b5-f837-474d-9528-963a620118a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:45.580703 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b885b5-f837-474d-9528-963a620118a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:45.580989 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b885b5-f837-474d-9528-963a620118a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:45.581497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b885b5-f837-474d-9528-963a620118a7 admin admin] PATH_INFO: `/v3/projects/2c294bc841144b2ca54af55fa25f1497/users/7abd4a2b6a33476dbd37dfc92f634633/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:45.583307 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b885b5-f837-474d-9528-963a620118a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c294bc841144b2ca54af55fa25f1497, user_id=7abd4a2b6a33476dbd37dfc92f634633, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:45.586482 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b885b5-f837-474d-9528-963a620118a7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:45.597687 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1374/2755] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:12:45 2022] PUT /identity/v3/projects/2c294bc841144b2ca54af55fa25f1497/users/7abd4a2b6a33476dbd37dfc92f634633/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:51.166192 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a85e6-cb55-4d77-afd3-bd09be0429ef admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:51.171092 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b885b5-f837-474d-9528-963a620118a7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:51.173125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a3b885b5-f837-474d-9528-963a620118a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:51.176569 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a85e6-cb55-4d77-afd3-bd09be0429ef admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:51.285013 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7000d8b-2730-4eb2-9ab2-d2ae9f0d2bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:51.286541 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7000d8b-2730-4eb2-9ab2-d2ae9f0d2bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:51.287077 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7000d8b-2730-4eb2-9ab2-d2ae9f0d2bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:51.287606 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7000d8b-2730-4eb2-9ab2-d2ae9f0d2bd5 admin admin] PATH_INFO: `/v3/users/4ab4117d7ee9450086e07da53ff857de` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:51.289275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7000d8b-2730-4eb2-9ab2-d2ae9f0d2bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ab4117d7ee9450086e07da53ff857de)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:51.291512 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7000d8b-2730-4eb2-9ab2-d2ae9f0d2bd5 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:51.344700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b885b5-f837-474d-9528-963a620118a7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:51.357201 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2a4e0-ef6d-47c9-9103-9f7567c699ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59cb32d2807549699e37b27ca97d351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:51.358472 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2a4e0-ef6d-47c9-9103-9f7567c699ac service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:51.359554 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2a4e0-ef6d-47c9-9103-9f7567c699ac service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:51.359833 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2a4e0-ef6d-47c9-9103-9f7567c699ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:51.370414 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-61f2a4e0-ef6d-47c9-9103-9f7567c699ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:51.390395 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2a4e0-ef6d-47c9-9103-9f7567c699ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:51.393122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2a4e0-ef6d-47c9-9103-9f7567c699ac service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:51.447793 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1375/2756] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:12:51.536174 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7000d8b-2730-4eb2-9ab2-d2ae9f0d2bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ab4117d7ee9450086e07da53ff857de'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:51.613751 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cca84c-aa0a-4135-be9c-ac26c0221bc4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:51.616759 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7000d8b-2730-4eb2-9ab2-d2ae9f0d2bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ab4117d7ee9450086e07da53ff857de'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:51.617004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cca84c-aa0a-4135-be9c-ac26c0221bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:51.617004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cca84c-aa0a-4135-be9c-ac26c0221bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:51.623659 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7000d8b-2730-4eb2-9ab2-d2ae9f0d2bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ab4117d7ee9450086e07da53ff857de'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:51.624528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7000d8b-2730-4eb2-9ab2-d2ae9f0d2bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ab4117d7ee9450086e07da53ff857de'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:51.625218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-e7000d8b-2730-4eb2-9ab2-d2ae9f0d2bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ab4117d7ee9450086e07da53ff857de'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:51.646196 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1382/2757] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:51 2022] DELETE /identity/v3/users/4ab4117d7ee9450086e07da53ff857de => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:51.650877 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bf275-90f2-42b9-a9d4-b0436f4cae39 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:51.651268 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f8cca84c-aa0a-4135-be9c-ac26c0221bc4 None None] MFA Rules not processed for user `7abd4a2b6a33476dbd37dfc92f634633`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:51.651604 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bf275-90f2-42b9-a9d4-b0436f4cae39 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:51.652275 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bf275-90f2-42b9-a9d4-b0436f4cae39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:51.652966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f8cca84c-aa0a-4135-be9c-ac26c0221bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:51.670785 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-9a3bf275-90f2-42b9-a9d4-b0436f4cae39 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:51.672076 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9a3bf275-90f2-42b9-a9d4-b0436f4cae39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:51.736970 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1376/2758] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:51.739699 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1383/2759] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:12:51.749640 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cca84c-aa0a-4135-be9c-ac26c0221bc4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:51.751884 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f8cca84c-aa0a-4135-be9c-ac26c0221bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:51.754083 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bf275-90f2-42b9-a9d4-b0436f4cae39 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:51.755312 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9a3bf275-90f2-42b9-a9d4-b0436f4cae39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:51.813198 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cca84c-aa0a-4135-be9c-ac26c0221bc4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:51.816363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bf275-90f2-42b9-a9d4-b0436f4cae39 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:51.817634 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d6c77-b6c1-4eec-8787-ad55a47ee3c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce12ee27315460793dfedd294eb3c55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:51.822525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d6c77-b6c1-4eec-8787-ad55a47ee3c9 service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:51.822525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d6c77-b6c1-4eec-8787-ad55a47ee3c9 service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:51.822525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d6c77-b6c1-4eec-8787-ad55a47ee3c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:51.822525 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c38d6c77-b6c1-4eec-8787-ad55a47ee3c9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:51.825788 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139dea6-3655-47c0-82ba-278208008f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:51.826472 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139dea6-3655-47c0-82ba-278208008f03 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:51.826744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139dea6-3655-47c0-82ba-278208008f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:51.827205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139dea6-3655-47c0-82ba-278208008f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:51.837486 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139dea6-3655-47c0-82ba-278208008f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:51.839244 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139dea6-3655-47c0-82ba-278208008f03 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:51.849622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1384/2760] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:12:51.899176 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d6c77-b6c1-4eec-8787-ad55a47ee3c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:51.902559 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d6c77-b6c1-4eec-8787-ad55a47ee3c9 service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:51.912536 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1377/2761] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:12:52.156221 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ff9eb-7dfd-4c54-86bb-c32bf43421fb None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:52.156540 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ff9eb-7dfd-4c54-86bb-c32bf43421fb None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:52.156826 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ff9eb-7dfd-4c54-86bb-c32bf43421fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:52.176383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-8b5ff9eb-7dfd-4c54-86bb-c32bf43421fb None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:52.177303 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8b5ff9eb-7dfd-4c54-86bb-c32bf43421fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:52.239294 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1385/2762] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:52.291629 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d6c77-b6c1-4eec-8787-ad55a47ee3c9 service glance] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:52.293081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c38d6c77-b6c1-4eec-8787-ad55a47ee3c9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:52.307390 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d6c77-b6c1-4eec-8787-ad55a47ee3c9 service glance] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:52.312502 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:52.313367 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:52.313690 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:52.313968 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] PATH_INFO: `/v3/projects/4f79506c044944e0ad33370f8959c812` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:52.315251 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f79506c044944e0ad33370f8959c812)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:52.317249 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:52.412505 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ff9eb-7dfd-4c54-86bb-c32bf43421fb None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:52.414078 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-8b5ff9eb-7dfd-4c54-86bb-c32bf43421fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:52.476910 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f79506c044944e0ad33370f8959c812', 'request_id': 'req-f627c46a-4385-499b-9ab1-24e267dacce3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:52.483248 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f79506c044944e0ad33370f8959c812', 'request_id': 'req-f627c46a-4385-499b-9ab1-24e267dacce3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:52.483415 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ff9eb-7dfd-4c54-86bb-c32bf43421fb None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:52.489834 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f79506c044944e0ad33370f8959c812', 'request_id': 'req-f627c46a-4385-499b-9ab1-24e267dacce3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:52.547758 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8726f33-a90b-4753-afaf-2292c4f341eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:52.548449 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8726f33-a90b-4753-afaf-2292c4f341eb service swift] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:52.548748 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8726f33-a90b-4753-afaf-2292c4f341eb service swift] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:52.549029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8726f33-a90b-4753-afaf-2292c4f341eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:52.608939 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8726f33-a90b-4753-afaf-2292c4f341eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:52.610747 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8726f33-a90b-4753-afaf-2292c4f341eb service swift] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:52.615992 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] The token cache is being invalidate because project 4f79506c044944e0ad33370f8959c812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:52.616552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:52.620815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:52.621205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1386/2763] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:12:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 21:12:52.625859 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1378/2764] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:52 2022] DELETE /identity/v3/projects/4f79506c044944e0ad33370f8959c812 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:52.630719 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8726f33-a90b-4753-afaf-2292c4f341eb service swift] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:52.721494 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8726f33-a90b-4753-afaf-2292c4f341eb service swift] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:52.731621 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c93c34-93a8-40a5-9e90-5bd866bd4e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:52.732528 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93c34-93a8-40a5-9e90-5bd866bd4e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:52.732815 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93c34-93a8-40a5-9e90-5bd866bd4e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:52.733148 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93c34-93a8-40a5-9e90-5bd866bd4e5f admin admin] PATH_INFO: `/v3/users/d0812f417ab845ac81a5991a700bc0c4` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:52.734598 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c93c34-93a8-40a5-9e90-5bd866bd4e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0812f417ab845ac81a5991a700bc0c4)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:52.736595 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c93c34-93a8-40a5-9e90-5bd866bd4e5f admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:52.948947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75c93c34-93a8-40a5-9e90-5bd866bd4e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0812f417ab845ac81a5991a700bc0c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:53.028340 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75c93c34-93a8-40a5-9e90-5bd866bd4e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0812f417ab845ac81a5991a700bc0c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:53.034791 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75c93c34-93a8-40a5-9e90-5bd866bd4e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0812f417ab845ac81a5991a700bc0c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:53.036225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75c93c34-93a8-40a5-9e90-5bd866bd4e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0812f417ab845ac81a5991a700bc0c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:53.037042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-75c93c34-93a8-40a5-9e90-5bd866bd4e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0812f417ab845ac81a5991a700bc0c4'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:53.063189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1387/2765] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:52 2022] DELETE /identity/v3/users/d0812f417ab845ac81a5991a700bc0c4 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:53.643650 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:53.648125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:53.666822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627c46a-4385-499b-9ab1-24e267dacce3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:53.756478 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:53.757704 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:53.758181 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:53.758664 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a admin admin] PATH_INFO: `/v3/projects/9a69c2cba0d048d581027c7f7daa8846` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:53.762473 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a69c2cba0d048d581027c7f7daa8846)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:53.764675 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:53.871112 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a69c2cba0d048d581027c7f7daa8846', 'request_id': 'req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:53.878891 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a69c2cba0d048d581027c7f7daa8846', 'request_id': 'req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:53.887272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a69c2cba0d048d581027c7f7daa8846', 'request_id': 'req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:53.952497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a admin admin] The token cache is being invalidate because project 9a69c2cba0d048d581027c7f7daa8846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:53.952715 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:53.954564 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bd7f7446-ac3d-45fb-8c75-a8edad223a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:53.957088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1379/2766] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:53 2022] DELETE /identity/v3/projects/9a69c2cba0d048d581027c7f7daa8846 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:57.039320 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c93c34-93a8-40a5-9e90-5bd866bd4e5f admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:57.041465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-75c93c34-93a8-40a5-9e90-5bd866bd4e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:57.057318 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c93c34-93a8-40a5-9e90-5bd866bd4e5f admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:57.123342 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c509d3-b2c7-4166-9c3d-a1bced3b8d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:57.124465 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c509d3-b2c7-4166-9c3d-a1bced3b8d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:57.124638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c509d3-b2c7-4166-9c3d-a1bced3b8d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:57.125870 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c509d3-b2c7-4166-9c3d-a1bced3b8d5c admin admin] PATH_INFO: `/v3/users/38fa3a995af749288bb630a30cb13771` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:57.126584 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c509d3-b2c7-4166-9c3d-a1bced3b8d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fa3a995af749288bb630a30cb13771)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:57.128573 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c509d3-b2c7-4166-9c3d-a1bced3b8d5c admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:57.320026 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2c509d3-b2c7-4166-9c3d-a1bced3b8d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fa3a995af749288bb630a30cb13771'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:57.395576 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2c509d3-b2c7-4166-9c3d-a1bced3b8d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fa3a995af749288bb630a30cb13771'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:57.404135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2c509d3-b2c7-4166-9c3d-a1bced3b8d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fa3a995af749288bb630a30cb13771'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:57.404837 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2c509d3-b2c7-4166-9c3d-a1bced3b8d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fa3a995af749288bb630a30cb13771'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:57.405474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2c509d3-b2c7-4166-9c3d-a1bced3b8d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fa3a995af749288bb630a30cb13771'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:57.425859 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1388/2767] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:57 2022] DELETE /identity/v3/users/38fa3a995af749288bb630a30cb13771 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:57.431176 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caea9d0-a81e-449f-9a02-67be30949ff0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:57.431176 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caea9d0-a81e-449f-9a02-67be30949ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:57.431176 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caea9d0-a81e-449f-9a02-67be30949ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:57.450313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8caea9d0-a81e-449f-9a02-67be30949ff0 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:57.451882 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8caea9d0-a81e-449f-9a02-67be30949ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:57.520228 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1380/2768] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:57.528170 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c509d3-b2c7-4166-9c3d-a1bced3b8d5c admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:57.530931 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f2c509d3-b2c7-4166-9c3d-a1bced3b8d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:57.596753 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c509d3-b2c7-4166-9c3d-a1bced3b8d5c admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:57.600853 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc70da-b090-4e56-9b7a-fcfe1aa509c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:57.601637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc70da-b090-4e56-9b7a-fcfe1aa509c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:57.601910 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc70da-b090-4e56-9b7a-fcfe1aa509c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:57.602191 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc70da-b090-4e56-9b7a-fcfe1aa509c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:57.612822 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc70da-b090-4e56-9b7a-fcfe1aa509c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:57.614327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc70da-b090-4e56-9b7a-fcfe1aa509c0 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:57.625138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1389/2769] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:12:58.102338 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caea9d0-a81e-449f-9a02-67be30949ff0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:58.104287 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8caea9d0-a81e-449f-9a02-67be30949ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:58.119854 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caea9d0-a81e-449f-9a02-67be30949ff0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:58.131885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:58.132870 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:58.133210 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:58.133590 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] PATH_INFO: `/v3/projects/d861a5454d2c4e958c3d2dc0ff9de841` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:58.134873 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d861a5454d2c4e958c3d2dc0ff9de841)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:58.137172 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:58.248950 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd861a5454d2c4e958c3d2dc0ff9de841', 'request_id': 'req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:58.255592 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd861a5454d2c4e958c3d2dc0ff9de841', 'request_id': 'req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:58.264113 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd861a5454d2c4e958c3d2dc0ff9de841', 'request_id': 'req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:58.385882 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] The token cache is being invalidate because project d861a5454d2c4e958c3d2dc0ff9de841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:58.386543 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:58.387379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:58.389582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1381/2770] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:58 2022] DELETE /identity/v3/projects/d861a5454d2c4e958c3d2dc0ff9de841 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:58.393900 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc70da-b090-4e56-9b7a-fcfe1aa509c0 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:58.405326 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc70da-b090-4e56-9b7a-fcfe1aa509c0 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:58.471970 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f15ec-7966-420e-96f6-b4e88adeeffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:58.472926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f15ec-7966-420e-96f6-b4e88adeeffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:58.472926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f15ec-7966-420e-96f6-b4e88adeeffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:58.475101 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f15ec-7966-420e-96f6-b4e88adeeffd admin admin] PATH_INFO: `/v3/users/759fecc4d98649e4a7dc5ecc5ef16825` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:58.475101 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f15ec-7966-420e-96f6-b4e88adeeffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=759fecc4d98649e4a7dc5ecc5ef16825)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:58.476973 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f15ec-7966-420e-96f6-b4e88adeeffd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:58.685167 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-739f15ec-7966-420e-96f6-b4e88adeeffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759fecc4d98649e4a7dc5ecc5ef16825'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:58.779432 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-739f15ec-7966-420e-96f6-b4e88adeeffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759fecc4d98649e4a7dc5ecc5ef16825'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:58.787857 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-739f15ec-7966-420e-96f6-b4e88adeeffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759fecc4d98649e4a7dc5ecc5ef16825'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:58.788619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-739f15ec-7966-420e-96f6-b4e88adeeffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759fecc4d98649e4a7dc5ecc5ef16825'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:58.789239 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-739f15ec-7966-420e-96f6-b4e88adeeffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759fecc4d98649e4a7dc5ecc5ef16825'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:58.810367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1390/2771] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:12:58 2022] DELETE /identity/v3/users/759fecc4d98649e4a7dc5ecc5ef16825 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:59.518824 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:59.524889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:59.547852 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f38e6c-e3e5-4b0f-b2ec-7fdf60596e4f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:59.633191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:59.634065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:59.634353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:59.634633 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92 admin admin] PATH_INFO: `/v3/projects/87537beee46a4fbabf80c26acf77e229` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:59.635916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87537beee46a4fbabf80c26acf77e229)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:59.638148 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:12:59.745966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87537beee46a4fbabf80c26acf77e229', 'request_id': 'req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:59.752941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87537beee46a4fbabf80c26acf77e229', 'request_id': 'req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:59.758674 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87537beee46a4fbabf80c26acf77e229', 'request_id': 'req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:59.824626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92 admin admin] The token cache is being invalidate because project 87537beee46a4fbabf80c26acf77e229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:12:59.824926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:59.826668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-79e6bd9e-a9ae-4932-bb1f-e4bd43f02a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:12:59.833067 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1382/2772] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:12:59 2022] DELETE /identity/v3/projects/87537beee46a4fbabf80c26acf77e229 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:12:59.835925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a5904-7595-48c0-a607-0e338bb8463d None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:59.835925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a5904-7595-48c0-a607-0e338bb8463d None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:59.835925 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a5904-7595-48c0-a607-0e338bb8463d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:59.857347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3f5a5904-7595-48c0-a607-0e338bb8463d None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:59.858602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3f5a5904-7595-48c0-a607-0e338bb8463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:59.925307 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1391/2773] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:59.933716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeced9d-949d-4911-b53b-448f50989726 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:59.933716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeced9d-949d-4911-b53b-448f50989726 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:59.933716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeced9d-949d-4911-b53b-448f50989726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:59.953732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fbeced9d-949d-4911-b53b-448f50989726 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:12:59.955125 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fbeced9d-949d-4911-b53b-448f50989726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:12:59.965572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1383/2774] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:12:59.968262 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a5904-7595-48c0-a607-0e338bb8463d None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:12:59.978218 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a5904-7595-48c0-a607-0e338bb8463d None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:12:59.984731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fb932-ae93-4139-9fe2-3ec94c0fb9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:12:59.984731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fb932-ae93-4139-9fe2-3ec94c0fb9ff admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:12:59.984731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fb932-ae93-4139-9fe2-3ec94c0fb9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:12:59.984731 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fb932-ae93-4139-9fe2-3ec94c0fb9ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:12:59.985835 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fb932-ae93-4139-9fe2-3ec94c0fb9ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:12:59.986247 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fb932-ae93-4139-9fe2-3ec94c0fb9ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:12:59.987956 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fb932-ae93-4139-9fe2-3ec94c0fb9ff admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:00.001792 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1392/2775] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:13:00.005782 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeced9d-949d-4911-b53b-448f50989726 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:00.015585 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeced9d-949d-4911-b53b-448f50989726 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:00.020588 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ecb97-8481-48bf-ba55-9802469bed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:00.021441 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ecb97-8481-48bf-ba55-9802469bed62 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:00.021847 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ecb97-8481-48bf-ba55-9802469bed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:00.023961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ecb97-8481-48bf-ba55-9802469bed62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:00.023961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ecb97-8481-48bf-ba55-9802469bed62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:00.024893 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ecb97-8481-48bf-ba55-9802469bed62 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:00.113701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1384/2776] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:13:00 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:13:00.117310 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fb932-ae93-4139-9fe2-3ec94c0fb9ff admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:00.129025 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fb932-ae93-4139-9fe2-3ec94c0fb9ff admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:00.200367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebcc8b-5a8d-478b-aa2d-575fc1c71676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:00.201125 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebcc8b-5a8d-478b-aa2d-575fc1c71676 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:00.201484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebcc8b-5a8d-478b-aa2d-575fc1c71676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:00.201896 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebcc8b-5a8d-478b-aa2d-575fc1c71676 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:00.202637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebcc8b-5a8d-478b-aa2d-575fc1c71676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:00.205211 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebcc8b-5a8d-478b-aa2d-575fc1c71676 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:00.306318 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1393/2777] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:13:00 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:13:00.310451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ecb97-8481-48bf-ba55-9802469bed62 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:00.324002 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ecb97-8481-48bf-ba55-9802469bed62 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:00.329153 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584383be-3e27-467e-a69d-68f2f1d6b493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:00.329848 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584383be-3e27-467e-a69d-68f2f1d6b493 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:00.330642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584383be-3e27-467e-a69d-68f2f1d6b493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:00.330642 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584383be-3e27-467e-a69d-68f2f1d6b493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:00.331404 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584383be-3e27-467e-a69d-68f2f1d6b493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:00.332709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584383be-3e27-467e-a69d-68f2f1d6b493 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:00.345812 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1385/2778] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:13:00.349829 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebcc8b-5a8d-478b-aa2d-575fc1c71676 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:00.361059 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebcc8b-5a8d-478b-aa2d-575fc1c71676 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:00.369495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2774bc9-8f48-44db-91c9-da01f7050f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:00.369495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774bc9-8f48-44db-91c9-da01f7050f3e admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:00.369495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774bc9-8f48-44db-91c9-da01f7050f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:00.369989 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774bc9-8f48-44db-91c9-da01f7050f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:00.370726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2774bc9-8f48-44db-91c9-da01f7050f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:00.372425 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2774bc9-8f48-44db-91c9-da01f7050f3e admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:00.392639 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1394/2779] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:13:00.398288 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584383be-3e27-467e-a69d-68f2f1d6b493 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:00.411392 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584383be-3e27-467e-a69d-68f2f1d6b493 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:00.416521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053cdbe-7a12-478d-b73b-d2af35075a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:00.417522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053cdbe-7a12-478d-b73b-d2af35075a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:00.417890 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053cdbe-7a12-478d-b73b-d2af35075a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:00.418220 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053cdbe-7a12-478d-b73b-d2af35075a46 admin admin] PATH_INFO: `/v3/projects/b629013e0aa34ad2b3cd10aea769f4be/users/fca702d2ef794e60851a192c14744bbd/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:00.436459 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053cdbe-7a12-478d-b73b-d2af35075a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b629013e0aa34ad2b3cd10aea769f4be, user_id=fca702d2ef794e60851a192c14744bbd, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:00.439395 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053cdbe-7a12-478d-b73b-d2af35075a46 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:00.535128 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1386/2780] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:13:00 2022] PUT /identity/v3/projects/b629013e0aa34ad2b3cd10aea769f4be/users/fca702d2ef794e60851a192c14744bbd/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:13:00.546496 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628cb6a-b402-42f3-a572-8aa48e459947 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:00.546864 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628cb6a-b402-42f3-a572-8aa48e459947 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:00.547335 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628cb6a-b402-42f3-a572-8aa48e459947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:00.603070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-a628cb6a-b402-42f3-a572-8aa48e459947 None None] MFA Rules not processed for user `fca702d2ef794e60851a192c14744bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:00.604430 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-a628cb6a-b402-42f3-a572-8aa48e459947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:00.709281 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1395/2781] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:00.721617 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053cdbe-7a12-478d-b73b-d2af35075a46 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:00.723778 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9053cdbe-7a12-478d-b73b-d2af35075a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:00.792012 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053cdbe-7a12-478d-b73b-d2af35075a46 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:00.796042 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ec79e-1957-4aca-ba46-e41891c71386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:00.798496 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ec79e-1957-4aca-ba46-e41891c71386 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:00.798496 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ec79e-1957-4aca-ba46-e41891c71386 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:00.798496 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ec79e-1957-4aca-ba46-e41891c71386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:00.807377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ec79e-1957-4aca-ba46-e41891c71386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:00.808976 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ec79e-1957-4aca-ba46-e41891c71386 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:00.819986 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1387/2782] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:13:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:13:00.847643 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628cb6a-b402-42f3-a572-8aa48e459947 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:00.934903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628cb6a-b402-42f3-a572-8aa48e459947 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:00.943538 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de82b4-4d55-46f8-b23c-4f7686a49ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:00.946048 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de82b4-4d55-46f8-b23c-4f7686a49ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:00.946405 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de82b4-4d55-46f8-b23c-4f7686a49ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:00.946815 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de82b4-4d55-46f8-b23c-4f7686a49ec4 admin admin] PATH_INFO: `/v3/users/fca702d2ef794e60851a192c14744bbd` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:00.948313 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de82b4-4d55-46f8-b23c-4f7686a49ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fca702d2ef794e60851a192c14744bbd)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:00.951000 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de82b4-4d55-46f8-b23c-4f7686a49ec4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:01.140008 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-66de82b4-4d55-46f8-b23c-4f7686a49ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fca702d2ef794e60851a192c14744bbd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:01.224103 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-66de82b4-4d55-46f8-b23c-4f7686a49ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fca702d2ef794e60851a192c14744bbd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:01.232416 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-66de82b4-4d55-46f8-b23c-4f7686a49ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fca702d2ef794e60851a192c14744bbd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:01.233638 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-66de82b4-4d55-46f8-b23c-4f7686a49ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fca702d2ef794e60851a192c14744bbd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:01.234252 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-66de82b4-4d55-46f8-b23c-4f7686a49ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fca702d2ef794e60851a192c14744bbd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:01.255850 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1396/2783] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:13:00 2022] DELETE /identity/v3/users/fca702d2ef794e60851a192c14744bbd => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:13:01.260110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ebc46-16ca-45b8-8f1f-8bdaea8d7018 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:01.260470 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ebc46-16ca-45b8-8f1f-8bdaea8d7018 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:01.260762 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ebc46-16ca-45b8-8f1f-8bdaea8d7018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:01.280468 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-470ebc46-16ca-45b8-8f1f-8bdaea8d7018 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:01.281811 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-470ebc46-16ca-45b8-8f1f-8bdaea8d7018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:01.347446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1388/2784] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:01.357568 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de82b4-4d55-46f8-b23c-4f7686a49ec4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:01.359108 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-66de82b4-4d55-46f8-b23c-4f7686a49ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:01.428928 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de82b4-4d55-46f8-b23c-4f7686a49ec4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:01.435012 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8c708-2fc3-4aad-93a3-fb53cd8b7e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:01.435918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8c708-2fc3-4aad-93a3-fb53cd8b7e05 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:01.436516 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8c708-2fc3-4aad-93a3-fb53cd8b7e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:01.436795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8c708-2fc3-4aad-93a3-fb53cd8b7e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:01.449034 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8c708-2fc3-4aad-93a3-fb53cd8b7e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:01.450624 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8c708-2fc3-4aad-93a3-fb53cd8b7e05 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:01.463790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1397/2785] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:13:01.861340 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ebc46-16ca-45b8-8f1f-8bdaea8d7018 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:01.862889 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-470ebc46-16ca-45b8-8f1f-8bdaea8d7018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:01.878031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ebc46-16ca-45b8-8f1f-8bdaea8d7018 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:01.886930 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591c790-65b7-48a8-86a9-15e5d8a81751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:01.887895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c790-65b7-48a8-86a9-15e5d8a81751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:01.888186 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c790-65b7-48a8-86a9-15e5d8a81751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:01.888467 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c790-65b7-48a8-86a9-15e5d8a81751 admin admin] PATH_INFO: `/v3/projects/b629013e0aa34ad2b3cd10aea769f4be` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:01.890040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591c790-65b7-48a8-86a9-15e5d8a81751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b629013e0aa34ad2b3cd10aea769f4be)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:01.892345 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591c790-65b7-48a8-86a9-15e5d8a81751 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:02.009219 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4591c790-65b7-48a8-86a9-15e5d8a81751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b629013e0aa34ad2b3cd10aea769f4be', 'request_id': 'req-4591c790-65b7-48a8-86a9-15e5d8a81751'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:02.015404 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4591c790-65b7-48a8-86a9-15e5d8a81751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b629013e0aa34ad2b3cd10aea769f4be', 'request_id': 'req-4591c790-65b7-48a8-86a9-15e5d8a81751'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:02.020924 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4591c790-65b7-48a8-86a9-15e5d8a81751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b629013e0aa34ad2b3cd10aea769f4be', 'request_id': 'req-4591c790-65b7-48a8-86a9-15e5d8a81751'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:02.275765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4591c790-65b7-48a8-86a9-15e5d8a81751 admin admin] The token cache is being invalidate because project b629013e0aa34ad2b3cd10aea769f4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:13:02.276065 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4591c790-65b7-48a8-86a9-15e5d8a81751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:02.276780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-4591c790-65b7-48a8-86a9-15e5d8a81751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:02.282857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1389/2786] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:13:01 2022] DELETE /identity/v3/projects/b629013e0aa34ad2b3cd10aea769f4be => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:13:02.284736 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e717146-808d-4c6a-b68a-c1856fd33754 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:02.285336 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e717146-808d-4c6a-b68a-c1856fd33754 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:02.285336 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e717146-808d-4c6a-b68a-c1856fd33754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:02.308769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-4e717146-808d-4c6a-b68a-c1856fd33754 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:02.310005 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-4e717146-808d-4c6a-b68a-c1856fd33754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:02.375756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1398/2787] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:02.384007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff6d8d-5d22-42c3-868c-b0b4286dfda5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:02.384296 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff6d8d-5d22-42c3-868c-b0b4286dfda5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:02.384570 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff6d8d-5d22-42c3-868c-b0b4286dfda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:02.404510 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-abff6d8d-5d22-42c3-868c-b0b4286dfda5 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:02.405739 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-abff6d8d-5d22-42c3-868c-b0b4286dfda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:02.419633 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1390/2788] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:02.421160 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e717146-808d-4c6a-b68a-c1856fd33754 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:02.435369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e717146-808d-4c6a-b68a-c1856fd33754 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:02.441258 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81f071-2c47-4e55-9dbc-aa702c95bd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:02.442149 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81f071-2c47-4e55-9dbc-aa702c95bd5a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:02.442680 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81f071-2c47-4e55-9dbc-aa702c95bd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:02.443153 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81f071-2c47-4e55-9dbc-aa702c95bd5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:02.444321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81f071-2c47-4e55-9dbc-aa702c95bd5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:13:02.444787 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81f071-2c47-4e55-9dbc-aa702c95bd5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:02.446744 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81f071-2c47-4e55-9dbc-aa702c95bd5a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:02.461321 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1399/2789] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 11 21:13:02.465936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff6d8d-5d22-42c3-868c-b0b4286dfda5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:02.476191 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff6d8d-5d22-42c3-868c-b0b4286dfda5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:02.483781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576ab01-9cbf-4394-8aa5-22ad5514aa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:02.484535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576ab01-9cbf-4394-8aa5-22ad5514aa4b admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:02.484887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576ab01-9cbf-4394-8aa5-22ad5514aa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:02.485261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576ab01-9cbf-4394-8aa5-22ad5514aa4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:02.486169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576ab01-9cbf-4394-8aa5-22ad5514aa4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:02.488246 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7576ab01-9cbf-4394-8aa5-22ad5514aa4b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:02.575483 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1391/2790] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:13:02 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:13:02.579946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81f071-2c47-4e55-9dbc-aa702c95bd5a admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:02.590369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81f071-2c47-4e55-9dbc-aa702c95bd5a admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:02.653226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61da4fb-eff1-4786-b391-2989a30c7d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:02.653942 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61da4fb-eff1-4786-b391-2989a30c7d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:02.654227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61da4fb-eff1-4786-b391-2989a30c7d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:02.654507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61da4fb-eff1-4786-b391-2989a30c7d05 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:02.655210 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61da4fb-eff1-4786-b391-2989a30c7d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:02.657238 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61da4fb-eff1-4786-b391-2989a30c7d05 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:02.737452 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1400/2791] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:13:02 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:13:02.739040 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576ab01-9cbf-4394-8aa5-22ad5514aa4b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:02.750261 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576ab01-9cbf-4394-8aa5-22ad5514aa4b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:02.756661 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9cac8-496b-4a1e-b8f0-0cb03a03b958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:02.757498 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9cac8-496b-4a1e-b8f0-0cb03a03b958 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:02.757815 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9cac8-496b-4a1e-b8f0-0cb03a03b958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:02.758098 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9cac8-496b-4a1e-b8f0-0cb03a03b958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:02.758842 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9cac8-496b-4a1e-b8f0-0cb03a03b958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:02.760485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9cac8-496b-4a1e-b8f0-0cb03a03b958 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:02.772060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1392/2792] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:13:02.775942 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61da4fb-eff1-4786-b391-2989a30c7d05 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:02.786805 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61da4fb-eff1-4786-b391-2989a30c7d05 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:02.791762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e2807-d901-437b-ada0-f6c1f2800eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:02.792436 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e2807-d901-437b-ada0-f6c1f2800eda admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:02.792720 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e2807-d901-437b-ada0-f6c1f2800eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:02.793011 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e2807-d901-437b-ada0-f6c1f2800eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:02.793767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e2807-d901-437b-ada0-f6c1f2800eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:02.795872 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e2807-d901-437b-ada0-f6c1f2800eda admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:02.806350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1401/2793] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:13:02.810719 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9cac8-496b-4a1e-b8f0-0cb03a03b958 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:02.826583 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9cac8-496b-4a1e-b8f0-0cb03a03b958 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:02.832255 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd36f1-f7c9-4bb8-bfa7-fb6d7c4f7e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:02.834194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd36f1-f7c9-4bb8-bfa7-fb6d7c4f7e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:02.834194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd36f1-f7c9-4bb8-bfa7-fb6d7c4f7e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:02.834194 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd36f1-f7c9-4bb8-bfa7-fb6d7c4f7e9a admin admin] PATH_INFO: `/v3/projects/b70316ec7169441f84ac5dc86774caf1/users/bc556ac8e3ba4f3e9076de3a1d3bacab/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:02.849416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd36f1-f7c9-4bb8-bfa7-fb6d7c4f7e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70316ec7169441f84ac5dc86774caf1, user_id=bc556ac8e3ba4f3e9076de3a1d3bacab, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:02.852144 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd36f1-f7c9-4bb8-bfa7-fb6d7c4f7e9a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:02.962709 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1393/2794] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:13:02 2022] PUT /identity/v3/projects/b70316ec7169441f84ac5dc86774caf1/users/bc556ac8e3ba4f3e9076de3a1d3bacab/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:13:02.973202 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74b2e6-8eaa-4be4-a194-d9a756f66109 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:02.973681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74b2e6-8eaa-4be4-a194-d9a756f66109 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:02.974047 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74b2e6-8eaa-4be4-a194-d9a756f66109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:03.003558 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ab74b2e6-8eaa-4be4-a194-d9a756f66109 None None] MFA Rules not processed for user `bc556ac8e3ba4f3e9076de3a1d3bacab`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:03.004759 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ab74b2e6-8eaa-4be4-a194-d9a756f66109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:03.079444 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1402/2795] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:03.091213 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd36f1-f7c9-4bb8-bfa7-fb6d7c4f7e9a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:03.092954 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c7bd36f1-f7c9-4bb8-bfa7-fb6d7c4f7e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:03.155405 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd36f1-f7c9-4bb8-bfa7-fb6d7c4f7e9a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:03.160701 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162efa65-1d25-4bd7-94d9-603d869b9378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:03.164111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162efa65-1d25-4bd7-94d9-603d869b9378 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:03.164111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162efa65-1d25-4bd7-94d9-603d869b9378 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:03.164111 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162efa65-1d25-4bd7-94d9-603d869b9378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:03.174346 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162efa65-1d25-4bd7-94d9-603d869b9378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:03.176295 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162efa65-1d25-4bd7-94d9-603d869b9378 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:03.187868 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1394/2796] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:13:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:13:04.318212 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1762ca-95ea-4aef-907d-be8f6844fb9a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:04.318698 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1762ca-95ea-4aef-907d-be8f6844fb9a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:04.318799 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1762ca-95ea-4aef-907d-be8f6844fb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:04.337118 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2a1762ca-95ea-4aef-907d-be8f6844fb9a None None] MFA Rules not processed for user `5f921c3ec5a44c49a6ee9903e56b6d62`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:04.341932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2a1762ca-95ea-4aef-907d-be8f6844fb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:04.394093 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1403/2797] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:07.497668 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162efa65-1d25-4bd7-94d9-603d869b9378 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:07.499059 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-162efa65-1d25-4bd7-94d9-603d869b9378 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:07.510063 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162efa65-1d25-4bd7-94d9-603d869b9378 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:07.513594 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356fb85-fde0-430d-adad-a976340b4b7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:07.514225 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356fb85-fde0-430d-adad-a976340b4b7c service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:07.514510 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356fb85-fde0-430d-adad-a976340b4b7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:07.514787 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356fb85-fde0-430d-adad-a976340b4b7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:07.516606 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b356fb85-fde0-430d-adad-a976340b4b7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:07.573875 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356fb85-fde0-430d-adad-a976340b4b7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:07.575308 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356fb85-fde0-430d-adad-a976340b4b7c service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:07.584791 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1395/2798] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:13:13.953768 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7d36b-75a0-4fac-8da1-fafd0539cfe4 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:13.954279 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7d36b-75a0-4fac-8da1-fafd0539cfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:13.955079 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7d36b-75a0-4fac-8da1-fafd0539cfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:13.972958 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ffd7d36b-75a0-4fac-8da1-fafd0539cfe4 None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:13.974265 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ffd7d36b-75a0-4fac-8da1-fafd0539cfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:14.031634 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1404/2799] 10.222.0.35 () {58 vars in 1009 bytes} [Wed May 11 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:14.044509 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356fb85-fde0-430d-adad-a976340b4b7c service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:14.045950 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b356fb85-fde0-430d-adad-a976340b4b7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:14.114802 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356fb85-fde0-430d-adad-a976340b4b7c service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:14.119781 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d8a34-44c7-4617-977f-4c68b70f7f6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:14.120485 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d8a34-44c7-4617-977f-4c68b70f7f6e service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:14.121497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d8a34-44c7-4617-977f-4c68b70f7f6e service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:14.121497 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d8a34-44c7-4617-977f-4c68b70f7f6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:14.129764 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d8a34-44c7-4617-977f-4c68b70f7f6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:14.131370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d8a34-44c7-4617-977f-4c68b70f7f6e service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:14.139621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1396/2800] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:13:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 21:13:21.004533 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa57c5-2954-44fd-8131-46f2c20b9fd8 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:21.005617 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa57c5-2954-44fd-8131-46f2c20b9fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:21.006146 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa57c5-2954-44fd-8131-46f2c20b9fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:21.026781 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-85fa57c5-2954-44fd-8131-46f2c20b9fd8 None None] MFA Rules not processed for user `98cd883e05da4e5798ad64e7a43bfed1`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:21.028612 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-85fa57c5-2954-44fd-8131-46f2c20b9fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:21.103421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1405/2801] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:23.539388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f28bdc-b014-44ba-8c19-9bd184eb1a83 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:23.539990 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f28bdc-b014-44ba-8c19-9bd184eb1a83 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:23.540402 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f28bdc-b014-44ba-8c19-9bd184eb1a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:23.557664 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-22f28bdc-b014-44ba-8c19-9bd184eb1a83 None None] MFA Rules not processed for user `3a47bfbd0a2e459cabaa30d74f45811a`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:23.559007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-22f28bdc-b014-44ba-8c19-9bd184eb1a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:23.566680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1397/2802] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:34.401897 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa57c5-2954-44fd-8131-46f2c20b9fd8 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:34.464051 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa57c5-2954-44fd-8131-46f2c20b9fd8 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:34.468698 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8129d-1e63-4d13-87fb-e62dd709f898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:34.469596 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8129d-1e63-4d13-87fb-e62dd709f898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:34.469887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8129d-1e63-4d13-87fb-e62dd709f898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:34.470715 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8129d-1e63-4d13-87fb-e62dd709f898 admin admin] PATH_INFO: `/v3/users/bc556ac8e3ba4f3e9076de3a1d3bacab` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:34.471979 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8129d-1e63-4d13-87fb-e62dd709f898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc556ac8e3ba4f3e9076de3a1d3bacab)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:34.473995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8129d-1e63-4d13-87fb-e62dd709f898 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:34.605009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9ba8129d-1e63-4d13-87fb-e62dd709f898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc556ac8e3ba4f3e9076de3a1d3bacab'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:34.669780 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9ba8129d-1e63-4d13-87fb-e62dd709f898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc556ac8e3ba4f3e9076de3a1d3bacab'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:34.677895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9ba8129d-1e63-4d13-87fb-e62dd709f898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc556ac8e3ba4f3e9076de3a1d3bacab'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:34.678637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9ba8129d-1e63-4d13-87fb-e62dd709f898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc556ac8e3ba4f3e9076de3a1d3bacab'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:34.681009 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-9ba8129d-1e63-4d13-87fb-e62dd709f898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc556ac8e3ba4f3e9076de3a1d3bacab'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:34.700215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1406/2803] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:13:34 2022] DELETE /identity/v3/users/bc556ac8e3ba4f3e9076de3a1d3bacab => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:13:34.705624 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38666640-cab0-4f05-8e0a-de6dbef7d5cf None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:34.706212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38666640-cab0-4f05-8e0a-de6dbef7d5cf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:34.706561 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38666640-cab0-4f05-8e0a-de6dbef7d5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:34.724988 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-38666640-cab0-4f05-8e0a-de6dbef7d5cf None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:34.726233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-38666640-cab0-4f05-8e0a-de6dbef7d5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:34.813557 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1398/2804] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:13:34.825673 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8129d-1e63-4d13-87fb-e62dd709f898 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:34.827205 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-9ba8129d-1e63-4d13-87fb-e62dd709f898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:34.887919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8129d-1e63-4d13-87fb-e62dd709f898 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:34.891669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d0934-479e-418f-8ab3-004355c153b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:34.892946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d0934-479e-418f-8ab3-004355c153b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:34.893230 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d0934-479e-418f-8ab3-004355c153b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:34.893509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d0934-479e-418f-8ab3-004355c153b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:34.903566 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d0934-479e-418f-8ab3-004355c153b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:34.905090 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d0934-479e-418f-8ab3-004355c153b4 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:34.915154 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1407/2805] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:13:35.420613 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38666640-cab0-4f05-8e0a-de6dbef7d5cf None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:35.422171 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-38666640-cab0-4f05-8e0a-de6dbef7d5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:35.443895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38666640-cab0-4f05-8e0a-de6dbef7d5cf None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:35.457416 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84213733-2d17-46b7-b49a-69d28a799862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:35.462379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84213733-2d17-46b7-b49a-69d28a799862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:35.462379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84213733-2d17-46b7-b49a-69d28a799862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:35.462379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84213733-2d17-46b7-b49a-69d28a799862 admin admin] PATH_INFO: `/v3/projects/b70316ec7169441f84ac5dc86774caf1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:35.462379 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84213733-2d17-46b7-b49a-69d28a799862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70316ec7169441f84ac5dc86774caf1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:35.463003 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84213733-2d17-46b7-b49a-69d28a799862 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:35.584284 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84213733-2d17-46b7-b49a-69d28a799862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70316ec7169441f84ac5dc86774caf1', 'request_id': 'req-84213733-2d17-46b7-b49a-69d28a799862'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:35.590381 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84213733-2d17-46b7-b49a-69d28a799862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70316ec7169441f84ac5dc86774caf1', 'request_id': 'req-84213733-2d17-46b7-b49a-69d28a799862'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:35.596139 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84213733-2d17-46b7-b49a-69d28a799862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70316ec7169441f84ac5dc86774caf1', 'request_id': 'req-84213733-2d17-46b7-b49a-69d28a799862'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:35.675548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84213733-2d17-46b7-b49a-69d28a799862 admin admin] The token cache is being invalidate because project b70316ec7169441f84ac5dc86774caf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:13:35.675878 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84213733-2d17-46b7-b49a-69d28a799862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:35.676507 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-84213733-2d17-46b7-b49a-69d28a799862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:35.678122 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1399/2806] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:13:35 2022] DELETE /identity/v3/projects/b70316ec7169441f84ac5dc86774caf1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:13:35.683358 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a56ad-2f09-4dff-a919-9542313b8331 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:35.683867 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a56ad-2f09-4dff-a919-9542313b8331 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:35.683954 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a56ad-2f09-4dff-a919-9542313b8331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:35.702488 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-550a56ad-2f09-4dff-a919-9542313b8331 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:35.704144 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-550a56ad-2f09-4dff-a919-9542313b8331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:35.762637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1408/2807] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:13:35.771846 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d7500-ca75-4af7-8799-d60cace08d8b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:35.772336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d7500-ca75-4af7-8799-d60cace08d8b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:35.772461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d7500-ca75-4af7-8799-d60cace08d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:35.791453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b09d7500-ca75-4af7-8799-d60cace08d8b None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:35.792833 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b09d7500-ca75-4af7-8799-d60cace08d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:35.800867 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1400/2808] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:35.805125 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a56ad-2f09-4dff-a919-9542313b8331 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:35.814946 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a56ad-2f09-4dff-a919-9542313b8331 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:35.819577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15fa12-156f-4a50-9e86-52a520940303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:35.820233 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15fa12-156f-4a50-9e86-52a520940303 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:35.820622 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15fa12-156f-4a50-9e86-52a520940303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:35.820786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15fa12-156f-4a50-9e86-52a520940303 admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:35.821515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15fa12-156f-4a50-9e86-52a520940303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:13:35.821861 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15fa12-156f-4a50-9e86-52a520940303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:35.823732 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15fa12-156f-4a50-9e86-52a520940303 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:35.842907 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1409/2809] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:13:35.845786 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d7500-ca75-4af7-8799-d60cace08d8b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:35.854630 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d7500-ca75-4af7-8799-d60cace08d8b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:35.859272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42369d7d-68e3-4d23-aed4-ae6775f4fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:35.859920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42369d7d-68e3-4d23-aed4-ae6775f4fd39 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:35.860204 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42369d7d-68e3-4d23-aed4-ae6775f4fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:35.860481 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42369d7d-68e3-4d23-aed4-ae6775f4fd39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:35.861197 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42369d7d-68e3-4d23-aed4-ae6775f4fd39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:35.863162 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42369d7d-68e3-4d23-aed4-ae6775f4fd39 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:35.959202 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1401/2810] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:13:35 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:13:35.963632 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15fa12-156f-4a50-9e86-52a520940303 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:35.976096 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15fa12-156f-4a50-9e86-52a520940303 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:36.040429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae09ad-bfcb-4d51-9b39-40e135be431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:36.040429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae09ad-bfcb-4d51-9b39-40e135be431d admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:36.040429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae09ad-bfcb-4d51-9b39-40e135be431d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:36.040429 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae09ad-bfcb-4d51-9b39-40e135be431d admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:36.041189 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae09ad-bfcb-4d51-9b39-40e135be431d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:36.043049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae09ad-bfcb-4d51-9b39-40e135be431d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:36.132044 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1410/2811] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:13:35 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:13:36.132504 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42369d7d-68e3-4d23-aed4-ae6775f4fd39 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:36.149626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42369d7d-68e3-4d23-aed4-ae6775f4fd39 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:36.161906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de19702-3311-4b69-a52c-bac120fa81fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:36.162961 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de19702-3311-4b69-a52c-bac120fa81fc admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:36.163649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de19702-3311-4b69-a52c-bac120fa81fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:36.164150 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de19702-3311-4b69-a52c-bac120fa81fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:36.165328 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de19702-3311-4b69-a52c-bac120fa81fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:36.167004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de19702-3311-4b69-a52c-bac120fa81fc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:36.179910 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1402/2812] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 11 21:13:36.184159 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae09ad-bfcb-4d51-9b39-40e135be431d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:36.196365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae09ad-bfcb-4d51-9b39-40e135be431d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:36.202191 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0a553-d408-4349-8d1e-8fb33776548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:36.202901 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0a553-d408-4349-8d1e-8fb33776548a admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:36.203194 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0a553-d408-4349-8d1e-8fb33776548a admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:36.203476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0a553-d408-4349-8d1e-8fb33776548a admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:36.204216 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0a553-d408-4349-8d1e-8fb33776548a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:36.212249 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0a553-d408-4349-8d1e-8fb33776548a admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:36.224177 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1411/2813] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:13:36.228212 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de19702-3311-4b69-a52c-bac120fa81fc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:36.238553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de19702-3311-4b69-a52c-bac120fa81fc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:36.243290 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee2557-606a-4dd9-a70c-6eaea0d3df46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:36.244154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee2557-606a-4dd9-a70c-6eaea0d3df46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:36.244435 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee2557-606a-4dd9-a70c-6eaea0d3df46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:36.244707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee2557-606a-4dd9-a70c-6eaea0d3df46 admin admin] PATH_INFO: `/v3/projects/faddc2cbb91344f5a1f2c27a6773c220/users/f9b6529071224b5dac47418bfac9f6b2/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:36.259408 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee2557-606a-4dd9-a70c-6eaea0d3df46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faddc2cbb91344f5a1f2c27a6773c220, user_id=f9b6529071224b5dac47418bfac9f6b2, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:36.262137 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee2557-606a-4dd9-a70c-6eaea0d3df46 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:36.333147 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1403/2814] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:13:36 2022] PUT /identity/v3/projects/faddc2cbb91344f5a1f2c27a6773c220/users/f9b6529071224b5dac47418bfac9f6b2/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:13:36.344594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba32e15-fde4-4391-8440-0a8c645e6859 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:36.344894 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba32e15-fde4-4391-8440-0a8c645e6859 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:36.345183 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba32e15-fde4-4391-8440-0a8c645e6859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:36.371681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-1ba32e15-fde4-4391-8440-0a8c645e6859 None None] MFA Rules not processed for user `f9b6529071224b5dac47418bfac9f6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:36.372895 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-1ba32e15-fde4-4391-8440-0a8c645e6859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:36.437522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1412/2815] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:36.449203 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee2557-606a-4dd9-a70c-6eaea0d3df46 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:36.450956 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-07ee2557-606a-4dd9-a70c-6eaea0d3df46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:36.506700 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee2557-606a-4dd9-a70c-6eaea0d3df46 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:36.510317 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78a86c-fabe-42d4-8faa-9c054ad1e61b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:36.510957 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78a86c-fabe-42d4-8faa-9c054ad1e61b service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:36.511245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78a86c-fabe-42d4-8faa-9c054ad1e61b service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:36.511522 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78a86c-fabe-42d4-8faa-9c054ad1e61b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:36.520306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78a86c-fabe-42d4-8faa-9c054ad1e61b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:36.521783 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78a86c-fabe-42d4-8faa-9c054ad1e61b service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:36.530649 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1404/2816] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:13:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:13:36.557073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba32e15-fde4-4391-8440-0a8c645e6859 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:36.622365 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba32e15-fde4-4391-8440-0a8c645e6859 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:36.627167 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566f60c-ddab-42ba-ab7f-7ca370b490ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:36.628031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566f60c-ddab-42ba-ab7f-7ca370b490ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:36.628316 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566f60c-ddab-42ba-ab7f-7ca370b490ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:36.628594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566f60c-ddab-42ba-ab7f-7ca370b490ef admin admin] PATH_INFO: `/v3/users/f9b6529071224b5dac47418bfac9f6b2` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:36.629831 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566f60c-ddab-42ba-ab7f-7ca370b490ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b6529071224b5dac47418bfac9f6b2)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:36.631751 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566f60c-ddab-42ba-ab7f-7ca370b490ef admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:36.825381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f566f60c-ddab-42ba-ab7f-7ca370b490ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b6529071224b5dac47418bfac9f6b2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:36.898236 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f566f60c-ddab-42ba-ab7f-7ca370b490ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b6529071224b5dac47418bfac9f6b2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:36.905871 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f566f60c-ddab-42ba-ab7f-7ca370b490ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b6529071224b5dac47418bfac9f6b2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:36.906515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f566f60c-ddab-42ba-ab7f-7ca370b490ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b6529071224b5dac47418bfac9f6b2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:36.907130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f566f60c-ddab-42ba-ab7f-7ca370b490ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b6529071224b5dac47418bfac9f6b2'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:36.923871 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1413/2817] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:13:36 2022] DELETE /identity/v3/users/f9b6529071224b5dac47418bfac9f6b2 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:13:36.928518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7e351-1982-44c6-9258-f238721623b2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:36.928980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7e351-1982-44c6-9258-f238721623b2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:36.929097 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7e351-1982-44c6-9258-f238721623b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:36.946099 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a5f7e351-1982-44c6-9258-f238721623b2 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:36.947206 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a5f7e351-1982-44c6-9258-f238721623b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:37.003389 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1405/2818] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:37.013017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566f60c-ddab-42ba-ab7f-7ca370b490ef admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:37.014608 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f566f60c-ddab-42ba-ab7f-7ca370b490ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:37.072319 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566f60c-ddab-42ba-ab7f-7ca370b490ef admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:37.076140 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8a055-7aaa-473a-9977-45df94b58c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:37.076786 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a055-7aaa-473a-9977-45df94b58c91 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:37.077073 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a055-7aaa-473a-9977-45df94b58c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:37.077412 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8a055-7aaa-473a-9977-45df94b58c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:37.086495 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8a055-7aaa-473a-9977-45df94b58c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:37.087941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8a055-7aaa-473a-9977-45df94b58c91 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:37.098058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1414/2819] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:13:37.567174 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7e351-1982-44c6-9258-f238721623b2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:37.568699 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a5f7e351-1982-44c6-9258-f238721623b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:37.581653 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7e351-1982-44c6-9258-f238721623b2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:37.586236 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df241c-a51c-400b-be8b-99f239a733d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:37.587088 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df241c-a51c-400b-be8b-99f239a733d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:37.587372 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df241c-a51c-400b-be8b-99f239a733d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:37.587647 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df241c-a51c-400b-be8b-99f239a733d3 admin admin] PATH_INFO: `/v3/projects/faddc2cbb91344f5a1f2c27a6773c220` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:37.588851 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df241c-a51c-400b-be8b-99f239a733d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faddc2cbb91344f5a1f2c27a6773c220)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:37.596745 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df241c-a51c-400b-be8b-99f239a733d3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:37.719068 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c3df241c-a51c-400b-be8b-99f239a733d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faddc2cbb91344f5a1f2c27a6773c220', 'request_id': 'req-c3df241c-a51c-400b-be8b-99f239a733d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:37.725882 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c3df241c-a51c-400b-be8b-99f239a733d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faddc2cbb91344f5a1f2c27a6773c220', 'request_id': 'req-c3df241c-a51c-400b-be8b-99f239a733d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:37.731306 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c3df241c-a51c-400b-be8b-99f239a733d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faddc2cbb91344f5a1f2c27a6773c220', 'request_id': 'req-c3df241c-a51c-400b-be8b-99f239a733d3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:37.818545 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c3df241c-a51c-400b-be8b-99f239a733d3 admin admin] The token cache is being invalidate because project faddc2cbb91344f5a1f2c27a6773c220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:13:37.824109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c3df241c-a51c-400b-be8b-99f239a733d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:37.824109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c3df241c-a51c-400b-be8b-99f239a733d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:13:37.824109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1406/2820] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:13:37 2022] DELETE /identity/v3/projects/faddc2cbb91344f5a1f2c27a6773c220 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:13:37.826462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b9a74-eef8-458c-9880-a8cfbd571d79 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:37.826942 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b9a74-eef8-458c-9880-a8cfbd571d79 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:37.827052 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b9a74-eef8-458c-9880-a8cfbd571d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:37.844588 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-ce0b9a74-eef8-458c-9880-a8cfbd571d79 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:37.847560 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-ce0b9a74-eef8-458c-9880-a8cfbd571d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:37.904403 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1415/2821] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:37.912716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de6b8-6cfc-4a67-8546-aa95591c168c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:37.913014 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de6b8-6cfc-4a67-8546-aa95591c168c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:37.913295 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de6b8-6cfc-4a67-8546-aa95591c168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:37.932264 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f19de6b8-6cfc-4a67-8546-aa95591c168c None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:37.933457 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f19de6b8-6cfc-4a67-8546-aa95591c168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:37.943378 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1407/2822] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:37.947493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b9a74-eef8-458c-9880-a8cfbd571d79 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:37.957795 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b9a74-eef8-458c-9880-a8cfbd571d79 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:37.962542 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29146eff-a3f3-42ef-a501-a904edca1fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:37.963199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29146eff-a3f3-42ef-a501-a904edca1fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:37.963484 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29146eff-a3f3-42ef-a501-a904edca1fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:37.963760 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29146eff-a3f3-42ef-a501-a904edca1fcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:37.964487 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29146eff-a3f3-42ef-a501-a904edca1fcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80193) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:13:37.964796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29146eff-a3f3-42ef-a501-a904edca1fcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:37.966507 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29146eff-a3f3-42ef-a501-a904edca1fcf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:37.977764 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1416/2823] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:13:37.983458 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19de6b8-6cfc-4a67-8546-aa95591c168c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:37.991056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19de6b8-6cfc-4a67-8546-aa95591c168c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:37.995806 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4347ee-da7c-4bde-aaec-11d404ac3764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:37.996446 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4347ee-da7c-4bde-aaec-11d404ac3764 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:37.996758 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4347ee-da7c-4bde-aaec-11d404ac3764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:37.997037 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4347ee-da7c-4bde-aaec-11d404ac3764 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:37.997769 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4347ee-da7c-4bde-aaec-11d404ac3764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:37.999670 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4347ee-da7c-4bde-aaec-11d404ac3764 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:38.094531 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1408/2824] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:13:37 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:13:38.098524 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29146eff-a3f3-42ef-a501-a904edca1fcf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:38.108512 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29146eff-a3f3-42ef-a501-a904edca1fcf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:38.164199 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d54d4b-9acc-47fd-84a2-46721d8876f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:38.164869 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d54d4b-9acc-47fd-84a2-46721d8876f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:38.165186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d54d4b-9acc-47fd-84a2-46721d8876f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:38.165462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d54d4b-9acc-47fd-84a2-46721d8876f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:38.166172 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d54d4b-9acc-47fd-84a2-46721d8876f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:38.168110 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d54d4b-9acc-47fd-84a2-46721d8876f0 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:38.275770 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1417/2825] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:13:38 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 11 21:13:38.279827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4347ee-da7c-4bde-aaec-11d404ac3764 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:38.290109 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4347ee-da7c-4bde-aaec-11d404ac3764 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:38.294716 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bab972-eb79-4fe1-a4c2-4a1ce0c479cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:38.295370 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bab972-eb79-4fe1-a4c2-4a1ce0c479cb admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:38.295656 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bab972-eb79-4fe1-a4c2-4a1ce0c479cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:38.295962 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bab972-eb79-4fe1-a4c2-4a1ce0c479cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:38.296687 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bab972-eb79-4fe1-a4c2-4a1ce0c479cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:38.298841 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bab972-eb79-4fe1-a4c2-4a1ce0c479cb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:38.309070 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1409/2826] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:13:38.312871 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d54d4b-9acc-47fd-84a2-46721d8876f0 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:38.323213 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d54d4b-9acc-47fd-84a2-46721d8876f0 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:38.327930 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136aaed8-348f-4669-af3e-b97d7618e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:38.330577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aaed8-348f-4669-af3e-b97d7618e776 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:38.330577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aaed8-348f-4669-af3e-b97d7618e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:38.330577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aaed8-348f-4669-af3e-b97d7618e776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:38.330577 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136aaed8-348f-4669-af3e-b97d7618e776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:38.331518 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136aaed8-348f-4669-af3e-b97d7618e776 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:38.341140 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1418/2827] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:13:38.345187 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bab972-eb79-4fe1-a4c2-4a1ce0c479cb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:38.354941 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bab972-eb79-4fe1-a4c2-4a1ce0c479cb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:38.359575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43798d-6115-40a1-8618-43fb617c1358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:38.360981 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43798d-6115-40a1-8618-43fb617c1358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:38.361272 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43798d-6115-40a1-8618-43fb617c1358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:38.361575 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43798d-6115-40a1-8618-43fb617c1358 admin admin] PATH_INFO: `/v3/projects/715fee0f9c6e4c73b716faa3b978208c/users/05901232e0534f6fa130e78584b703ee/roles/a211713995b7409ca158916c665f73b6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:38.376081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43798d-6115-40a1-8618-43fb617c1358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715fee0f9c6e4c73b716faa3b978208c, user_id=05901232e0534f6fa130e78584b703ee, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:38.379502 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43798d-6115-40a1-8618-43fb617c1358 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:38.515494 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1410/2828] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:13:38 2022] PUT /identity/v3/projects/715fee0f9c6e4c73b716faa3b978208c/users/05901232e0534f6fa130e78584b703ee/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 11 21:13:38.520721 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6ce42-9f07-4c11-853c-bb47913e4b69 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:38.521215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6ce42-9f07-4c11-853c-bb47913e4b69 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:38.521551 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6ce42-9f07-4c11-853c-bb47913e4b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:38.540085 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-2cb6ce42-9f07-4c11-853c-bb47913e4b69 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:38.542537 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-2cb6ce42-9f07-4c11-853c-bb47913e4b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:38.606125 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1419/2829] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:38.615803 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43798d-6115-40a1-8618-43fb617c1358 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:38.617489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bc43798d-6115-40a1-8618-43fb617c1358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:38.678233 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43798d-6115-40a1-8618-43fb617c1358 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:38.682215 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc0167-e96d-4fb8-b95c-fdf392c635f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:38.682979 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc0167-e96d-4fb8-b95c-fdf392c635f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:38.683360 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc0167-e96d-4fb8-b95c-fdf392c635f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:38.683732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc0167-e96d-4fb8-b95c-fdf392c635f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:38.699640 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc0167-e96d-4fb8-b95c-fdf392c635f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:38.701202 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc0167-e96d-4fb8-b95c-fdf392c635f8 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:38.713030 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1411/2830] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:13:44.385269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b5eb-b3c4-4520-bf98-005c4e962b0c None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:44.385879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b5eb-b3c4-4520-bf98-005c4e962b0c None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:44.385879 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1b5eb-b3c4-4520-bf98-005c4e962b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:44.420229 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-60a1b5eb-b3c4-4520-bf98-005c4e962b0c None None] MFA Rules not processed for user `05901232e0534f6fa130e78584b703ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:44.421769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-60a1b5eb-b3c4-4520-bf98-005c4e962b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:44.493607 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1420/2831] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:44.498110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc0167-e96d-4fb8-b95c-fdf392c635f8 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:44.508521 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc0167-e96d-4fb8-b95c-fdf392c635f8 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:44.513037 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5079d8-bcaa-4436-8a48-6571a7c58ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:44.513714 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5079d8-bcaa-4436-8a48-6571a7c58ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:44.514168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5079d8-bcaa-4436-8a48-6571a7c58ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:44.514448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5079d8-bcaa-4436-8a48-6571a7c58ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:44.515134 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5079d8-bcaa-4436-8a48-6571a7c58ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:44.517817 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5079d8-bcaa-4436-8a48-6571a7c58ce9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:44.617357 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1412/2832] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:13:44 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:13:44.618591 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b5eb-b3c4-4520-bf98-005c4e962b0c None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:44.632418 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1b5eb-b3c4-4520-bf98-005c4e962b0c None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:44.695726 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaa035-3c09-4ec3-933f-a55f97bae7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:44.696506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaa035-3c09-4ec3-933f-a55f97bae7cf admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:44.696906 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaa035-3c09-4ec3-933f-a55f97bae7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:44.697282 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaa035-3c09-4ec3-933f-a55f97bae7cf admin admin] PATH_INFO: `/v3/users` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:44.698138 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdaa035-3c09-4ec3-933f-a55f97bae7cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:44.700375 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdaa035-3c09-4ec3-933f-a55f97bae7cf admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:44.800588 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1421/2833] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:13:44 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:13:44.802822 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5079d8-bcaa-4436-8a48-6571a7c58ce9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:44.828052 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5079d8-bcaa-4436-8a48-6571a7c58ce9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:44.834635 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff521f-e73d-40cf-939d-5541a0fe4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:44.835044 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff521f-e73d-40cf-939d-5541a0fe4ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:44.835325 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff521f-e73d-40cf-939d-5541a0fe4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:44.835698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff521f-e73d-40cf-939d-5541a0fe4ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:44.836602 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff521f-e73d-40cf-939d-5541a0fe4ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:44.846662 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff521f-e73d-40cf-939d-5541a0fe4ba6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:44.861582 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1413/2834] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:13:44.865816 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaa035-3c09-4ec3-933f-a55f97bae7cf admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:44.894509 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaa035-3c09-4ec3-933f-a55f97bae7cf admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:44.910884 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f93e96-e104-4709-8b49-ece025349781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:44.911929 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93e96-e104-4709-8b49-ece025349781 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:44.912292 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93e96-e104-4709-8b49-ece025349781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:44.912640 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f93e96-e104-4709-8b49-ece025349781 admin admin] PATH_INFO: `/v3/projects/d907c79abcf14c0b943fa50af057aa9a/users/054757ba46614be1bc708f193cbe0427/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:44.929462 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f93e96-e104-4709-8b49-ece025349781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d907c79abcf14c0b943fa50af057aa9a, user_id=054757ba46614be1bc708f193cbe0427, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:44.932242 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f93e96-e104-4709-8b49-ece025349781 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:45.003422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1422/2835] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:13:44 2022] PUT /identity/v3/projects/d907c79abcf14c0b943fa50af057aa9a/users/054757ba46614be1bc708f193cbe0427/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:13:45.006903 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff521f-e73d-40cf-939d-5541a0fe4ba6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:45.017420 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff521f-e73d-40cf-939d-5541a0fe4ba6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:45.079060 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99172a5f-b8da-48e8-9c14-841e2be0d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:45.079734 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99172a5f-b8da-48e8-9c14-841e2be0d64e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:45.080017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99172a5f-b8da-48e8-9c14-841e2be0d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:45.080296 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99172a5f-b8da-48e8-9c14-841e2be0d64e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:45.081017 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99172a5f-b8da-48e8-9c14-841e2be0d64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:45.082659 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99172a5f-b8da-48e8-9c14-841e2be0d64e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:45.093063 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1414/2836] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:13:45.097506 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f93e96-e104-4709-8b49-ece025349781 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:45.108381 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f93e96-e104-4709-8b49-ece025349781 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:45.113547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1755646-67f1-4084-b2fe-9bc0dccefd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:45.114439 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755646-67f1-4084-b2fe-9bc0dccefd40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:45.114747 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755646-67f1-4084-b2fe-9bc0dccefd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:45.115024 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755646-67f1-4084-b2fe-9bc0dccefd40 admin admin] PATH_INFO: `/v3/projects/d907c79abcf14c0b943fa50af057aa9a/users/054757ba46614be1bc708f193cbe0427/roles/f72042e895ea41aeb4e1db9c3ad05128` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:45.116982 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1755646-67f1-4084-b2fe-9bc0dccefd40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d907c79abcf14c0b943fa50af057aa9a, user_id=054757ba46614be1bc708f193cbe0427, role_id=f72042e895ea41aeb4e1db9c3ad05128)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:45.119756 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1755646-67f1-4084-b2fe-9bc0dccefd40 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:45.130363 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1423/2837] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:13:45 2022] PUT /identity/v3/projects/d907c79abcf14c0b943fa50af057aa9a/users/054757ba46614be1bc708f193cbe0427/roles/f72042e895ea41aeb4e1db9c3ad05128 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:13:46.466348 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99172a5f-b8da-48e8-9c14-841e2be0d64e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:46.538445 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99172a5f-b8da-48e8-9c14-841e2be0d64e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:46.632177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841728b9-82b8-479f-994b-52c360cc59cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:46.633090 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841728b9-82b8-479f-994b-52c360cc59cc service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:46.635539 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841728b9-82b8-479f-994b-52c360cc59cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:46.636008 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841728b9-82b8-479f-994b-52c360cc59cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:46.640707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-841728b9-82b8-479f-994b-52c360cc59cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:46.767169 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841728b9-82b8-479f-994b-52c360cc59cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:46.768768 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841728b9-82b8-479f-994b-52c360cc59cc service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:46.781315 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1415/2838] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:13:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:13:49.079600 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1755646-67f1-4084-b2fe-9bc0dccefd40 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:49.090070 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1755646-67f1-4084-b2fe-9bc0dccefd40 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:49.095092 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c64014-c071-4c70-8793-49c5c8f0205c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:49.095855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c64014-c071-4c70-8793-49c5c8f0205c service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:49.096142 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c64014-c071-4c70-8793-49c5c8f0205c service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:49.096422 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c64014-c071-4c70-8793-49c5c8f0205c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:49.098329 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-60c64014-c071-4c70-8793-49c5c8f0205c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:49.189747 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c64014-c071-4c70-8793-49c5c8f0205c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:49.191482 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c64014-c071-4c70-8793-49c5c8f0205c service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:49.209825 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1424/2839] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:13:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:13:52.563243 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce60303-0a85-4f48-a18a-12fb41f95877 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:52.563749 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce60303-0a85-4f48-a18a-12fb41f95877 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:52.563885 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce60303-0a85-4f48-a18a-12fb41f95877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:52.619259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5ce60303-0a85-4f48-a18a-12fb41f95877 None None] MFA Rules not processed for user `054757ba46614be1bc708f193cbe0427`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:52.620764 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5ce60303-0a85-4f48-a18a-12fb41f95877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:52.749586 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1416/2840] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:13:52.762855 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c64014-c071-4c70-8793-49c5c8f0205c service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:13:52.765771 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-60c64014-c071-4c70-8793-49c5c8f0205c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:52.903385 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c64014-c071-4c70-8793-49c5c8f0205c service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:13:52.913039 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09d181-f77a-4695-9f49-6a3032c04226 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:13:52.913746 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d181-f77a-4695-9f49-6a3032c04226 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:52.914209 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d181-f77a-4695-9f49-6a3032c04226 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:52.914523 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d181-f77a-4695-9f49-6a3032c04226 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:53.026066 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09d181-f77a-4695-9f49-6a3032c04226 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:13:53.028056 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09d181-f77a-4695-9f49-6a3032c04226 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:13:53.046661 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1425/2841] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:13:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:13:55.801967 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb6d5-51a4-4cb7-9340-c13bc2bfc37b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:13:55.803906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb6d5-51a4-4cb7-9340-c13bc2bfc37b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:13:55.803906 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb6d5-51a4-4cb7-9340-c13bc2bfc37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:13:55.820518 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ce0bb6d5-51a4-4cb7-9340-c13bc2bfc37b None None] MFA Rules not processed for user `05901232e0534f6fa130e78584b703ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:13:55.822120 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ce0bb6d5-51a4-4cb7-9340-c13bc2bfc37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:13:55.829185 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1417/2842] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:14:35.456630 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09d181-f77a-4695-9f49-6a3032c04226 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:14:35.466234 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09d181-f77a-4695-9f49-6a3032c04226 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:14:35.469875 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411989a2-cf03-4636-891c-321375e18f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:14:35.470508 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411989a2-cf03-4636-891c-321375e18f6d service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:35.470787 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411989a2-cf03-4636-891c-321375e18f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:35.471058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411989a2-cf03-4636-891c-321375e18f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:35.480347 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411989a2-cf03-4636-891c-321375e18f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:14:35.481796 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411989a2-cf03-4636-891c-321375e18f6d service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:14:35.491801 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1426/2843] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 11 21:14:39.596655 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bb6d5-51a4-4cb7-9340-c13bc2bfc37b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:14:39.598373 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ce0bb6d5-51a4-4cb7-9340-c13bc2bfc37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:14:39.668368 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bb6d5-51a4-4cb7-9340-c13bc2bfc37b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:14:39.672833 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78c61d-e8cb-4f97-9d46-5b7d2a37cf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:14:39.673732 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78c61d-e8cb-4f97-9d46-5b7d2a37cf22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:39.678257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78c61d-e8cb-4f97-9d46-5b7d2a37cf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:39.678257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78c61d-e8cb-4f97-9d46-5b7d2a37cf22 admin admin] PATH_INFO: `/v3/users/98cd883e05da4e5798ad64e7a43bfed1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:39.678257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78c61d-e8cb-4f97-9d46-5b7d2a37cf22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98cd883e05da4e5798ad64e7a43bfed1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:14:39.678257 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78c61d-e8cb-4f97-9d46-5b7d2a37cf22 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:14:39.869966 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9b78c61d-e8cb-4f97-9d46-5b7d2a37cf22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98cd883e05da4e5798ad64e7a43bfed1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:14:39.876423 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9b78c61d-e8cb-4f97-9d46-5b7d2a37cf22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98cd883e05da4e5798ad64e7a43bfed1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:14:39.954377 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9b78c61d-e8cb-4f97-9d46-5b7d2a37cf22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98cd883e05da4e5798ad64e7a43bfed1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:14:39.954925 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9b78c61d-e8cb-4f97-9d46-5b7d2a37cf22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98cd883e05da4e5798ad64e7a43bfed1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:14:39.955523 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9b78c61d-e8cb-4f97-9d46-5b7d2a37cf22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98cd883e05da4e5798ad64e7a43bfed1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:14:39.972936 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1418/2844] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:14:39 2022] DELETE /identity/v3/users/98cd883e05da4e5798ad64e7a43bfed1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:14:40.196106 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411989a2-cf03-4636-891c-321375e18f6d service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:14:40.207453 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411989a2-cf03-4636-891c-321375e18f6d service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:14:40.263028 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dc636-12df-4325-bb1c-eff08d1fcba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:14:40.263889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dc636-12df-4325-bb1c-eff08d1fcba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:40.273669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dc636-12df-4325-bb1c-eff08d1fcba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:40.273669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dc636-12df-4325-bb1c-eff08d1fcba6 admin admin] PATH_INFO: `/v3/projects/b37271fa94bf4dd7b16f144dbb9c049c` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:40.273669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dc636-12df-4325-bb1c-eff08d1fcba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b37271fa94bf4dd7b16f144dbb9c049c)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:14:40.273669 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8dc636-12df-4325-bb1c-eff08d1fcba6 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:14:40.376657 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ce8dc636-12df-4325-bb1c-eff08d1fcba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b37271fa94bf4dd7b16f144dbb9c049c', 'request_id': 'req-ce8dc636-12df-4325-bb1c-eff08d1fcba6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:14:40.383240 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ce8dc636-12df-4325-bb1c-eff08d1fcba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b37271fa94bf4dd7b16f144dbb9c049c', 'request_id': 'req-ce8dc636-12df-4325-bb1c-eff08d1fcba6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:14:40.388587 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ce8dc636-12df-4325-bb1c-eff08d1fcba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b37271fa94bf4dd7b16f144dbb9c049c', 'request_id': 'req-ce8dc636-12df-4325-bb1c-eff08d1fcba6'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:14:40.467602 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ce8dc636-12df-4325-bb1c-eff08d1fcba6 admin admin] The token cache is being invalidate because project b37271fa94bf4dd7b16f144dbb9c049c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:14:40.467845 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ce8dc636-12df-4325-bb1c-eff08d1fcba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:14:40.468485 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-ce8dc636-12df-4325-bb1c-eff08d1fcba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:14:40.470058 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1427/2845] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:14:40 2022] DELETE /identity/v3/projects/b37271fa94bf4dd7b16f144dbb9c049c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:14:40.474980 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a7dac-0a1f-41c5-80fd-8f0891339e54 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:40.478837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a7dac-0a1f-41c5-80fd-8f0891339e54 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:40.478837 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a7dac-0a1f-41c5-80fd-8f0891339e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:40.493630 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d45a7dac-0a1f-41c5-80fd-8f0891339e54 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:14:40.494808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d45a7dac-0a1f-41c5-80fd-8f0891339e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:14:40.551387 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1419/2846] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:14:40.559476 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de30ec5-e66a-43f1-95b6-571b6be966e1 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:40.559768 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de30ec5-e66a-43f1-95b6-571b6be966e1 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:40.560182 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de30ec5-e66a-43f1-95b6-571b6be966e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:40.577792 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-3de30ec5-e66a-43f1-95b6-571b6be966e1 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:14:40.578974 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-3de30ec5-e66a-43f1-95b6-571b6be966e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:14:40.586705 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1428/2847] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:14:40.590809 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a7dac-0a1f-41c5-80fd-8f0891339e54 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:14:40.600844 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a7dac-0a1f-41c5-80fd-8f0891339e54 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:14:40.605359 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46ba52-b170-4df4-b821-fe7e5803c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:14:40.606067 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46ba52-b170-4df4-b821-fe7e5803c69d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:40.606353 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46ba52-b170-4df4-b821-fe7e5803c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:40.606625 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46ba52-b170-4df4-b821-fe7e5803c69d admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:40.607336 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46ba52-b170-4df4-b821-fe7e5803c69d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 11 21:14:40.607643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46ba52-b170-4df4-b821-fe7e5803c69d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:14:40.609231 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46ba52-b170-4df4-b821-fe7e5803c69d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:14:40.621210 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1420/2848] 10.222.0.35 () {58 vars in 1152 bytes} [Wed May 11 21:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 11 21:14:40.625276 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de30ec5-e66a-43f1-95b6-571b6be966e1 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:14:40.634630 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de30ec5-e66a-43f1-95b6-571b6be966e1 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:14:40.639280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38f11e-c970-4a83-b18d-ebc466ad3cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:14:40.639918 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38f11e-c970-4a83-b18d-ebc466ad3cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:40.640200 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38f11e-c970-4a83-b18d-ebc466ad3cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:40.640474 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38f11e-c970-4a83-b18d-ebc466ad3cb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:40.641186 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38f11e-c970-4a83-b18d-ebc466ad3cb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:14:40.643116 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38f11e-c970-4a83-b18d-ebc466ad3cb9 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:14:40.739349 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1429/2849] 10.222.0.35 () {60 vars in 1152 bytes} [Wed May 11 21:14:40 2022] POST /identity/v3/projects => generated 391 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:14:40.743862 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46ba52-b170-4df4-b821-fe7e5803c69d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:14:40.754080 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46ba52-b170-4df4-b821-fe7e5803c69d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:14:40.815318 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19258efc-ca3a-4850-8d54-0795ad808ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:14:40.816021 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19258efc-ca3a-4850-8d54-0795ad808ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:40.816303 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19258efc-ca3a-4850-8d54-0795ad808ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:40.816607 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19258efc-ca3a-4850-8d54-0795ad808ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:40.817295 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19258efc-ca3a-4850-8d54-0795ad808ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:14:40.819312 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19258efc-ca3a-4850-8d54-0795ad808ee9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:14:40.943043 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1421/2850] 10.222.0.35 () {60 vars in 1143 bytes} [Wed May 11 21:14:40 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 11 21:14:40.947057 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38f11e-c970-4a83-b18d-ebc466ad3cb9 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:14:40.957081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38f11e-c970-4a83-b18d-ebc466ad3cb9 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:14:40.962110 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0ccef-e738-4b71-8d95-efc43b028d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:14:40.962765 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0ccef-e738-4b71-8d95-efc43b028d32 admin admin] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:40.963049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0ccef-e738-4b71-8d95-efc43b028d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:40.963327 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0ccef-e738-4b71-8d95-efc43b028d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:40.964076 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0ccef-e738-4b71-8d95-efc43b028d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:14:40.965710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0ccef-e738-4b71-8d95-efc43b028d32 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:14:40.976413 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1430/2851] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:14:40.980189 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19258efc-ca3a-4850-8d54-0795ad808ee9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:14:40.990142 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19258efc-ca3a-4850-8d54-0795ad808ee9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:14:40.994703 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb9c4-83e3-4c0e-866a-66640be46da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:14:40.995355 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb9c4-83e3-4c0e-866a-66640be46da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:40.995641 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb9c4-83e3-4c0e-866a-66640be46da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:40.995919 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb9c4-83e3-4c0e-866a-66640be46da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:40.996638 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb9c4-83e3-4c0e-866a-66640be46da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:14:40.998259 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb9c4-83e3-4c0e-866a-66640be46da3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:14:41.007830 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1422/2852] 10.222.0.35 () {58 vars in 1121 bytes} [Wed May 11 21:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 11 21:14:41.011767 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0ccef-e738-4b71-8d95-efc43b028d32 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:14:41.022033 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0ccef-e738-4b71-8d95-efc43b028d32 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:14:41.026560 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f779f-b47c-4401-b854-ac128dafdfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:14:41.027421 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f779f-b47c-4401-b854-ac128dafdfd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:41.027707 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f779f-b47c-4401-b854-ac128dafdfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:41.027987 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f779f-b47c-4401-b854-ac128dafdfd4 admin admin] PATH_INFO: `/v3/projects/e070de8da3eb4ac5bd1b02f14800cfd5/users/764dc7cb3c6e4abb913b5dcd1d3a67a6/roles/a211713995b7409ca158916c665f73b6` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:41.042790 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f779f-b47c-4401-b854-ac128dafdfd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e070de8da3eb4ac5bd1b02f14800cfd5, user_id=764dc7cb3c6e4abb913b5dcd1d3a67a6, role_id=a211713995b7409ca158916c665f73b6)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:14:41.045459 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f779f-b47c-4401-b854-ac128dafdfd4 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:14:41.113985 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1431/2853] 10.222.0.35 () {60 vars in 1482 bytes} [Wed May 11 21:14:41 2022] PUT /identity/v3/projects/e070de8da3eb4ac5bd1b02f14800cfd5/users/764dc7cb3c6e4abb913b5dcd1d3a67a6/roles/a211713995b7409ca158916c665f73b6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:14:41.124063 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f13144-c67f-4370-ab38-68e96060c2de None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:41.124358 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f13144-c67f-4370-ab38-68e96060c2de None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:41.124643 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f13144-c67f-4370-ab38-68e96060c2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:41.150946 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d9f13144-c67f-4370-ab38-68e96060c2de None None] MFA Rules not processed for user `764dc7cb3c6e4abb913b5dcd1d3a67a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:14:41.152144 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d9f13144-c67f-4370-ab38-68e96060c2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:14:41.214615 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1423/2854] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:14:41.225656 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f779f-b47c-4401-b854-ac128dafdfd4 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:14:41.227369 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-935f779f-b47c-4401-b854-ac128dafdfd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:14:41.282554 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f779f-b47c-4401-b854-ac128dafdfd4 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:14:41.286176 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f1a84-97dd-42a4-9cfd-aa2a76ba08f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3888fb083b0149bd92054cffa88c51e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:14:41.286813 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f1a84-97dd-42a4-9cfd-aa2a76ba08f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:41.287097 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f1a84-97dd-42a4-9cfd-aa2a76ba08f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:41.287376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f1a84-97dd-42a4-9cfd-aa2a76ba08f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:41.295334 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f1a84-97dd-42a4-9cfd-aa2a76ba08f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:14:41.296766 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f1a84-97dd-42a4-9cfd-aa2a76ba08f6 service cinder] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:14:41.305273 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1432/2855] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:14:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:14:47.753296 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f13144-c67f-4370-ab38-68e96060c2de None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:14:47.754707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d9f13144-c67f-4370-ab38-68e96060c2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:14:47.814074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f13144-c67f-4370-ab38-68e96060c2de None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:14:47.817908 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58101f2-cb2a-4de1-9f82-94284b4988b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:14:47.818664 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58101f2-cb2a-4de1-9f82-94284b4988b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:47.822765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58101f2-cb2a-4de1-9f82-94284b4988b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:47.822765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58101f2-cb2a-4de1-9f82-94284b4988b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:47.822765 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f58101f2-cb2a-4de1-9f82-94284b4988b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:14:47.893596 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58101f2-cb2a-4de1-9f82-94284b4988b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:14:47.895036 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58101f2-cb2a-4de1-9f82-94284b4988b4 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:14:47.906562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1424/2856] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:14:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:14:49.091769 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f1a84-97dd-42a4-9cfd-aa2a76ba08f6 service cinder] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:14:49.093233 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6d9f1a84-97dd-42a4-9cfd-aa2a76ba08f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:14:49.105603 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f1a84-97dd-42a4-9cfd-aa2a76ba08f6 service cinder] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:14:49.109104 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b85474-f77b-4e26-aec5-d33d2175cee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:14:49.109765 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85474-f77b-4e26-aec5-d33d2175cee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:14:49.110047 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85474-f77b-4e26-aec5-d33d2175cee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:14:49.110322 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85474-f77b-4e26-aec5-d33d2175cee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:14:49.111991 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-25b85474-f77b-4e26-aec5-d33d2175cee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:14:49.125065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b85474-f77b-4e26-aec5-d33d2175cee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:14:49.126515 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b85474-f77b-4e26-aec5-d33d2175cee0 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:14:49.137004 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1433/2857] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:14:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:15:01.700707 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58101f2-cb2a-4de1-9f82-94284b4988b4 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:15:01.761240 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58101f2-cb2a-4de1-9f82-94284b4988b4 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:15:01.766026 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633086c-9ac8-481a-8b5f-a5ddf48fcd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:15:01.766920 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633086c-9ac8-481a-8b5f-a5ddf48fcd2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:15:01.767208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633086c-9ac8-481a-8b5f-a5ddf48fcd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:15:01.767487 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633086c-9ac8-481a-8b5f-a5ddf48fcd2e admin admin] PATH_INFO: `/v3/users/764dc7cb3c6e4abb913b5dcd1d3a67a6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:15:01.768725 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633086c-9ac8-481a-8b5f-a5ddf48fcd2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=764dc7cb3c6e4abb913b5dcd1d3a67a6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:15:01.770773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633086c-9ac8-481a-8b5f-a5ddf48fcd2e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:15:01.938722 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6633086c-9ac8-481a-8b5f-a5ddf48fcd2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764dc7cb3c6e4abb913b5dcd1d3a67a6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:01.945250 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6633086c-9ac8-481a-8b5f-a5ddf48fcd2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764dc7cb3c6e4abb913b5dcd1d3a67a6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:01.994205 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6633086c-9ac8-481a-8b5f-a5ddf48fcd2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764dc7cb3c6e4abb913b5dcd1d3a67a6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:01.994807 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6633086c-9ac8-481a-8b5f-a5ddf48fcd2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764dc7cb3c6e4abb913b5dcd1d3a67a6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:01.995399 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6633086c-9ac8-481a-8b5f-a5ddf48fcd2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764dc7cb3c6e4abb913b5dcd1d3a67a6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:02.012892 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1425/2858] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:15:01 2022] DELETE /identity/v3/users/764dc7cb3c6e4abb913b5dcd1d3a67a6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:15:02.017409 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd127fed-c982-4fde-bf9f-be3586923200 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:15:02.018019 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd127fed-c982-4fde-bf9f-be3586923200 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:15:02.018133 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd127fed-c982-4fde-bf9f-be3586923200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:15:02.034905 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-fd127fed-c982-4fde-bf9f-be3586923200 None None] MFA Rules not processed for user `3529d1a9e25d41d4bfc8bab9cf496381`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:15:02.036089 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fd127fed-c982-4fde-bf9f-be3586923200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:15:02.092041 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1434/2859] 10.222.0.35 () {58 vars in 957 bytes} [Wed May 11 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:15:02.105548 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633086c-9ac8-481a-8b5f-a5ddf48fcd2e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:15:02.106938 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6633086c-9ac8-481a-8b5f-a5ddf48fcd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:15:02.162773 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633086c-9ac8-481a-8b5f-a5ddf48fcd2e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:15:02.166963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290da09e-3cc0-4528-909f-f1473cd3918b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:15:02.167601 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290da09e-3cc0-4528-909f-f1473cd3918b service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:15:02.167887 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290da09e-3cc0-4528-909f-f1473cd3918b service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:15:02.168165 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290da09e-3cc0-4528-909f-f1473cd3918b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:15:02.176808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290da09e-3cc0-4528-909f-f1473cd3918b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:15:02.178264 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290da09e-3cc0-4528-909f-f1473cd3918b service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:15:02.188028 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1426/2860] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:15:02.566762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd127fed-c982-4fde-bf9f-be3586923200 None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:15:02.568179 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-fd127fed-c982-4fde-bf9f-be3586923200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:15:02.584947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd127fed-c982-4fde-bf9f-be3586923200 None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:15:02.590100 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:15:02.590966 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:15:02.591248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:15:02.591597 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] PATH_INFO: `/v3/projects/e070de8da3eb4ac5bd1b02f14800cfd5` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:15:02.592805 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e070de8da3eb4ac5bd1b02f14800cfd5)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:15:02.594755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:15:02.696081 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e070de8da3eb4ac5bd1b02f14800cfd5', 'request_id': 'req-782f98ad-4da8-47c4-9614-f1d513d67322'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:02.702130 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e070de8da3eb4ac5bd1b02f14800cfd5', 'request_id': 'req-782f98ad-4da8-47c4-9614-f1d513d67322'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:02.707383 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e070de8da3eb4ac5bd1b02f14800cfd5', 'request_id': 'req-782f98ad-4da8-47c4-9614-f1d513d67322'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:02.782095 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] The token cache is being invalidate because project e070de8da3eb4ac5bd1b02f14800cfd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:15:02.782408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:02.783015 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:02.784551 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1435/2861] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:15:02 2022] DELETE /identity/v3/projects/e070de8da3eb4ac5bd1b02f14800cfd5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:15:32.227572 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290da09e-3cc0-4528-909f-f1473cd3918b service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:15:32.229123 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-290da09e-3cc0-4528-909f-f1473cd3918b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:15:32.316948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290da09e-3cc0-4528-909f-f1473cd3918b service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:15:32.389682 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6606867-c1e8-4bb8-a186-1f4715a237c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:15:32.390409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6606867-c1e8-4bb8-a186-1f4715a237c9 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:15:32.390698 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6606867-c1e8-4bb8-a186-1f4715a237c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:15:32.390972 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6606867-c1e8-4bb8-a186-1f4715a237c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:15:32.392993 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c6606867-c1e8-4bb8-a186-1f4715a237c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:15:32.407078 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6606867-c1e8-4bb8-a186-1f4715a237c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:15:32.408458 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6606867-c1e8-4bb8-a186-1f4715a237c9 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:15:32.420007 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1427/2862] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:15:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:15:32.488267 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:15:32.489922 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:15:32.550002 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f98ad-4da8-47c4-9614-f1d513d67322 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:15:32.553990 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7ab6a-0b06-45ea-99b7-6f297d2a98e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:15:32.554647 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7ab6a-0b06-45ea-99b7-6f297d2a98e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:15:32.554932 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7ab6a-0b06-45ea-99b7-6f297d2a98e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:15:32.555212 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7ab6a-0b06-45ea-99b7-6f297d2a98e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:15:32.556999 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-55d7ab6a-0b06-45ea-99b7-6f297d2a98e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:15:32.567777 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7ab6a-0b06-45ea-99b7-6f297d2a98e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:15:32.569248 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7ab6a-0b06-45ea-99b7-6f297d2a98e2 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:15:32.577619 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1436/2863] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:15:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:15:40.245034 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6606867-c1e8-4bb8-a186-1f4715a237c9 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:15:40.246608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c6606867-c1e8-4bb8-a186-1f4715a237c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:15:40.261879 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6606867-c1e8-4bb8-a186-1f4715a237c9 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:15:40.267448 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff77fbc-2561-450f-81bc-004accd457a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:15:40.268118 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff77fbc-2561-450f-81bc-004accd457a0 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:15:40.268402 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff77fbc-2561-450f-81bc-004accd457a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:15:40.268680 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff77fbc-2561-450f-81bc-004accd457a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:15:40.270429 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9ff77fbc-2561-450f-81bc-004accd457a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:15:40.283208 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff77fbc-2561-450f-81bc-004accd457a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:15:40.284788 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff77fbc-2561-450f-81bc-004accd457a0 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:15:40.296451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1428/2864] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:15:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:15:41.414408 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e09ab2-4e41-423f-9a30-3cb2eee9fa9a None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:15:41.414936 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e09ab2-4e41-423f-9a30-3cb2eee9fa9a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:15:41.415042 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e09ab2-4e41-423f-9a30-3cb2eee9fa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:15:41.432898 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-69e09ab2-4e41-423f-9a30-3cb2eee9fa9a None None] MFA Rules not processed for user `0c5f278013574823afa0ad70db22f866`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:15:41.434139 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-69e09ab2-4e41-423f-9a30-3cb2eee9fa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:15:41.486941 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1437/2865] 10.222.0.35 () {58 vars in 967 bytes} [Wed May 11 21:15:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:15:41.526551 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff77fbc-2561-450f-81bc-004accd457a0 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:15:41.528553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9ff77fbc-2561-450f-81bc-004accd457a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:15:41.594545 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff77fbc-2561-450f-81bc-004accd457a0 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:15:41.599417 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfb13e-bff6-4246-88ab-1829f480ed9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85cb784bf9984abc9977c665a6db1656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:15:41.600056 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfb13e-bff6-4246-88ab-1829f480ed9a service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:15:41.600341 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfb13e-bff6-4246-88ab-1829f480ed9a service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:15:41.600620 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfb13e-bff6-4246-88ab-1829f480ed9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:15:41.608452 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfb13e-bff6-4246-88ab-1829f480ed9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:15:41.610071 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfb13e-bff6-4246-88ab-1829f480ed9a service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:15:41.617951 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1429/2866] 10.222.0.35 () {60 vars in 1384 bytes} [Wed May 11 21:15:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 11 21:15:49.485122 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e09ab2-4e41-423f-9a30-3cb2eee9fa9a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:15:49.486637 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-69e09ab2-4e41-423f-9a30-3cb2eee9fa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:15:49.550838 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e09ab2-4e41-423f-9a30-3cb2eee9fa9a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:15:49.555868 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7cc47-037d-4262-b513-6071da9d7c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:15:49.556740 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7cc47-037d-4262-b513-6071da9d7c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:15:49.557031 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7cc47-037d-4262-b513-6071da9d7c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:15:49.557309 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7cc47-037d-4262-b513-6071da9d7c48 admin admin] PATH_INFO: `/v3/users/5f921c3ec5a44c49a6ee9903e56b6d62` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:15:49.558562 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7cc47-037d-4262-b513-6071da9d7c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f921c3ec5a44c49a6ee9903e56b6d62)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:15:49.560979 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7cc47-037d-4262-b513-6071da9d7c48 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:15:49.738412 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-81d7cc47-037d-4262-b513-6071da9d7c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f921c3ec5a44c49a6ee9903e56b6d62'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:49.810800 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-81d7cc47-037d-4262-b513-6071da9d7c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f921c3ec5a44c49a6ee9903e56b6d62'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:49.817709 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-81d7cc47-037d-4262-b513-6071da9d7c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f921c3ec5a44c49a6ee9903e56b6d62'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:49.818391 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-81d7cc47-037d-4262-b513-6071da9d7c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f921c3ec5a44c49a6ee9903e56b6d62'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:49.819003 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-81d7cc47-037d-4262-b513-6071da9d7c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f921c3ec5a44c49a6ee9903e56b6d62'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:49.835919 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1438/2867] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:15:49 2022] DELETE /identity/v3/users/5f921c3ec5a44c49a6ee9903e56b6d62 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:15:50.047006 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfb13e-bff6-4246-88ab-1829f480ed9a service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:15:50.057720 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfb13e-bff6-4246-88ab-1829f480ed9a service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:15:50.122146 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:15:50.123001 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:15:50.123285 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:15:50.123562 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] PATH_INFO: `/v3/projects/ffc2f645c2fb4fb1baf86bfa44be2d56` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:15:50.124742 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc2f645c2fb4fb1baf86bfa44be2d56)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:15:50.126780 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:15:50.202963 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'request_id': 'req-e8593972-0aca-4e89-a220-22875061f377'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:50.208935 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'request_id': 'req-e8593972-0aca-4e89-a220-22875061f377'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:50.214236 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc2f645c2fb4fb1baf86bfa44be2d56', 'request_id': 'req-e8593972-0aca-4e89-a220-22875061f377'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:50.266142 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] The token cache is being invalidate because project ffc2f645c2fb4fb1baf86bfa44be2d56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:15:50.266417 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:50.267025 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:50.268542 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1430/2868] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:15:50 2022] DELETE /identity/v3/projects/ffc2f645c2fb4fb1baf86bfa44be2d56 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:15:50.272594 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7cc47-037d-4262-b513-6071da9d7c48 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:15:50.275049 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-81d7cc47-037d-4262-b513-6071da9d7c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:15:50.287464 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7cc47-037d-4262-b513-6071da9d7c48 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:15:50.341719 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f64a76-6795-4f51-9c3d-711655022f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:15:50.342609 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64a76-6795-4f51-9c3d-711655022f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:15:50.342965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64a76-6795-4f51-9c3d-711655022f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:15:50.343316 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64a76-6795-4f51-9c3d-711655022f90 admin admin] PATH_INFO: `/v3/users/7abd4a2b6a33476dbd37dfc92f634633` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:15:50.344611 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f64a76-6795-4f51-9c3d-711655022f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abd4a2b6a33476dbd37dfc92f634633)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:15:50.346662 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f64a76-6795-4f51-9c3d-711655022f90 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:15:50.514195 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-23f64a76-6795-4f51-9c3d-711655022f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abd4a2b6a33476dbd37dfc92f634633'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:50.592845 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-23f64a76-6795-4f51-9c3d-711655022f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abd4a2b6a33476dbd37dfc92f634633'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:50.599709 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-23f64a76-6795-4f51-9c3d-711655022f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abd4a2b6a33476dbd37dfc92f634633'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:50.600335 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-23f64a76-6795-4f51-9c3d-711655022f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abd4a2b6a33476dbd37dfc92f634633'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:50.600969 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-23f64a76-6795-4f51-9c3d-711655022f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abd4a2b6a33476dbd37dfc92f634633'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:50.617299 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1439/2869] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:15:50 2022] DELETE /identity/v3/users/7abd4a2b6a33476dbd37dfc92f634633 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:15:50.851825 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:15:50.853235 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:15:50.869035 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8593972-0aca-4e89-a220-22875061f377 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:15:50.928648 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:15:50.929637 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:15:50.929924 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:15:50.930202 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] PATH_INFO: `/v3/projects/2c294bc841144b2ca54af55fa25f1497` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:15:50.931450 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c294bc841144b2ca54af55fa25f1497)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:15:50.933451 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:15:51.009857 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c294bc841144b2ca54af55fa25f1497', 'request_id': 'req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:51.016532 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c294bc841144b2ca54af55fa25f1497', 'request_id': 'req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:51.021808 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c294bc841144b2ca54af55fa25f1497', 'request_id': 'req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:51.078568 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] The token cache is being invalidate because project 2c294bc841144b2ca54af55fa25f1497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:15:51.079177 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:51.079512 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:15:51.081182 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1431/2870] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:15:50 2022] DELETE /identity/v3/projects/2c294bc841144b2ca54af55fa25f1497 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:16:09.153639 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f64a76-6795-4f51-9c3d-711655022f90 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:16:09.156675 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-23f64a76-6795-4f51-9c3d-711655022f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:16:09.211029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f64a76-6795-4f51-9c3d-711655022f90 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:16:09.256983 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f3e55-db71-41cc-97d4-b63a28b706a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:16:09.257658 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3e55-db71-41cc-97d4-b63a28b706a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:16:09.257947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3e55-db71-41cc-97d4-b63a28b706a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:16:09.258225 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3e55-db71-41cc-97d4-b63a28b706a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:16:09.259995 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-e95f3e55-db71-41cc-97d4-b63a28b706a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:16:09.319234 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f3e55-db71-41cc-97d4-b63a28b706a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:16:09.320710 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f3e55-db71-41cc-97d4-b63a28b706a1 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:16:09.330409 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1440/2871] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:16:16.455337 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:16:16.456923 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:16:16.470472 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c424d-0209-44bf-9d2d-ac7a75c2af61 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:16:16.475461 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65272d-6ca0-484f-9443-a6ff31c3ad81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:16:16.476329 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65272d-6ca0-484f-9443-a6ff31c3ad81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:16:16.476608 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65272d-6ca0-484f-9443-a6ff31c3ad81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:16:16.476882 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65272d-6ca0-484f-9443-a6ff31c3ad81 admin admin] PATH_INFO: `/v3/users/3a47bfbd0a2e459cabaa30d74f45811a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:16:16.478081 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65272d-6ca0-484f-9443-a6ff31c3ad81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a47bfbd0a2e459cabaa30d74f45811a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:16:16.479994 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65272d-6ca0-484f-9443-a6ff31c3ad81 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:16:16.658025 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5d65272d-6ca0-484f-9443-a6ff31c3ad81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a47bfbd0a2e459cabaa30d74f45811a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:16.664552 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5d65272d-6ca0-484f-9443-a6ff31c3ad81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a47bfbd0a2e459cabaa30d74f45811a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:16.729593 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5d65272d-6ca0-484f-9443-a6ff31c3ad81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a47bfbd0a2e459cabaa30d74f45811a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:16.730154 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5d65272d-6ca0-484f-9443-a6ff31c3ad81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a47bfbd0a2e459cabaa30d74f45811a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:16.730756 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5d65272d-6ca0-484f-9443-a6ff31c3ad81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a47bfbd0a2e459cabaa30d74f45811a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:16.747484 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1432/2872] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:16:16 2022] DELETE /identity/v3/users/3a47bfbd0a2e459cabaa30d74f45811a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:16:16.986490 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f3e55-db71-41cc-97d4-b63a28b706a1 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:16:16.994345 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f3e55-db71-41cc-97d4-b63a28b706a1 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:16:17.052411 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:16:17.053269 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:16:17.053804 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:16:17.053949 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] PATH_INFO: `/v3/projects/31585e8d8c2b4eb0b052b30e2ce5fa63` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:16:17.055027 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31585e8d8c2b4eb0b052b30e2ce5fa63)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:16:17.056937 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:16:17.146318 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'request_id': 'req-f2c61ae4-7c80-491a-ab02-9766583b6d59'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.152217 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'request_id': 'req-f2c61ae4-7c80-491a-ab02-9766583b6d59'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.157802 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31585e8d8c2b4eb0b052b30e2ce5fa63', 'request_id': 'req-f2c61ae4-7c80-491a-ab02-9766583b6d59'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.208603 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] The token cache is being invalidate because project 31585e8d8c2b4eb0b052b30e2ce5fa63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:16:17.208888 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.209505 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.211065 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1441/2873] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:16:16 2022] DELETE /identity/v3/projects/31585e8d8c2b4eb0b052b30e2ce5fa63 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:16:17.215057 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65272d-6ca0-484f-9443-a6ff31c3ad81 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:16:17.216450 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5d65272d-6ca0-484f-9443-a6ff31c3ad81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:16:17.229363 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65272d-6ca0-484f-9443-a6ff31c3ad81 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:16:17.283244 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aad807-208a-4ce0-b203-3a77f1c7a26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:16:17.284106 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aad807-208a-4ce0-b203-3a77f1c7a26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:16:17.284388 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aad807-208a-4ce0-b203-3a77f1c7a26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:16:17.284663 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aad807-208a-4ce0-b203-3a77f1c7a26b admin admin] PATH_INFO: `/v3/users/055822c3fe864c548bedc59bd7e3edea` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:16:17.285916 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aad807-208a-4ce0-b203-3a77f1c7a26b admin admin] RBAC: Authorizing `identity:delete_user(user_id=055822c3fe864c548bedc59bd7e3edea)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:16:17.287828 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aad807-208a-4ce0-b203-3a77f1c7a26b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:16:17.428938 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37aad807-208a-4ce0-b203-3a77f1c7a26b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055822c3fe864c548bedc59bd7e3edea'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.436130 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37aad807-208a-4ce0-b203-3a77f1c7a26b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055822c3fe864c548bedc59bd7e3edea'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.484110 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37aad807-208a-4ce0-b203-3a77f1c7a26b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055822c3fe864c548bedc59bd7e3edea'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.484827 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37aad807-208a-4ce0-b203-3a77f1c7a26b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055822c3fe864c548bedc59bd7e3edea'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.485455 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-37aad807-208a-4ce0-b203-3a77f1c7a26b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055822c3fe864c548bedc59bd7e3edea'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.502838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1433/2874] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:16:17 2022] DELETE /identity/v3/users/055822c3fe864c548bedc59bd7e3edea => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:16:17.714195 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:16:17.715685 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:16:17.729011 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c61ae4-7c80-491a-ab02-9766583b6d59 admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:16:17.786245 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:16:17.787103 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:16:17.787387 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:16:17.787667 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd admin admin] PATH_INFO: `/v3/projects/386fab40624d4318a27dcfa1379427f7` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:16:17.788842 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=386fab40624d4318a27dcfa1379427f7)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:16:17.790823 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:16:17.872376 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386fab40624d4318a27dcfa1379427f7', 'request_id': 'req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.878994 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386fab40624d4318a27dcfa1379427f7', 'request_id': 'req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.884226 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386fab40624d4318a27dcfa1379427f7', 'request_id': 'req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.952227 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd admin admin] The token cache is being invalidate because project 386fab40624d4318a27dcfa1379427f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80193) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:16:17.952512 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.953135 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-7c5c46bc-3d22-4387-af53-9ba4371e6bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:16:17.954717 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1442/2875] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:16:17 2022] DELETE /identity/v3/projects/386fab40624d4318a27dcfa1379427f7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:16:50.989705 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38a7ee-9048-451d-a852-e7eb933e1453 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:16:50.995628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38a7ee-9048-451d-a852-e7eb933e1453 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:16:50.995628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38a7ee-9048-451d-a852-e7eb933e1453 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:16:50.995628 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1434/2876] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 11 21:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:16:50.997877 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f1c3-5865-4e3a-a934-850908247b88 None None] REQUEST_METHOD: `POST` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:16:50.998358 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f1c3-5865-4e3a-a934-850908247b88 None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:16:50.998483 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f1c3-5865-4e3a-a934-850908247b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:16:51.057214 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.auth.core [None req-7040f1c3-5865-4e3a-a934-850908247b88 None None] MFA Rules not processed for user `8aa998f15cd543338cd0fc8b5a501066`. Rule list: `[]` (Enabled: `True`). {{(pid=80193) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:16:51.058438 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-7040f1c3-5865-4e3a-a934-850908247b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:16:51.132096 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1443/2877] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 11 21:16:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 11 21:16:51.144553 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38a7ee-9048-451d-a852-e7eb933e1453 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:16:51.146243 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0f38a7ee-9048-451d-a852-e7eb933e1453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:16:51.159895 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38a7ee-9048-451d-a852-e7eb933e1453 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:16:51.163376 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9895e-bb9b-4ce7-9cd4-520b3d683505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:16:51.164074 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9895e-bb9b-4ce7-9cd4-520b3d683505 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:16:51.164443 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9895e-bb9b-4ce7-9cd4-520b3d683505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:16:51.164626 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9895e-bb9b-4ce7-9cd4-520b3d683505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:16:51.171322 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9895e-bb9b-4ce7-9cd4-520b3d683505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:16:51.172736 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9895e-bb9b-4ce7-9cd4-520b3d683505 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:16:51.180168 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1435/2878] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:16:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:16:51.260960 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7685703-faa4-4eea-9638-f2cb97ca4e0a None None] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:16:51.261251 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7685703-faa4-4eea-9638-f2cb97ca4e0a None None] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:16:51.261552 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7685703-faa4-4eea-9638-f2cb97ca4e0a None None] PATH_INFO: `/` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:16:51.262955 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1444/2879] 10.222.0.35 () {54 vars in 921 bytes} [Wed May 11 21:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 11 21:16:51.268407 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e388b3-fca2-410e-9d05-28867f965e45 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:16:51.268697 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e388b3-fca2-410e-9d05-28867f965e45 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:16:51.268976 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e388b3-fca2-410e-9d05-28867f965e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:16:51.287610 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-48e388b3-fca2-410e-9d05-28867f965e45 None None] MFA Rules not processed for user `f400b94d3fbc40bdace4860fe83a0891`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 11 21:16:51.288787 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-48e388b3-fca2-410e-9d05-28867f965e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:16:51.370245 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1436/2880] 10.222.0.35 () {58 vars in 1018 bytes} [Wed May 11 21:16:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 11 21:16:51.380547 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7685703-faa4-4eea-9638-f2cb97ca4e0a None None] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:16:51.382285 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c7685703-faa4-4eea-9638-f2cb97ca4e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:16:51.395762 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7685703-faa4-4eea-9638-f2cb97ca4e0a None None] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:16:51.399302 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40e22b-35b3-4e6c-a7e3-c0d4737811f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8aa998f15cd543338cd0fc8b5a501066', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:16:51.399926 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40e22b-35b3-4e6c-a7e3-c0d4737811f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:16:51.400215 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40e22b-35b3-4e6c-a7e3-c0d4737811f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:16:51.400493 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40e22b-35b3-4e6c-a7e3-c0d4737811f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:16:51.410470 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40e22b-35b3-4e6c-a7e3-c0d4737811f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:16:51.411889 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40e22b-35b3-4e6c-a7e3-c0d4737811f8 service neutron] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:16:51.422350 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1445/2881] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:16:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:16:51.480810 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e388b3-fca2-410e-9d05-28867f965e45 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:16:51.482227 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-48e388b3-fca2-410e-9d05-28867f965e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:16:51.552593 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e388b3-fca2-410e-9d05-28867f965e45 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:16:51.558201 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8add506-11e6-4ae1-9273-af15f57c1836 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59cb32d2807549699e37b27ca97d351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:16:51.558881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8add506-11e6-4ae1-9273-af15f57c1836 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:16:51.559155 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8add506-11e6-4ae1-9273-af15f57c1836 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:16:51.559449 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8add506-11e6-4ae1-9273-af15f57c1836 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:16:51.561203 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c8add506-11e6-4ae1-9273-af15f57c1836 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:16:51.572838 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8add506-11e6-4ae1-9273-af15f57c1836 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:16:51.574434 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8add506-11e6-4ae1-9273-af15f57c1836 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:16:51.583948 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1437/2882] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:16:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:16:53.089127 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40e22b-35b3-4e6c-a7e3-c0d4737811f8 service neutron] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:16:53.090674 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-5c40e22b-35b3-4e6c-a7e3-c0d4737811f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:16:53.106062 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40e22b-35b3-4e6c-a7e3-c0d4737811f8 service neutron] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:16:53.111874 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00181fa0-f693-4f0f-bb0c-d9affbfe5407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f400b94d3fbc40bdace4860fe83a0891', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:16:53.112665 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00181fa0-f693-4f0f-bb0c-d9affbfe5407 service nova] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:16:53.112953 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00181fa0-f693-4f0f-bb0c-d9affbfe5407 service nova] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:16:53.113238 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00181fa0-f693-4f0f-bb0c-d9affbfe5407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:16:53.115071 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-00181fa0-f693-4f0f-bb0c-d9affbfe5407 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:16:53.128077 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00181fa0-f693-4f0f-bb0c-d9affbfe5407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:16:53.129755 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00181fa0-f693-4f0f-bb0c-d9affbfe5407 service nova] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:16:53.141367 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1446/2883] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:16:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:17:54.149611 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8add506-11e6-4ae1-9273-af15f57c1836 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:17:54.150993 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c8add506-11e6-4ae1-9273-af15f57c1836 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:17:54.185535 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8add506-11e6-4ae1-9273-af15f57c1836 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:17:54.190438 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02498236-129c-4051-891c-be2530128e33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59cb32d2807549699e37b27ca97d351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:17:54.191064 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02498236-129c-4051-891c-be2530128e33 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:17:54.191347 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02498236-129c-4051-891c-be2530128e33 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:17:54.191621 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02498236-129c-4051-891c-be2530128e33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:17:54.193403 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-02498236-129c-4051-891c-be2530128e33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:17:54.204289 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02498236-129c-4051-891c-be2530128e33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:17:54.205881 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02498236-129c-4051-891c-be2530128e33 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:17:54.215439 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1438/2884] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:17:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 11 21:18:34.168810 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00181fa0-f693-4f0f-bb0c-d9affbfe5407 service nova] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:18:34.170280 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-00181fa0-f693-4f0f-bb0c-d9affbfe5407 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:18:34.266390 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00181fa0-f693-4f0f-bb0c-d9affbfe5407 service nova] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:18:34.271032 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872b4d9-0742-447b-9fdd-c5a6b12121ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:18:34.271846 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872b4d9-0742-447b-9fdd-c5a6b12121ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:18:34.272124 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872b4d9-0742-447b-9fdd-c5a6b12121ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:18:34.272396 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872b4d9-0742-447b-9fdd-c5a6b12121ac admin admin] PATH_INFO: `/v3/users/05901232e0534f6fa130e78584b703ee` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:18:34.273615 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872b4d9-0742-447b-9fdd-c5a6b12121ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=05901232e0534f6fa130e78584b703ee)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:18:34.275534 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872b4d9-0742-447b-9fdd-c5a6b12121ac admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:18:34.500387 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6872b4d9-0742-447b-9fdd-c5a6b12121ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05901232e0534f6fa130e78584b703ee'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:34.567452 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6872b4d9-0742-447b-9fdd-c5a6b12121ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05901232e0534f6fa130e78584b703ee'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:34.574900 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6872b4d9-0742-447b-9fdd-c5a6b12121ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05901232e0534f6fa130e78584b703ee'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:34.575588 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6872b4d9-0742-447b-9fdd-c5a6b12121ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05901232e0534f6fa130e78584b703ee'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:34.576201 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6872b4d9-0742-447b-9fdd-c5a6b12121ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05901232e0534f6fa130e78584b703ee'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:34.593041 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1447/2885] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:18:34 2022] DELETE /identity/v3/users/05901232e0534f6fa130e78584b703ee => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:18:34.821046 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02498236-129c-4051-891c-be2530128e33 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:18:34.830850 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02498236-129c-4051-891c-be2530128e33 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:18:34.888589 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:18:34.889453 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:18:34.889771 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:18:34.890048 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] PATH_INFO: `/v3/projects/715fee0f9c6e4c73b716faa3b978208c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:18:34.891228 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=715fee0f9c6e4c73b716faa3b978208c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:18:34.893163 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:18:34.990409 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715fee0f9c6e4c73b716faa3b978208c', 'request_id': 'req-e94e6d51-45dd-4218-9e73-2200acd207fe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:34.996489 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715fee0f9c6e4c73b716faa3b978208c', 'request_id': 'req-e94e6d51-45dd-4218-9e73-2200acd207fe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:35.002075 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715fee0f9c6e4c73b716faa3b978208c', 'request_id': 'req-e94e6d51-45dd-4218-9e73-2200acd207fe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:35.093466 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] The token cache is being invalidate because project 715fee0f9c6e4c73b716faa3b978208c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:18:35.093693 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:35.094313 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:35.095850 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1439/2886] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:18:34 2022] DELETE /identity/v3/projects/715fee0f9c6e4c73b716faa3b978208c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:18:35.099903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872b4d9-0742-447b-9fdd-c5a6b12121ac admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:18:35.101390 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6872b4d9-0742-447b-9fdd-c5a6b12121ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:18:35.114223 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872b4d9-0742-447b-9fdd-c5a6b12121ac admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:18:35.168095 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bb061-0098-4b98-82f5-88b4bf449b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:18:35.168965 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bb061-0098-4b98-82f5-88b4bf449b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:18:35.169522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bb061-0098-4b98-82f5-88b4bf449b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:18:35.169522 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bb061-0098-4b98-82f5-88b4bf449b3d admin admin] PATH_INFO: `/v3/users/054757ba46614be1bc708f193cbe0427` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:18:35.170727 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bb061-0098-4b98-82f5-88b4bf449b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=054757ba46614be1bc708f193cbe0427)` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:18:35.172649 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bb061-0098-4b98-82f5-88b4bf449b3d admin admin] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:18:35.392887 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e3bb061-0098-4b98-82f5-88b4bf449b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '054757ba46614be1bc708f193cbe0427'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:35.464681 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e3bb061-0098-4b98-82f5-88b4bf449b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '054757ba46614be1bc708f193cbe0427'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:35.471579 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e3bb061-0098-4b98-82f5-88b4bf449b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '054757ba46614be1bc708f193cbe0427'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:35.472238 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e3bb061-0098-4b98-82f5-88b4bf449b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '054757ba46614be1bc708f193cbe0427'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:35.472840 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.notifications [None req-6e3bb061-0098-4b98-82f5-88b4bf449b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '054757ba46614be1bc708f193cbe0427'} {{(pid=80193) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:35.489194 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1448/2887] 10.222.0.35 () {58 vars in 1223 bytes} [Wed May 11 21:18:35 2022] DELETE /identity/v3/users/054757ba46614be1bc708f193cbe0427 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:18:35.734505 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:18:35.735934 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:18:35.749004 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e6d51-45dd-4218-9e73-2200acd207fe admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:18:35.805753 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ca928-b91f-41f0-a51d-2f62b0295fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3529d1a9e25d41d4bfc8bab9cf496381', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2831911a3b2e4e6f87ef9844395d784e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:18:35.806645 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca928-b91f-41f0-a51d-2f62b0295fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:18:35.806926 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca928-b91f-41f0-a51d-2f62b0295fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:18:35.807205 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca928-b91f-41f0-a51d-2f62b0295fbe admin admin] PATH_INFO: `/v3/projects/d907c79abcf14c0b943fa50af057aa9a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:18:35.808969 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ca928-b91f-41f0-a51d-2f62b0295fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d907c79abcf14c0b943fa50af057aa9a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:18:35.810922 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ca928-b91f-41f0-a51d-2f62b0295fbe admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:18:35.898031 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-190ca928-b91f-41f0-a51d-2f62b0295fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd907c79abcf14c0b943fa50af057aa9a', 'request_id': 'req-190ca928-b91f-41f0-a51d-2f62b0295fbe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:35.904185 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-190ca928-b91f-41f0-a51d-2f62b0295fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd907c79abcf14c0b943fa50af057aa9a', 'request_id': 'req-190ca928-b91f-41f0-a51d-2f62b0295fbe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:35.909955 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-190ca928-b91f-41f0-a51d-2f62b0295fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd907c79abcf14c0b943fa50af057aa9a', 'request_id': 'req-190ca928-b91f-41f0-a51d-2f62b0295fbe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:35.972240 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-190ca928-b91f-41f0-a51d-2f62b0295fbe admin admin] The token cache is being invalidate because project d907c79abcf14c0b943fa50af057aa9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 11 21:18:35.972526 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-190ca928-b91f-41f0-a51d-2f62b0295fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:35.973170 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-190ca928-b91f-41f0-a51d-2f62b0295fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 11 21:18:35.974767 dv-cinder-841467-1-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1440/2888] 10.222.0.35 () {58 vars in 1232 bytes} [Wed May 11 21:18:35 2022] DELETE /identity/v3/projects/d907c79abcf14c0b943fa50af057aa9a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 11 21:23:00.142017 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bb061-0098-4b98-82f5-88b4bf449b3d admin admin] Authenticating user token {{(pid=80193) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 11 21:23:00.143438 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-6e3bb061-0098-4b98-82f5-88b4bf449b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:23:00.210112 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bb061-0098-4b98-82f5-88b4bf449b3d admin admin] Validating token access rules against request {{(pid=80193) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 11 21:23:00.266736 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb1609-f96d-4da8-a4e2-142e820ed8f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59cb32d2807549699e37b27ca97d351c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c03e5fec995436aa5424d2be2e268aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80193) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 11 21:23:00.267386 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb1609-f96d-4da8-a4e2-142e820ed8f4 service placement] REQUEST_METHOD: `GET` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 11 21:23:00.267673 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb1609-f96d-4da8-a4e2-142e820ed8f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 11 21:23:00.267947 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb1609-f96d-4da8-a4e2-142e820ed8f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80193) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 11 21:23:00.269718 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.fernet_utils [None req-c6eb1609-f96d-4da8-a4e2-142e820ed8f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80193) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 11 21:23:00.281029 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb1609-f96d-4da8-a4e2-142e820ed8f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 11 21:23:00.282903 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb1609-f96d-4da8-a4e2-142e820ed8f4 service placement] RBAC: Authorization granted {{(pid=80193) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 11 21:23:00.292452 dv-cinder-841467-1-iscsi devstack@keystone.service[80193]: [pid: 80193|app: 0|req: 1449/2889] 10.222.0.35 () {60 vars in 1365 bytes} [Wed May 11 21:23:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)